Jun 10 18:59:01.815081 ip-10-0-143-108 systemd[1]: Starting Kubernetes Kubelet... Jun 10 18:59:02.213291 ip-10-0-143-108 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 18:59:02.213291 ip-10-0-143-108 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 18:59:02.213291 ip-10-0-143-108 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 18:59:02.213291 ip-10-0-143-108 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 18:59:02.213291 ip-10-0-143-108 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 18:59:02.215025 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.214934 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 18:59:02.222099 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222074 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:59:02.222099 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222099 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:59:02.222099 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222103 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222107 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222111 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222116 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222119 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222122 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222126 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222129 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222131 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222134 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222137 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222139 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222153 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222156 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222159 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222161 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222164 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222166 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222169 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222172 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:59:02.222209 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222174 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222177 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222180 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222182 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222185 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222187 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222190 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222193 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222195 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222198 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222200 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222203 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222205 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222208 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222211 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222214 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222217 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222219 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222222 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222225 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:59:02.222693 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222227 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222232 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222234 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222237 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222239 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222242 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222244 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222247 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222249 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222255 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222259 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222261 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222264 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222267 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222270 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222272 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222275 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222277 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222282 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:59:02.223237 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222285 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222287 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222290 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222293 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222295 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222297 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222300 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222303 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222306 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222308 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222311 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222315 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222319 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222322 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222326 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222330 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222333 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222336 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222339 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222341 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:59:02.223705 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222344 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222346 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222349 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222351 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222353 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222356 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222359 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222361 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222363 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222366 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222369 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222372 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222375 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222377 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222380 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222382 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222386 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.222389 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223194 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:59:02.224211 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223203 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223207 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223210 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223213 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223216 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223218 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223221 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223224 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223227 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223230 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223233 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223236 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223239 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223241 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223245 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223248 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223250 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223253 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223255 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:59:02.224665 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223258 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223261 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223263 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223266 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223268 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223273 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223278 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223281 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223284 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223286 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223289 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223291 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223294 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223297 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223300 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223302 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223306 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223308 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223311 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223314 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:59:02.225155 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223316 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223319 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223322 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223324 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223327 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223329 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223332 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223334 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223336 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223339 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223341 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223344 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223346 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223349 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223351 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223353 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223356 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223359 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223361 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223364 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:59:02.225642 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223366 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223369 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223372 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223375 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223379 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223382 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223385 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223388 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223390 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223393 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223395 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223398 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223400 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223403 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223406 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223409 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223411 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223414 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223416 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223419 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:59:02.226156 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223421 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223425 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223427 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223430 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223432 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223435 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223437 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223440 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223443 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223446 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223449 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223451 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223454 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223457 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223460 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223462 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223464 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223469 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223472 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:59:02.226686 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223954 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223980 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223983 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223994 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.223998 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224001 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224004 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224007 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224011 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224013 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224016 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224019 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224021 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224024 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224026 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224029 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224032 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224034 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224037 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224039 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:59:02.227177 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224042 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224044 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224047 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224050 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224052 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224055 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224058 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224060 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224063 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224065 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224068 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224071 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224075 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224079 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224082 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224085 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224088 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224090 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224093 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224095 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:59:02.227650 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224098 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224108 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224111 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224114 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224116 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224119 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224121 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224124 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224128 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224130 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224132 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224135 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224138 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224140 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224143 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224145 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224147 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224150 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224153 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224155 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:59:02.228152 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224157 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224160 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224163 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224166 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224168 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224171 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224174 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224176 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224179 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224181 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224186 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224188 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224191 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224194 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224202 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224204 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224207 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224209 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224212 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224215 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:59:02.228666 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224217 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224220 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224222 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224225 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224230 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224233 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224236 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224239 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224241 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224244 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224246 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224248 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224251 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224253 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224258 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224261 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224264 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224267 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.224269 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:59:02.229178 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224345 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224358 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224374 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224382 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224388 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224395 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224400 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224404 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224414 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224418 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224421 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224424 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224428 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224431 2562 flags.go:64] FLAG: --cgroup-root="" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224434 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224436 2562 flags.go:64] FLAG: --client-ca-file="" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224439 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224442 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224448 2562 flags.go:64] FLAG: --cluster-domain="" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224451 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224454 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224457 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224462 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224465 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 18:59:02.229624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224469 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224472 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224475 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224480 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224485 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224489 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224494 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224497 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224502 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224505 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224508 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224513 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224516 2562 flags.go:64] FLAG: --enable-server="true" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224519 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224524 2562 flags.go:64] FLAG: --event-burst="100" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224527 2562 flags.go:64] FLAG: --event-qps="50" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224530 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224534 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224537 2562 flags.go:64] FLAG: --eviction-hard="" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224541 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224544 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224547 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224550 2562 flags.go:64] FLAG: --eviction-soft="" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224553 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224555 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 18:59:02.230205 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224558 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224561 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224567 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224570 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224572 2562 flags.go:64] FLAG: --feature-gates="" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224576 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224579 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224582 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224585 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224588 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224591 2562 flags.go:64] FLAG: --help="false" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224594 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224598 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224600 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224603 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224607 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224610 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224613 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224617 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224620 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224623 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224626 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224629 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224632 2562 flags.go:64] FLAG: --kube-reserved="" Jun 10 18:59:02.230835 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224635 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224638 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224641 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224644 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224647 2562 flags.go:64] FLAG: --lock-file="" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224650 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224653 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224656 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224662 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224665 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224669 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224672 2562 flags.go:64] FLAG: --logging-format="text" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224675 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224678 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224681 2562 flags.go:64] FLAG: --manifest-url="" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224684 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224689 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224692 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224697 2562 flags.go:64] FLAG: --max-pods="110" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224700 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224702 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224706 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224709 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224711 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224714 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 18:59:02.231430 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224717 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224729 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224732 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224735 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224739 2562 flags.go:64] FLAG: --pod-cidr="" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224741 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224747 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224750 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224768 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224771 2562 flags.go:64] FLAG: --port="10250" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224775 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224778 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d2aae7bccdc91146" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224781 2562 flags.go:64] FLAG: --qos-reserved="" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224784 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224787 2562 flags.go:64] FLAG: --register-node="true" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224790 2562 flags.go:64] FLAG: --register-with-taints="" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224799 2562 flags.go:64] FLAG: --registry-burst="10" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224802 2562 flags.go:64] FLAG: --registry-qps="5" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224806 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224809 2562 flags.go:64] FLAG: --reserved-memory="" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224813 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224816 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224819 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224822 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224825 2562 flags.go:64] FLAG: --runonce="false" Jun 10 18:59:02.232086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224828 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224831 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224834 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224837 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224840 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224843 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224846 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224849 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224853 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224856 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224859 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224862 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224865 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224868 2562 flags.go:64] FLAG: --system-cgroups="" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224871 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224876 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224879 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224882 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224886 2562 flags.go:64] FLAG: --tls-min-version="" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224889 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224892 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224895 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224898 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224901 2562 flags.go:64] FLAG: --v="2" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224905 2562 flags.go:64] FLAG: --version="false" Jun 10 18:59:02.232744 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224911 2562 flags.go:64] FLAG: --vmodule="" Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224915 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.224918 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225045 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225049 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225052 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225055 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225058 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225061 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225064 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225068 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225070 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225073 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225076 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225079 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225082 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225085 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225088 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225090 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225093 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:59:02.233374 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225095 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225098 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225100 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225104 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225108 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225111 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225114 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225117 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225120 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225122 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225125 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225128 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225132 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225135 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225138 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225141 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225143 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225146 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225149 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225151 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:59:02.233875 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225154 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225156 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225159 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225161 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225164 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225167 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225169 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225174 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225177 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225180 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225182 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225185 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225188 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225190 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225193 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225195 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225199 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225203 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225206 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:59:02.234401 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225209 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225212 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225214 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225217 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225219 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225222 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225225 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225227 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225230 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225232 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225234 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225237 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225239 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225242 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225245 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225247 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225249 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225252 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225254 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:59:02.234874 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225256 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225259 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225262 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225264 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225267 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225269 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225272 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225274 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225277 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225280 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225282 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225284 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225287 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225290 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225292 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225295 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225297 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225299 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225302 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:59:02.235336 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225305 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225307 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225310 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225312 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.225315 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.225323 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.233302 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.233324 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.233345 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.233352 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233413 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233420 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233425 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233428 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:59:02.235805 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233432 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233434 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233437 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233439 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233442 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233445 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233447 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233450 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233453 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233456 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233458 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233461 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233464 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233466 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233469 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233471 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233474 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233476 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233479 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233482 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:59:02.236176 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233484 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233487 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233490 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233492 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233495 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233499 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233502 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233505 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233507 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233510 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233512 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233515 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233517 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233520 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233524 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233542 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233545 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233548 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233551 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233554 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:59:02.236715 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233557 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233559 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233562 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233564 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233567 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233569 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233572 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233576 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233579 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233582 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233585 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233588 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233590 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233593 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233596 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233599 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233602 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233604 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233608 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:59:02.237278 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233611 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233614 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233616 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233619 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233621 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233623 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233626 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233628 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233631 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233633 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233635 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233638 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233640 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233643 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233645 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233647 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233650 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233653 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233655 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:59:02.237740 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233658 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233660 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233663 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233665 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233668 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233670 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233674 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233677 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233680 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233683 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233685 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233688 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233690 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233693 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233696 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233698 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:59:02.238210 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233701 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.233706 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233847 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233852 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233855 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233858 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233861 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233863 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233866 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233868 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233871 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233873 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233876 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233878 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233881 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 18:59:02.238839 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233884 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233886 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233889 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233892 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233894 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233897 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233899 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233901 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233904 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233907 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233909 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233913 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233916 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233918 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233921 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233924 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233927 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233929 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233932 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233934 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 18:59:02.239472 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233936 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233939 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233941 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233943 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233946 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233948 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233951 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233953 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233956 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233958 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233961 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233964 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233966 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233969 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233971 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233974 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233977 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233980 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233982 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233985 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 18:59:02.240026 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233987 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233989 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233992 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233994 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.233998 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234002 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234004 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234007 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234010 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234012 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234014 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234017 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234020 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234022 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234025 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234027 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234030 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234032 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234034 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 18:59:02.240710 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234037 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234039 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234042 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234046 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234049 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234052 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234054 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234057 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234060 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234063 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234065 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234068 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234071 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234073 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234077 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234080 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234083 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234086 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234089 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 18:59:02.241193 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234092 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234094 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234097 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234100 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234102 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234105 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234107 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:02.234110 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.234115 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.234249 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.236412 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.238203 2562 server.go:1019] "Starting client certificate rotation" Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.238335 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 18:59:02.241709 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.238403 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 18:59:02.242064 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.240697 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 18:59:02.242461 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.242368 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 18:59:02.260573 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.260544 2562 log.go:25] "Validated CRI v1 runtime API" Jun 10 18:59:02.263077 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.263058 2562 log.go:25] "Validated CRI v1 image API" Jun 10 18:59:02.265225 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.265202 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 18:59:02.267912 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.267887 2562 fs.go:135] Filesystem UUIDs: map[25e579d8-5fda-4b02-abae-b858d80d9944:/dev/nvme0n1p4 745823b4-c239-420e-8cf2-f3fd87bc6a44:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 10 18:59:02.267912 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.267909 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 18:59:02.273102 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.272961 2562 manager.go:216] Machine: {Timestamp:2026-06-10 18:59:02.271696544 +0000 UTC m=+0.339144896 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101505 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec271a201985fded212b1e240028de1c SystemUUID:ec271a20-1985-fded-212b-1e240028de1c BootID:03a5937f-9537-4953-bcff-5189dcda62b7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:30:c9:51:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:30:c9:51:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:fd:b0:05:0e:70 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 18:59:02.273102 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.273078 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 18:59:02.273250 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.273178 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 18:59:02.275624 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.275607 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 18:59:02.276390 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.276357 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 18:59:02.276542 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.276395 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 18:59:02.277099 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.277089 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 18:59:02.277136 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.277102 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 18:59:02.277136 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.277110 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 18:59:02.277854 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.277843 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 18:59:02.278609 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.278600 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 18:59:02.282039 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282025 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 18:59:02.282159 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282150 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 18:59:02.282194 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282181 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 10 18:59:02.282194 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282191 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 18:59:02.282257 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282204 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 18:59:02.282257 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282216 2562 kubelet.go:398] "Adding apiserver pod source" Jun 10 18:59:02.282257 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282224 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 18:59:02.282618 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282605 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 18:59:02.282705 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.282626 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 18:59:02.285185 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.285166 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 18:59:02.293115 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.293098 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 18:59:02.293194 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.293131 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 18:59:02.293987 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.293975 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.293992 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.293998 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294004 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294012 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294018 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294025 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294030 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294037 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 18:59:02.294040 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294043 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 18:59:02.294266 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294052 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 18:59:02.294266 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294058 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 18:59:02.294934 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294924 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 18:59:02.294934 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.294934 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 18:59:02.298259 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.298244 2562 server.go:1268] "Started kubelet" Jun 10 18:59:02.298397 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.298364 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 18:59:02.298520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.298388 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 18:59:02.298520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.298477 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 18:59:02.299124 ip-10-0-143-108 systemd[1]: Started Kubernetes Kubelet. Jun 10 18:59:02.303082 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.303044 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 18:59:02.303166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.303151 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 18:59:02.303342 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.303316 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 18:59:02.303847 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.303743 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 18:59:02.304672 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.304645 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 10 18:59:02.306135 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.306095 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 18:59:02.308997 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.308805 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 18:59:02.308997 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.308816 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 18:59:02.309267 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.309235 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:02.309898 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.309877 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 18:59:02.309898 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.309900 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 18:59:02.310056 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.309884 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 18:59:02.310056 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310035 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 10 18:59:02.310056 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310044 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 10 18:59:02.310188 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310091 2562 factory.go:55] Registering systemd factory Jun 10 18:59:02.310188 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310107 2562 factory.go:223] Registration of the systemd container factory successfully Jun 10 18:59:02.310414 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310399 2562 factory.go:153] Registering CRI-O factory Jun 10 18:59:02.310492 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310418 2562 factory.go:223] Registration of the crio container factory successfully Jun 10 18:59:02.310541 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310527 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 18:59:02.310596 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310555 2562 factory.go:103] Registering Raw factory Jun 10 18:59:02.310596 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310571 2562 manager.go:1196] Started watching for new ooms in manager Jun 10 18:59:02.310693 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.309768 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18b7cd54edc2621f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-06-10 18:59:02.298206751 +0000 UTC m=+0.365655159,LastTimestamp:2026-06-10 18:59:02.298206751 +0000 UTC m=+0.365655159,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jun 10 18:59:02.310949 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.310936 2562 manager.go:349] Starting recovery of all containers Jun 10 18:59:02.315476 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.315440 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 18:59:02.315586 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.315545 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 18:59:02.320864 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.320843 2562 manager.go:354] Recovery completed Jun 10 18:59:02.325100 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.325085 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:02.327268 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.327252 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:02.327335 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.327281 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:02.327335 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.327296 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:02.327906 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.327890 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 18:59:02.327906 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.327907 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 18:59:02.328027 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.327911 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:02.328027 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.327924 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 10 18:59:02.328794 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.328777 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:02.328864 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.328811 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:02.328864 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.328828 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:02.329797 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.329783 2562 policy_none.go:49] "None policy: Start" Jun 10 18:59:02.329797 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.329800 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 18:59:02.329888 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.329810 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 18:59:02.330267 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.330185 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18b7cd54ef7dd302 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-108.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-06-10 18:59:02.327268098 +0000 UTC m=+0.394716449,LastTimestamp:2026-06-10 18:59:02.327268098 +0000 UTC m=+0.394716449,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jun 10 18:59:02.330861 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.330848 2562 policy_none.go:47] "Start" Jun 10 18:59:02.339229 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.339062 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18b7cd54ef7e1a9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-108.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-06-10 18:59:02.327286429 +0000 UTC m=+0.394734781,LastTimestamp:2026-06-10 18:59:02.327286429 +0000 UTC m=+0.394734781,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jun 10 18:59:02.344730 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.344658 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18b7cd54ef7e506d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-108.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-06-10 18:59:02.327300205 +0000 UTC m=+0.394748558,LastTimestamp:2026-06-10 18:59:02.327300205 +0000 UTC m=+0.394748558,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jun 10 18:59:02.348657 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.348564 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-108.ec2.internal.18b7cd54ef7dd302\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18b7cd54ef7dd302 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-108.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-06-10 18:59:02.327268098 +0000 UTC m=+0.394716449,LastTimestamp:2026-06-10 18:59:02.32879438 +0000 UTC m=+0.396242734,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jun 10 18:59:02.357609 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.357531 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-108.ec2.internal.18b7cd54ef7e1a9d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18b7cd54ef7e1a9d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-108.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-06-10 18:59:02.327286429 +0000 UTC m=+0.394734781,LastTimestamp:2026-06-10 18:59:02.328819305 +0000 UTC m=+0.396267662,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jun 10 18:59:02.361102 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.361081 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hp269" Jun 10 18:59:02.371252 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.371174 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-108.ec2.internal.18b7cd54ef7e506d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-108.ec2.internal.18b7cd54ef7e506d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-108.ec2.internal,UID:ip-10-0-143-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-108.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-108.ec2.internal,},FirstTimestamp:2026-06-10 18:59:02.327300205 +0000 UTC m=+0.394748558,LastTimestamp:2026-06-10 18:59:02.328834416 +0000 UTC m=+0.396282773,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-108.ec2.internal,}" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.372468 2562 manager.go:337] "Starting Device Plugin manager" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.372505 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.372519 2562 server.go:87] "Starting device plugin registration server" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.372840 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.372854 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.372934 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.373036 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.373046 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.373577 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hp269" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.373834 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 18:59:02.382009 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.373887 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:02.382386 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.382134 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 18:59:02.383570 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.383548 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 18:59:02.383643 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.383600 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 18:59:02.383643 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.383625 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 18:59:02.383708 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.383667 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 18:59:02.386439 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.386413 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:59:02.473341 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.473257 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:02.474291 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.474273 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:02.474399 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.474306 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:02.474399 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.474316 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:02.474399 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.474341 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.484421 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.484386 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal"] Jun 10 18:59:02.484477 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.484462 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:02.486154 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.486136 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:02.486228 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.486167 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:02.486228 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.486181 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:02.487691 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.487677 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:02.487861 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.487847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.487901 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.487877 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:02.488406 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.488392 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:02.488459 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.488415 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:02.488459 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.488428 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:02.488526 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.488413 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:02.488559 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.488530 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:02.488559 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.488544 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:02.489808 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.489793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.489854 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.489825 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:02.490512 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.490497 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:02.490585 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.490527 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:02.490585 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.490541 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:02.495998 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.495982 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.496065 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.496004 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-108.ec2.internal\": node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:02.511903 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.511868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95c1e9bf236acb5d2d1045ded4a3bd9b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-108.ec2.internal\" (UID: \"95c1e9bf236acb5d2d1045ded4a3bd9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.512032 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.511917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52218d1f5d18048d0e5fc01b23ae90ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"52218d1f5d18048d0e5fc01b23ae90ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.512032 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.511988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52218d1f5d18048d0e5fc01b23ae90ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"52218d1f5d18048d0e5fc01b23ae90ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.519604 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.519579 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-108.ec2.internal\" not found" node="ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.524179 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.524162 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-108.ec2.internal\" not found" node="ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.532509 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.532488 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:02.612240 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.612210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95c1e9bf236acb5d2d1045ded4a3bd9b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-108.ec2.internal\" (UID: \"95c1e9bf236acb5d2d1045ded4a3bd9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.612349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.612244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52218d1f5d18048d0e5fc01b23ae90ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"52218d1f5d18048d0e5fc01b23ae90ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.612349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.612272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52218d1f5d18048d0e5fc01b23ae90ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"52218d1f5d18048d0e5fc01b23ae90ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.612349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.612317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/52218d1f5d18048d0e5fc01b23ae90ee-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"52218d1f5d18048d0e5fc01b23ae90ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.612349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.612326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/52218d1f5d18048d0e5fc01b23ae90ee-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal\" (UID: \"52218d1f5d18048d0e5fc01b23ae90ee\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.612469 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.612326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/95c1e9bf236acb5d2d1045ded4a3bd9b-config\") pod \"kube-apiserver-proxy-ip-10-0-143-108.ec2.internal\" (UID: \"95c1e9bf236acb5d2d1045ded4a3bd9b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.633387 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.633335 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:02.734096 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.734034 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:02.824550 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.824516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.829642 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:02.829619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jun 10 18:59:02.834152 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.834132 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:02.934273 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:02.934231 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.034884 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.034807 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.135470 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.135441 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.236053 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.236021 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.237127 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.237106 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 18:59:03.237286 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.237268 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 18:59:03.287808 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:03.287721 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52218d1f5d18048d0e5fc01b23ae90ee.slice/crio-43dce63c0348c1cdb113e7fdfd93dbf1e98ebb25114f9da20c7806de123d41c8 WatchSource:0}: Error finding container 43dce63c0348c1cdb113e7fdfd93dbf1e98ebb25114f9da20c7806de123d41c8: Status 404 returned error can't find the container with id 43dce63c0348c1cdb113e7fdfd93dbf1e98ebb25114f9da20c7806de123d41c8 Jun 10 18:59:03.287957 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:03.287941 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c1e9bf236acb5d2d1045ded4a3bd9b.slice/crio-90b1380eb0637d2cfd33a734579d809f50213ad6b586a474879db480ec2bc5a5 WatchSource:0}: Error finding container 90b1380eb0637d2cfd33a734579d809f50213ad6b586a474879db480ec2bc5a5: Status 404 returned error can't find the container with id 90b1380eb0637d2cfd33a734579d809f50213ad6b586a474879db480ec2bc5a5 Jun 10 18:59:03.291842 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.291824 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 18:59:03.336495 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.336451 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.376815 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.376747 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 18:54:02 +0000 UTC" deadline="2028-01-10 05:57:56.004882509 +0000 UTC" Jun 10 18:59:03.376898 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.376817 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13882h58m52.628074228s" Jun 10 18:59:03.387251 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.387196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" event={"ID":"95c1e9bf236acb5d2d1045ded4a3bd9b","Type":"ContainerStarted","Data":"90b1380eb0637d2cfd33a734579d809f50213ad6b586a474879db480ec2bc5a5"} Jun 10 18:59:03.388240 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.388216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" event={"ID":"52218d1f5d18048d0e5fc01b23ae90ee","Type":"ContainerStarted","Data":"43dce63c0348c1cdb113e7fdfd93dbf1e98ebb25114f9da20c7806de123d41c8"} Jun 10 18:59:03.436798 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.436769 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.460942 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.460918 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 18:59:03.462016 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.461998 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientMemory" Jun 10 18:59:03.462099 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.462038 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 18:59:03.462099 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.462053 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeHasSufficientPID" Jun 10 18:59:03.530061 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.530027 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:59:03.537395 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.537374 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.638029 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.637943 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.734923 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.734817 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:59:03.739032 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:03.739007 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-108.ec2.internal\" not found" Jun 10 18:59:03.752077 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.752029 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:59:03.810120 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.810083 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" Jun 10 18:59:03.834294 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.834262 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 18:59:03.835310 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.835283 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" Jun 10 18:59:03.850645 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:03.850612 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 18:59:04.283544 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.283511 2562 apiserver.go:52] "Watching apiserver" Jun 10 18:59:04.293223 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.293194 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 18:59:04.294223 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.294197 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jpqdb","openshift-multus/multus-phznk","openshift-ovn-kubernetes/ovnkube-node-tcn89","kube-system/global-pull-secret-syncer-5cl58","kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal","openshift-image-registry/node-ca-k94jc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal","openshift-multus/multus-additional-cni-plugins-g487k","openshift-multus/network-metrics-daemon-c4fvk","openshift-network-diagnostics/network-check-target-mt65r","openshift-network-operator/iptables-alerter-hzhcl","kube-system/konnectivity-agent-pl8fh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428","openshift-cluster-node-tuning-operator/tuned-7h5vk"] Jun 10 18:59:04.295810 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.295781 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:04.295919 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.295877 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:04.296833 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.296809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.298070 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.298051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.299160 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.299137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.299254 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.299201 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:04.300172 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.300045 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 18:59:04.300248 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.300169 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 18:59:04.300248 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.300195 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w8cgd\"" Jun 10 18:59:04.300413 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.300395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.300914 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.300897 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 18:59:04.301841 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.301823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.302365 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.302345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 18:59:04.302458 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.302362 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 18:59:04.303095 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:04.303186 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.303139 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:04.303249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303234 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 18:59:04.303249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303239 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 18:59:04.303349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 18:59:04.303349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h2pf9\"" Jun 10 18:59:04.303576 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303560 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 18:59:04.303993 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303970 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 18:59:04.304086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.303972 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 18:59:04.304086 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.304009 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cv9dc\"" Jun 10 18:59:04.304405 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.304389 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 18:59:04.304465 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.304453 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 18:59:04.304707 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.304692 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 18:59:04.304839 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.304825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.307372 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.306376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phznk" Jun 10 18:59:04.308163 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.308140 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-87pxv\"" Jun 10 18:59:04.309956 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.309541 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 18:59:04.309956 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.309580 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 18:59:04.309956 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.309674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 18:59:04.310156 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.309541 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 18:59:04.311060 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.311042 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 18:59:04.311146 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.311079 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 18:59:04.311213 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.311193 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7rn5d\"" Jun 10 18:59:04.311263 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.311243 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7jz2g\"" Jun 10 18:59:04.311319 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.311291 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 18:59:04.311319 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.311243 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 18:59:04.311497 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.311484 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.312718 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.312701 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.313905 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.313888 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 18:59:04.314021 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.314003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.314146 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.314130 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 18:59:04.314257 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.314241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2tnt5\"" Jun 10 18:59:04.317356 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.317055 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 18:59:04.317356 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.317127 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 18:59:04.317356 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.317142 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 18:59:04.317356 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.317303 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 18:59:04.317356 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.317325 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tkt6l\"" Jun 10 18:59:04.317598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.317373 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-snhxb\"" Jun 10 18:59:04.323675 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.323851 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323689 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-sys-fs\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.323851 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-system-cni-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.323851 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-run\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.323851 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:04.323851 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brxfd\" (UniqueName: \"kubernetes.io/projected/5f42138b-73c9-4665-95af-ac062b3ff720-kube-api-access-brxfd\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.323851 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-env-overrides\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.323851 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323845 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-socket-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-var-lib-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-etc-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysctl-conf\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-device-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.323978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpzg2\" (UniqueName: \"kubernetes.io/projected/b8d14000-e019-4c7d-8f89-b4083fba55f0-kube-api-access-hpzg2\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-systemd\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-host\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovnkube-script-lib\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324067 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-cni-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-hostroot\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-multus-certs\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fb0ba9-c516-4d36-a553-8f69a952afb5-tmp-dir\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324160 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxj9p\" (UniqueName: \"kubernetes.io/projected/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-kube-api-access-gxj9p\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.324191 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a8bf5d-2508-46d1-a298-a4218c71f472-host\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-cnibin\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8d14000-e019-4c7d-8f89-b4083fba55f0-host-slash\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3180912b-789f-492d-8c91-28a8c3e3a18a-kubelet-config\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3180912b-789f-492d-8c91-28a8c3e3a18a-dbus\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26a8bf5d-2508-46d1-a298-a4218c71f472-serviceca\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-log-socket\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-os-release\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-kubernetes\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovnkube-config\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-socket-dir-parent\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-k8s-cni-cncf-io\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f42138b-73c9-4665-95af-ac062b3ff720-cni-binary-copy\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-netns\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-cni-bin\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-kubelet\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-etc-kubernetes\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.324846 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-var-lib-kubelet\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-cni-bin\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-cni-multus\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-modprobe-d\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysconfig\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.324989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-sys\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325021 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-lib-modules\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-tuned\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-node-log\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f42138b-73c9-4665-95af-ac062b3ff720-multus-daemon-config\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-registration-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6fb0ba9-c516-4d36-a553-8f69a952afb5-hosts-file\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8d14000-e019-4c7d-8f89-b4083fba55f0-iptables-alerter-script\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.325621 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325338 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-tmp\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-systemd\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-ovn\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-cni-netd\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7hkl\" (UniqueName: \"kubernetes.io/projected/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-kube-api-access-r7hkl\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-conf-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-systemd-units\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325550 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-run-ovn-kubernetes\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysctl-d\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzjbr\" (UniqueName: \"kubernetes.io/projected/096826f3-d554-4194-a727-4d10576600a0-kube-api-access-bzjbr\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-kubelet\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-slash\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-run-netns\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325697 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovn-node-metrics-cert\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4vff\" (UniqueName: \"kubernetes.io/projected/26a8bf5d-2508-46d1-a298-a4218c71f472-kube-api-access-f4vff\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.326249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwzfd\" (UniqueName: \"kubernetes.io/projected/70e7813c-c0e7-4c24-a224-918ec13e15dc-kube-api-access-wwzfd\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.326879 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325834 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc6dl\" (UniqueName: \"kubernetes.io/projected/d6fb0ba9-c516-4d36-a553-8f69a952afb5-kube-api-access-qc6dl\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.326879 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.325856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:04.327858 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.327822 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 18:59:04.353577 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.353539 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8tgjw" Jun 10 18:59:04.362407 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.362382 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8tgjw" Jun 10 18:59:04.410609 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.410574 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 18:59:04.426270 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-run-netns\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.426447 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovn-node-metrics-cert\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.426447 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4vff\" (UniqueName: \"kubernetes.io/projected/26a8bf5d-2508-46d1-a298-a4218c71f472-kube-api-access-f4vff\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.426447 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-run-netns\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.426447 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.426447 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.426685 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwzfd\" (UniqueName: \"kubernetes.io/projected/70e7813c-c0e7-4c24-a224-918ec13e15dc-kube-api-access-wwzfd\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.426685 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc6dl\" (UniqueName: \"kubernetes.io/projected/d6fb0ba9-c516-4d36-a553-8f69a952afb5-kube-api-access-qc6dl\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.426685 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:04.426685 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.426685 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426633 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-sys-fs\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.426685 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-system-cni-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.426685 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-run\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426691 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-etc-selinux\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brxfd\" (UniqueName: \"kubernetes.io/projected/5f42138b-73c9-4665-95af-ac062b3ff720-kube-api-access-brxfd\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-env-overrides\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-socket-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-var-lib-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-etc-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysctl-conf\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.426892 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426938 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-device-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.426962 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:04.926943031 +0000 UTC m=+2.994391369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.426894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-device-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427004 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-etc-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-socket-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.427024 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-run\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-var-lib-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpzg2\" (UniqueName: \"kubernetes.io/projected/b8d14000-e019-4c7d-8f89-b4083fba55f0-kube-api-access-hpzg2\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysctl-conf\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-systemd\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427109 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-sys-fs\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-host\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-system-cni-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-host\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-systemd\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovnkube-script-lib\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-cni-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-hostroot\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427388 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-hostroot\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-cni-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-multus-certs\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fb0ba9-c516-4d36-a553-8f69a952afb5-tmp-dir\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxj9p\" (UniqueName: \"kubernetes.io/projected/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-kube-api-access-gxj9p\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.427719 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a8bf5d-2508-46d1-a298-a4218c71f472-host\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-multus-certs\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427511 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-env-overrides\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-cnibin\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8d14000-e019-4c7d-8f89-b4083fba55f0-host-slash\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427569 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26a8bf5d-2508-46d1-a298-a4218c71f472-host\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-cnibin\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3180912b-789f-492d-8c91-28a8c3e3a18a-kubelet-config\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427607 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8d14000-e019-4c7d-8f89-b4083fba55f0-host-slash\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3180912b-789f-492d-8c91-28a8c3e3a18a-kubelet-config\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6fb0ba9-c516-4d36-a553-8f69a952afb5-tmp-dir\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3180912b-789f-492d-8c91-28a8c3e3a18a-dbus\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-cnibin\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26a8bf5d-2508-46d1-a298-a4218c71f472-serviceca\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3180912b-789f-492d-8c91-28a8c3e3a18a-dbus\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-log-socket\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-os-release\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-log-socket\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.428598 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.427996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-os-release\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovnkube-script-lib\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-kubernetes\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-kubernetes\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovnkube-config\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-socket-dir-parent\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-k8s-cni-cncf-io\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f42138b-73c9-4665-95af-ac062b3ff720-cni-binary-copy\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-netns\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-cni-bin\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-kubelet\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-cni-binary-copy\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-etc-kubernetes\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-var-lib-kubelet\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-cni-bin\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.429472 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-cni-multus\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-modprobe-d\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysconfig\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-sys\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-lib-modules\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-tuned\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428568 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-node-log\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f42138b-73c9-4665-95af-ac062b3ff720-multus-daemon-config\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-os-release\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovnkube-config\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-netns\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428725 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428749 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f42138b-73c9-4665-95af-ac062b3ff720-cni-binary-copy\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/26a8bf5d-2508-46d1-a298-a4218c71f472-serviceca\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-cni-bin\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-etc-kubernetes\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-run-k8s-cni-cncf-io\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-registration-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6fb0ba9-c516-4d36-a553-8f69a952afb5-hosts-file\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-socket-dir-parent\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/70e7813c-c0e7-4c24-a224-918ec13e15dc-registration-dir\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-kubelet\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8d14000-e019-4c7d-8f89-b4083fba55f0-iptables-alerter-script\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-host-var-lib-cni-multus\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-tmp\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.428993 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-lib-modules\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-systemd\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-ovn\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-cni-netd\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7hkl\" (UniqueName: \"kubernetes.io/projected/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-kube-api-access-r7hkl\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-modprobe-d\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-conf-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.430883 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysconfig\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b4e812d-62e7-4e34-a568-46b0138fd224-agent-certs\") pod \"konnectivity-agent-pl8fh\" (UID: \"2b4e812d-62e7-4e34-a568-46b0138fd224\") " pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b4e812d-62e7-4e34-a568-46b0138fd224-konnectivity-ca\") pod \"konnectivity-agent-pl8fh\" (UID: \"2b4e812d-62e7-4e34-a568-46b0138fd224\") " pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429164 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-sys\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-systemd-units\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-run-ovn-kubernetes\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429202 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-cni-netd\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysctl-d\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429247 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-var-lib-kubelet\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-node-log\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-openvswitch\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8l4q\" (UniqueName: \"kubernetes.io/projected/09abe3a1-7968-4455-992c-d4cadad79d57-kube-api-access-k8l4q\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-cni-bin\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzjbr\" (UniqueName: \"kubernetes.io/projected/096826f3-d554-4194-a727-4d10576600a0-kube-api-access-bzjbr\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-system-cni-dir\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.431520 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429402 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-kubelet\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-slash\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f42138b-73c9-4665-95af-ac062b3ff720-multus-conf-dir\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429547 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-slash\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429800 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-systemd-units\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429813 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d6fb0ba9-c516-4d36-a553-8f69a952afb5-hosts-file\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-run-ovn-kubernetes\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-sysctl-d\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.429960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f42138b-73c9-4665-95af-ac062b3ff720-multus-daemon-config\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.430017 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.430113 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret podName:3180912b-789f-492d-8c91-28a8c3e3a18a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:04.930095014 +0000 UTC m=+2.997543356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret") pod "global-pull-secret-syncer-5cl58" (UID: "3180912b-789f-492d-8c91-28a8c3e3a18a") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.430154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-host-kubelet\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.430186 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-ovn\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.430189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-run-systemd\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.430315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8d14000-e019-4c7d-8f89-b4083fba55f0-iptables-alerter-script\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.430422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-ovn-node-metrics-cert\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.431382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-etc-tuned\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.432166 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.431683 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-tmp\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.434224 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.434205 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:04.434224 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.434225 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:04.434381 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.434238 2562 projected.go:196] Error preparing data for projected volume kube-api-access-57rzw for pod openshift-network-diagnostics/network-check-target-mt65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:04.434381 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.434297 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw podName:8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed nodeName:}" failed. No retries permitted until 2026-06-10 18:59:04.934282563 +0000 UTC m=+3.001730908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-57rzw" (UniqueName: "kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw") pod "network-check-target-mt65r" (UID: "8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:04.436379 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.436356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc6dl\" (UniqueName: \"kubernetes.io/projected/d6fb0ba9-c516-4d36-a553-8f69a952afb5-kube-api-access-qc6dl\") pod \"node-resolver-jpqdb\" (UID: \"d6fb0ba9-c516-4d36-a553-8f69a952afb5\") " pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.436643 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.436625 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwzfd\" (UniqueName: \"kubernetes.io/projected/70e7813c-c0e7-4c24-a224-918ec13e15dc-kube-api-access-wwzfd\") pod \"aws-ebs-csi-driver-node-z5428\" (UID: \"70e7813c-c0e7-4c24-a224-918ec13e15dc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.437167 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.437125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brxfd\" (UniqueName: \"kubernetes.io/projected/5f42138b-73c9-4665-95af-ac062b3ff720-kube-api-access-brxfd\") pod \"multus-phznk\" (UID: \"5f42138b-73c9-4665-95af-ac062b3ff720\") " pod="openshift-multus/multus-phznk" Jun 10 18:59:04.437267 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.437173 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4vff\" (UniqueName: \"kubernetes.io/projected/26a8bf5d-2508-46d1-a298-a4218c71f472-kube-api-access-f4vff\") pod \"node-ca-k94jc\" (UID: \"26a8bf5d-2508-46d1-a298-a4218c71f472\") " pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.439092 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.439071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxj9p\" (UniqueName: \"kubernetes.io/projected/ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d-kube-api-access-gxj9p\") pod \"tuned-7h5vk\" (UID: \"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d\") " pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.443696 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.443668 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpzg2\" (UniqueName: \"kubernetes.io/projected/b8d14000-e019-4c7d-8f89-b4083fba55f0-kube-api-access-hpzg2\") pod \"iptables-alerter-hzhcl\" (UID: \"b8d14000-e019-4c7d-8f89-b4083fba55f0\") " pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.443872 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.443856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7hkl\" (UniqueName: \"kubernetes.io/projected/2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df-kube-api-access-r7hkl\") pod \"ovnkube-node-tcn89\" (UID: \"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df\") " pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.444404 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.444378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzjbr\" (UniqueName: \"kubernetes.io/projected/096826f3-d554-4194-a727-4d10576600a0-kube-api-access-bzjbr\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:04.529943 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.529904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-cnibin\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530104 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.529959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530104 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.529991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-cni-binary-copy\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530104 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-os-release\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530104 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-cnibin\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530104 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530104 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b4e812d-62e7-4e34-a568-46b0138fd224-agent-certs\") pod \"konnectivity-agent-pl8fh\" (UID: \"2b4e812d-62e7-4e34-a568-46b0138fd224\") " pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.530325 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b4e812d-62e7-4e34-a568-46b0138fd224-konnectivity-ca\") pod \"konnectivity-agent-pl8fh\" (UID: \"2b4e812d-62e7-4e34-a568-46b0138fd224\") " pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.530325 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530325 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8l4q\" (UniqueName: \"kubernetes.io/projected/09abe3a1-7968-4455-992c-d4cadad79d57-kube-api-access-k8l4q\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530325 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-system-cni-dir\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530325 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-system-cni-dir\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530490 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-os-release\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530589 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-cni-binary-copy\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530739 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/09abe3a1-7968-4455-992c-d4cadad79d57-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.530831 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.530747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.531228 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.531207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2b4e812d-62e7-4e34-a568-46b0138fd224-konnectivity-ca\") pod \"konnectivity-agent-pl8fh\" (UID: \"2b4e812d-62e7-4e34-a568-46b0138fd224\") " pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.531321 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.531234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/09abe3a1-7968-4455-992c-d4cadad79d57-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.533596 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.533544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2b4e812d-62e7-4e34-a568-46b0138fd224-agent-certs\") pod \"konnectivity-agent-pl8fh\" (UID: \"2b4e812d-62e7-4e34-a568-46b0138fd224\") " pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.541370 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.541347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8l4q\" (UniqueName: \"kubernetes.io/projected/09abe3a1-7968-4455-992c-d4cadad79d57-kube-api-access-k8l4q\") pod \"multus-additional-cni-plugins-g487k\" (UID: \"09abe3a1-7968-4455-992c-d4cadad79d57\") " pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.610998 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.610955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hzhcl" Jun 10 18:59:04.617701 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.617680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:04.625337 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.625309 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" Jun 10 18:59:04.631076 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.631051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k94jc" Jun 10 18:59:04.638313 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.638288 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" Jun 10 18:59:04.646974 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.646952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-phznk" Jun 10 18:59:04.653908 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.653874 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpqdb" Jun 10 18:59:04.661805 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.661785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g487k" Jun 10 18:59:04.668492 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.668470 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:04.673808 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.673780 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 18:59:04.934163 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.934034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:04.934163 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:04.934161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:04.934394 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.934202 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:04.934394 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.934286 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:04.934394 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.934287 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret podName:3180912b-789f-492d-8c91-28a8c3e3a18a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:05.934264726 +0000 UTC m=+4.001713067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret") pod "global-pull-secret-syncer-5cl58" (UID: "3180912b-789f-492d-8c91-28a8c3e3a18a") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:04.934394 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:04.934350 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:05.934332353 +0000 UTC m=+4.001780697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:05.034687 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.034648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:05.034876 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.034853 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:05.034919 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.034884 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:05.034919 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.034896 2562 projected.go:196] Error preparing data for projected volume kube-api-access-57rzw for pod openshift-network-diagnostics/network-check-target-mt65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:05.034995 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.034952 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw podName:8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed nodeName:}" failed. No retries permitted until 2026-06-10 18:59:06.034939475 +0000 UTC m=+4.102387817 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rzw" (UniqueName: "kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw") pod "network-check-target-mt65r" (UID: "8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:05.165808 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:05.165777 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4e812d_62e7_4e34_a568_46b0138fd224.slice/crio-0a7388c6d91db788c3ed8e27b75ee61792cbaac157c669cad61bc61e02e12541 WatchSource:0}: Error finding container 0a7388c6d91db788c3ed8e27b75ee61792cbaac157c669cad61bc61e02e12541: Status 404 returned error can't find the container with id 0a7388c6d91db788c3ed8e27b75ee61792cbaac157c669cad61bc61e02e12541 Jun 10 18:59:05.167871 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:05.167740 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09abe3a1_7968_4455_992c_d4cadad79d57.slice/crio-7a9be36182aac4f5a3b38c8918c8c8f57ccadd9b9f962a3a03de10b68c212dad WatchSource:0}: Error finding container 7a9be36182aac4f5a3b38c8918c8c8f57ccadd9b9f962a3a03de10b68c212dad: Status 404 returned error can't find the container with id 7a9be36182aac4f5a3b38c8918c8c8f57ccadd9b9f962a3a03de10b68c212dad Jun 10 18:59:05.171465 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:05.171443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d14000_e019_4c7d_8f89_b4083fba55f0.slice/crio-55d9f9ebabf80bb64173854b5e43f7ea1d5105f4b18c64697c9afeec792f83b3 WatchSource:0}: Error finding container 55d9f9ebabf80bb64173854b5e43f7ea1d5105f4b18c64697c9afeec792f83b3: Status 404 returned error can't find the container with id 55d9f9ebabf80bb64173854b5e43f7ea1d5105f4b18c64697c9afeec792f83b3 Jun 10 18:59:05.176298 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:05.176273 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e7813c_c0e7_4c24_a224_918ec13e15dc.slice/crio-f75db9a06127327c1704cb5c0c9069b2655d17dd8f31305ddb3a843b7d41757c WatchSource:0}: Error finding container f75db9a06127327c1704cb5c0c9069b2655d17dd8f31305ddb3a843b7d41757c: Status 404 returned error can't find the container with id f75db9a06127327c1704cb5c0c9069b2655d17dd8f31305ddb3a843b7d41757c Jun 10 18:59:05.179289 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:05.179267 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f42138b_73c9_4665_95af_ac062b3ff720.slice/crio-34fd8d03e2a116459bc284bdfacddadf49951af0347c726481206e6420eda54c WatchSource:0}: Error finding container 34fd8d03e2a116459bc284bdfacddadf49951af0347c726481206e6420eda54c: Status 404 returned error can't find the container with id 34fd8d03e2a116459bc284bdfacddadf49951af0347c726481206e6420eda54c Jun 10 18:59:05.365497 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.365236 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 18:54:04 +0000 UTC" deadline="2028-02-12 18:53:20.697992853 +0000 UTC" Jun 10 18:59:05.365497 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.365466 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14687h54m15.332536408s" Jun 10 18:59:05.384400 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.384371 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:05.384539 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.384489 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:05.394239 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.394203 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" event={"ID":"95c1e9bf236acb5d2d1045ded4a3bd9b","Type":"ContainerStarted","Data":"2c7aba4277a0d2903ed5726ddba80329cbe9323410817db5fe81cd811ee441d8"} Jun 10 18:59:05.395249 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.395229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" event={"ID":"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d","Type":"ContainerStarted","Data":"1dca9a9161f9b357237f7c257239914c26f8e8eb202afc40c4b7e348bbc1dffe"} Jun 10 18:59:05.396192 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.396175 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hzhcl" event={"ID":"b8d14000-e019-4c7d-8f89-b4083fba55f0","Type":"ContainerStarted","Data":"55d9f9ebabf80bb64173854b5e43f7ea1d5105f4b18c64697c9afeec792f83b3"} Jun 10 18:59:05.397226 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.397202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerStarted","Data":"7a9be36182aac4f5a3b38c8918c8c8f57ccadd9b9f962a3a03de10b68c212dad"} Jun 10 18:59:05.398417 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.398389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k94jc" event={"ID":"26a8bf5d-2508-46d1-a298-a4218c71f472","Type":"ContainerStarted","Data":"d1d52d3a6fc86ab8bae4b4834e5075647767d0724a899ff660fb2de6bb65c4da"} Jun 10 18:59:05.399341 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.399321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpqdb" event={"ID":"d6fb0ba9-c516-4d36-a553-8f69a952afb5","Type":"ContainerStarted","Data":"6cdae486c1912fd880e8056e8228b81a1c3f3d422f19b62b60170b3f3671b35e"} Jun 10 18:59:05.400918 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.400853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phznk" event={"ID":"5f42138b-73c9-4665-95af-ac062b3ff720","Type":"ContainerStarted","Data":"34fd8d03e2a116459bc284bdfacddadf49951af0347c726481206e6420eda54c"} Jun 10 18:59:05.402675 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.402657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" event={"ID":"70e7813c-c0e7-4c24-a224-918ec13e15dc","Type":"ContainerStarted","Data":"f75db9a06127327c1704cb5c0c9069b2655d17dd8f31305ddb3a843b7d41757c"} Jun 10 18:59:05.403907 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.403876 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"63c4d88e6f10c01af8443223b7a53137e0bc402736ce343adf8bc26a228ce2a9"} Jun 10 18:59:05.405113 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.405089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pl8fh" event={"ID":"2b4e812d-62e7-4e34-a568-46b0138fd224","Type":"ContainerStarted","Data":"0a7388c6d91db788c3ed8e27b75ee61792cbaac157c669cad61bc61e02e12541"} Jun 10 18:59:05.409399 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.409362 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-108.ec2.internal" podStartSLOduration=2.409351034 podStartE2EDuration="2.409351034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:05.409337505 +0000 UTC m=+3.476785860" watchObservedRunningTime="2026-06-10 18:59:05.409351034 +0000 UTC m=+3.476799394" Jun 10 18:59:05.941655 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.940858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:05.941655 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:05.940954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:05.941655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.941075 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:05.941655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.941140 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret podName:3180912b-789f-492d-8c91-28a8c3e3a18a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:07.941121072 +0000 UTC m=+6.008569413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret") pod "global-pull-secret-syncer-5cl58" (UID: "3180912b-789f-492d-8c91-28a8c3e3a18a") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:05.941655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.941512 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:05.941655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:05.941559 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:07.941545077 +0000 UTC m=+6.008993418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:06.041705 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:06.041663 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:06.041953 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:06.041932 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:06.042041 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:06.041961 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:06.042041 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:06.041974 2562 projected.go:196] Error preparing data for projected volume kube-api-access-57rzw for pod openshift-network-diagnostics/network-check-target-mt65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:06.042041 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:06.042034 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw podName:8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed nodeName:}" failed. No retries permitted until 2026-06-10 18:59:08.042014635 +0000 UTC m=+6.109462990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rzw" (UniqueName: "kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw") pod "network-check-target-mt65r" (UID: "8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:06.368894 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:06.368745 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 18:54:04 +0000 UTC" deadline="2028-03-03 09:35:51.255795704 +0000 UTC" Jun 10 18:59:06.368894 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:06.368799 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15158h36m44.887002258s" Jun 10 18:59:06.387566 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:06.386680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:06.387566 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:06.386942 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:06.387566 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:06.387415 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:06.387566 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:06.387510 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:06.419666 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:06.419626 2562 generic.go:356] "Generic (PLEG): container finished" podID="52218d1f5d18048d0e5fc01b23ae90ee" containerID="4cc770a94b91529822557ddde70a43d6d1f93932ef6ebace732a477bd68b8aa2" exitCode=0 Jun 10 18:59:06.419863 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:06.419826 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" event={"ID":"52218d1f5d18048d0e5fc01b23ae90ee","Type":"ContainerDied","Data":"4cc770a94b91529822557ddde70a43d6d1f93932ef6ebace732a477bd68b8aa2"} Jun 10 18:59:07.384425 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:07.384391 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:07.384991 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:07.384515 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:07.450141 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:07.449974 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" event={"ID":"52218d1f5d18048d0e5fc01b23ae90ee","Type":"ContainerStarted","Data":"e0d70f56891659a0eee3e1be9ef526b715ef41a25e9b0bbfb646bf8871d69807"} Jun 10 18:59:07.960037 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:07.959994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:07.960230 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:07.960084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:07.960230 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:07.960209 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:07.960345 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:07.960261 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:11.960245116 +0000 UTC m=+10.027693454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:07.960559 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:07.960541 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:07.960626 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:07.960584 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret podName:3180912b-789f-492d-8c91-28a8c3e3a18a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:11.96057265 +0000 UTC m=+10.028020990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret") pod "global-pull-secret-syncer-5cl58" (UID: "3180912b-789f-492d-8c91-28a8c3e3a18a") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:08.061410 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:08.061362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:08.061573 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:08.061537 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:08.061573 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:08.061558 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:08.061573 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:08.061571 2562 projected.go:196] Error preparing data for projected volume kube-api-access-57rzw for pod openshift-network-diagnostics/network-check-target-mt65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:08.061731 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:08.061630 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw podName:8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed nodeName:}" failed. No retries permitted until 2026-06-10 18:59:12.061610979 +0000 UTC m=+10.129059331 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rzw" (UniqueName: "kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw") pod "network-check-target-mt65r" (UID: "8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:08.384828 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:08.384710 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:08.385245 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:08.385019 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:08.385245 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:08.384711 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:08.385245 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:08.385131 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:09.384254 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:09.384218 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:09.384445 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:09.384364 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:10.384823 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:10.384787 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:10.385275 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:10.384931 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:10.385398 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:10.385372 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:10.385528 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:10.385500 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:11.383946 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:11.383897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:11.384138 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:11.384028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:11.996176 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:11.996129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:11.996655 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:11.996215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:11.996655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:11.996284 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:11.996655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:11.996317 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:11.996655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:11.996362 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret podName:3180912b-789f-492d-8c91-28a8c3e3a18a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:19.996341964 +0000 UTC m=+18.063790316 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret") pod "global-pull-secret-syncer-5cl58" (UID: "3180912b-789f-492d-8c91-28a8c3e3a18a") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:11.996655 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:11.996383 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:19.996372444 +0000 UTC m=+18.063820789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:12.097936 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:12.097871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:12.098115 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:12.098048 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:12.098115 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:12.098068 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:12.098115 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:12.098081 2562 projected.go:196] Error preparing data for projected volume kube-api-access-57rzw for pod openshift-network-diagnostics/network-check-target-mt65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:12.098273 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:12.098136 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw podName:8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed nodeName:}" failed. No retries permitted until 2026-06-10 18:59:20.098117964 +0000 UTC m=+18.165566307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rzw" (UniqueName: "kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw") pod "network-check-target-mt65r" (UID: "8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:12.386082 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:12.386003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:12.386244 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:12.386121 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:12.386244 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:12.386185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:12.386366 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:12.386257 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:13.384844 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:13.384811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:13.385256 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:13.384915 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:14.384177 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:14.384144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:14.384349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:14.384144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:14.384349 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:14.384282 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:14.384466 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:14.384353 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:15.384056 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:15.384021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:15.384606 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:15.384140 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:16.384492 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:16.384453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:16.384909 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:16.384582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:16.384909 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:16.384639 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:16.384909 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:16.384736 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:17.384453 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:17.384407 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:17.384613 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:17.384562 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:18.384772 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:18.384717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:18.385186 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:18.384877 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:18.385186 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:18.384929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:18.385186 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:18.385067 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:19.384606 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:19.384185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:19.384606 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:19.384306 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:20.063208 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:20.063163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:20.063420 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:20.063253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:20.063420 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.063350 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:20.063420 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.063371 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:20.063588 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.063432 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret podName:3180912b-789f-492d-8c91-28a8c3e3a18a nodeName:}" failed. No retries permitted until 2026-06-10 18:59:36.063411674 +0000 UTC m=+34.130860016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret") pod "global-pull-secret-syncer-5cl58" (UID: "3180912b-789f-492d-8c91-28a8c3e3a18a") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:20.063588 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.063454 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:36.063444683 +0000 UTC m=+34.130893027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:20.164583 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:20.164547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:20.164816 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.164750 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:20.164816 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.164795 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:20.164816 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.164808 2562 projected.go:196] Error preparing data for projected volume kube-api-access-57rzw for pod openshift-network-diagnostics/network-check-target-mt65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:20.164980 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.164878 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw podName:8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed nodeName:}" failed. No retries permitted until 2026-06-10 18:59:36.164857359 +0000 UTC m=+34.232305717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rzw" (UniqueName: "kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw") pod "network-check-target-mt65r" (UID: "8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:20.384916 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:20.384829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:20.384916 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:20.384854 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:20.385397 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.384972 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:20.385397 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:20.385080 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:21.384400 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:21.384368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:21.384577 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:21.384492 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:22.384848 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:22.384812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:22.385311 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:22.384901 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:22.385311 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:22.384963 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:22.385311 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:22.385081 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:23.384131 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:23.384098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:23.384325 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:23.384218 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:24.389060 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.388698 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:24.389060 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.388898 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:24.389060 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:24.388942 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:24.389060 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:24.389017 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:24.483890 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.483596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" event={"ID":"ccf14e1d-a61c-4f7b-b99d-0c0fcc99bb0d","Type":"ContainerStarted","Data":"8d8decc6a557347e2aa7145eeab652cc4c4c02cb32b0c43cad806f68591a8b63"} Jun 10 18:59:24.485442 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.485409 2562 generic.go:356] "Generic (PLEG): container finished" podID="09abe3a1-7968-4455-992c-d4cadad79d57" containerID="a47a2ec850b0e8a313933e61033c0d7d4105d0345bb9b0e70ab18f993bcb35b3" exitCode=0 Jun 10 18:59:24.485588 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.485499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerDied","Data":"a47a2ec850b0e8a313933e61033c0d7d4105d0345bb9b0e70ab18f993bcb35b3"} Jun 10 18:59:24.487433 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.487128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k94jc" event={"ID":"26a8bf5d-2508-46d1-a298-a4218c71f472","Type":"ContainerStarted","Data":"af127a1b443d70b6ef092b8fe8297720dc367b940fc637e567f21a7e246a84b7"} Jun 10 18:59:24.488784 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.488704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpqdb" event={"ID":"d6fb0ba9-c516-4d36-a553-8f69a952afb5","Type":"ContainerStarted","Data":"c25799f9d633f3def0d639e0c849534640f0e708a299d25b382175a38e03e318"} Jun 10 18:59:24.490298 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.490271 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-phznk" event={"ID":"5f42138b-73c9-4665-95af-ac062b3ff720","Type":"ContainerStarted","Data":"5e547bd6381ae988bb8817ccf54a62ba19b33ed0773d06fb816c4dccba9fddc2"} Jun 10 18:59:24.491813 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.491790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" event={"ID":"70e7813c-c0e7-4c24-a224-918ec13e15dc","Type":"ContainerStarted","Data":"4e2f1deae1aad8bb277a32d44ce7d3b738ae8d775a83dca68094efb3b8df333b"} Jun 10 18:59:24.493966 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.493945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"b2a160226ad23318f56590c1a10ed5f709ddbf7ac12381f7a4317310ce481d31"} Jun 10 18:59:24.494068 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.494000 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"f00ddd75fbf6556dbc84368290463dc4417ad1046a7a7a3b5853ac349cb14fd5"} Jun 10 18:59:24.495246 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.495227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pl8fh" event={"ID":"2b4e812d-62e7-4e34-a568-46b0138fd224","Type":"ContainerStarted","Data":"b456ecbe373a2f8fd5d11aa62595604bcb85a43b364de3ba1fa3a0240cf8dbfe"} Jun 10 18:59:24.523080 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.523028 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-108.ec2.internal" podStartSLOduration=21.523011463 podStartE2EDuration="21.523011463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:07.468366883 +0000 UTC m=+5.535815245" watchObservedRunningTime="2026-06-10 18:59:24.523011463 +0000 UTC m=+22.590459824" Jun 10 18:59:24.523455 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.523424 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7h5vk" podStartSLOduration=3.591182714 podStartE2EDuration="22.523413593s" totalImagesPullingTime="18.932230879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:24.523206106 +0000 UTC m=+22.590654468" watchObservedRunningTime="2026-06-10 18:59:24.523413593 +0000 UTC m=+22.590861957" Jun 10 18:59:24.557666 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.557624 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-phznk" podStartSLOduration=3.614923057 podStartE2EDuration="22.557607543s" totalImagesPullingTime="18.942684486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:24.55609742 +0000 UTC m=+22.623545780" watchObservedRunningTime="2026-06-10 18:59:24.557607543 +0000 UTC m=+22.625055903" Jun 10 18:59:24.650051 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.650006 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pl8fh" podStartSLOduration=12.042585753 podStartE2EDuration="22.649990943s" totalImagesPullingTime="10.60740519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:24.628480115 +0000 UTC m=+22.695928475" watchObservedRunningTime="2026-06-10 18:59:24.649990943 +0000 UTC m=+22.717439304" Jun 10 18:59:24.650484 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.650456 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k94jc" podStartSLOduration=3.72397326 podStartE2EDuration="22.650448494s" totalImagesPullingTime="18.926475234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:24.648826181 +0000 UTC m=+22.716274542" watchObservedRunningTime="2026-06-10 18:59:24.650448494 +0000 UTC m=+22.717896897" Jun 10 18:59:24.673307 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:24.673265 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jpqdb" podStartSLOduration=3.768026558 podStartE2EDuration="22.673251563s" totalImagesPullingTime="18.905225005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:24.673194653 +0000 UTC m=+22.740643013" watchObservedRunningTime="2026-06-10 18:59:24.673251563 +0000 UTC m=+22.740699923" Jun 10 18:59:25.256871 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.256843 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 18:59:25.384739 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.384617 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T18:59:25.256865238Z","UUID":"0b7b7c98-aea4-41d7-b642-6709b91793de","Handler":null,"Name":"","Endpoint":""} Jun 10 18:59:25.384910 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.384790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:25.384992 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:25.384905 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:25.386363 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.386343 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 18:59:25.386482 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.386380 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 18:59:25.499880 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.499795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" event={"ID":"70e7813c-c0e7-4c24-a224-918ec13e15dc","Type":"ContainerStarted","Data":"83ccaf9a5621727debec7ded9973076487f76299de25b3bdc96aa8858be1db57"} Jun 10 18:59:25.506080 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.506041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"7db885b1a101c482ec6071abda8a2317b0ccd49310fde86a1edfb099e74e7c84"} Jun 10 18:59:25.506237 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.506129 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"fdf970f0cf40f8bdd4f80d789b0472a15e3c22b58e8fbcd2b8c3ab88d91e0133"} Jun 10 18:59:25.506237 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.506183 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"355f0677f219023869e20d55c6769aa49ff64e00e8f288ea0ba738f85f16c83a"} Jun 10 18:59:25.506237 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:25.506233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"b030d5911bb00be3f7369ff4e4de6a97672f46f37a8930c2f583c71ca880a4fc"} Jun 10 18:59:26.381435 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.381335 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:26.381916 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.381893 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:26.384130 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.384107 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:26.384240 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.384114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:26.384304 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:26.384281 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:26.384355 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:26.384327 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:26.511274 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.511237 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" event={"ID":"70e7813c-c0e7-4c24-a224-918ec13e15dc","Type":"ContainerStarted","Data":"1de79a8e23ab7c22edc0629501f2285f901a2dc3f497c3bcf75bbfffb021cae5"} Jun 10 18:59:26.512990 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.512961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hzhcl" event={"ID":"b8d14000-e019-4c7d-8f89-b4083fba55f0","Type":"ContainerStarted","Data":"9b0d6e9dfe57d9edcf1fe3d36850be27cc1bd476a8e1560e4205ffa1059a0332"} Jun 10 18:59:26.513215 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.513178 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:26.513740 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.513718 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pl8fh" Jun 10 18:59:26.533556 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.533495 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z5428" podStartSLOduration=4.172061177 podStartE2EDuration="24.533478664s" totalImagesPullingTime="20.361417487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:26.533212827 +0000 UTC m=+24.600661189" watchObservedRunningTime="2026-06-10 18:59:26.533478664 +0000 UTC m=+24.600927024" Jun 10 18:59:26.552261 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:26.552217 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hzhcl" podStartSLOduration=5.61890067 podStartE2EDuration="24.55220305s" totalImagesPullingTime="18.93330238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:26.551980439 +0000 UTC m=+24.619428802" watchObservedRunningTime="2026-06-10 18:59:26.55220305 +0000 UTC m=+24.619651410" Jun 10 18:59:27.384496 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:27.384317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:27.384691 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:27.384582 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:27.519599 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:27.519547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"1286fed210b0f1df0bb9b6ee91ebc5c79d4032cd7bbdbeab570179a9d3c28e72"} Jun 10 18:59:28.387955 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:28.387916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:28.388133 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:28.387966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:28.388133 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:28.388053 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:28.388231 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:28.388182 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:29.385018 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.384743 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:29.385676 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:29.385011 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:29.526207 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.526143 2562 generic.go:356] "Generic (PLEG): container finished" podID="09abe3a1-7968-4455-992c-d4cadad79d57" containerID="2b62febc6fd991bd0a436dfc2e2ffa9c68169ae6109e8de98257255279e70f96" exitCode=0 Jun 10 18:59:29.526207 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.526197 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerDied","Data":"2b62febc6fd991bd0a436dfc2e2ffa9c68169ae6109e8de98257255279e70f96"} Jun 10 18:59:29.530041 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.530017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" event={"ID":"2ac48ae2-ba6d-4d7a-b534-26ee2ac1a5df","Type":"ContainerStarted","Data":"dd8997c4bb463830104990c1672319690bcd28782f3ccb4cc75897483ebb36c5"} Jun 10 18:59:29.530279 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.530260 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:29.530391 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.530316 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:29.530391 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.530364 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:29.546579 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.546550 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:29.546699 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.546653 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 18:59:29.583561 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:29.583513 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" podStartSLOduration=8.598771398 podStartE2EDuration="27.583499004s" totalImagesPullingTime="18.984727606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:29.581549297 +0000 UTC m=+27.648997657" watchObservedRunningTime="2026-06-10 18:59:29.583499004 +0000 UTC m=+27.650947364" Jun 10 18:59:30.383910 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:30.383874 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:30.384106 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:30.383883 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:30.384106 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:30.384023 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:30.384218 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:30.384160 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:31.047306 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.047273 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mt65r"] Jun 10 18:59:31.047776 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.047399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:31.047776 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:31.047480 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:31.051020 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.050991 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5cl58"] Jun 10 18:59:31.051144 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.051084 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:31.051199 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:31.051183 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:31.051648 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.051631 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4fvk"] Jun 10 18:59:31.051730 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.051719 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:31.051856 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:31.051834 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:31.537326 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.537072 2562 generic.go:356] "Generic (PLEG): container finished" podID="09abe3a1-7968-4455-992c-d4cadad79d57" containerID="621dfc578358c1f6b3033859c98942ceb9af00622bae840b2788df543f8a75d7" exitCode=0 Jun 10 18:59:31.537485 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:31.537153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerDied","Data":"621dfc578358c1f6b3033859c98942ceb9af00622bae840b2788df543f8a75d7"} Jun 10 18:59:32.385067 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:32.385036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:32.385712 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:32.385151 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:32.385712 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:32.385195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:32.385712 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:32.385336 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:33.384896 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:33.384860 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:33.385061 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:33.384970 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:33.543789 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:33.543682 2562 generic.go:356] "Generic (PLEG): container finished" podID="09abe3a1-7968-4455-992c-d4cadad79d57" containerID="9ed0006269d8a203b00a1fdb8344ce9c58701d52ef622a19a045ab1ff071985b" exitCode=0 Jun 10 18:59:33.543789 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:33.543773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerDied","Data":"9ed0006269d8a203b00a1fdb8344ce9c58701d52ef622a19a045ab1ff071985b"} Jun 10 18:59:34.384337 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:34.384299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:34.384511 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:34.384299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:34.384511 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:34.384459 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:34.384651 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:34.384522 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:35.384538 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:35.384455 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:35.384998 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:35.384590 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mt65r" podUID="8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed" Jun 10 18:59:36.085489 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.085460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:36.085661 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.085507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:36.085661 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.085619 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:36.085661 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.085617 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:36.085813 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.085681 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret podName:3180912b-789f-492d-8c91-28a8c3e3a18a nodeName:}" failed. No retries permitted until 2026-06-10 19:00:08.085667742 +0000 UTC m=+66.153116080 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret") pod "global-pull-secret-syncer-5cl58" (UID: "3180912b-789f-492d-8c91-28a8c3e3a18a") : object "kube-system"/"original-pull-secret" not registered Jun 10 18:59:36.085813 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.085695 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 19:00:08.085687921 +0000 UTC m=+66.153136260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 18:59:36.185855 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.185824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:36.185999 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.185976 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 18:59:36.185999 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.185992 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 18:59:36.186067 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.186002 2562 projected.go:196] Error preparing data for projected volume kube-api-access-57rzw for pod openshift-network-diagnostics/network-check-target-mt65r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:36.186067 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.186050 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw podName:8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed nodeName:}" failed. No retries permitted until 2026-06-10 19:00:08.186037425 +0000 UTC m=+66.253485764 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-57rzw" (UniqueName: "kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw") pod "network-check-target-mt65r" (UID: "8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 18:59:36.384308 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.384214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:36.384479 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.384214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:36.384479 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.384375 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 18:59:36.384479 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:36.384430 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cl58" podUID="3180912b-789f-492d-8c91-28a8c3e3a18a" Jun 10 18:59:36.791672 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.791643 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-108.ec2.internal" event="NodeReady" Jun 10 18:59:36.791857 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.791795 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 18:59:36.864690 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.864652 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zcfvt"] Jun 10 18:59:36.895529 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.895495 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kjjjz"] Jun 10 18:59:36.895702 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.895641 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:36.899056 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.899032 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77lp9\"" Jun 10 18:59:36.899293 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.899278 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 18:59:36.899866 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.899849 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 18:59:36.911533 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.911471 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kjjjz"] Jun 10 18:59:36.911533 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.911511 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zcfvt"] Jun 10 18:59:36.911703 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.911606 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:36.918865 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.918838 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 18:59:36.919120 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.919100 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 18:59:36.919391 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.919374 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htph4\"" Jun 10 18:59:36.919581 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.919557 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 18:59:36.991078 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.991043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ad8ce2-1537-4248-a192-eb9e3809f811-tmp-dir\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:36.991078 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.991093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31ad8ce2-1537-4248-a192-eb9e3809f811-config-volume\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:36.991344 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.991222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:36.991344 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:36.991288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj2tw\" (UniqueName: \"kubernetes.io/projected/31ad8ce2-1537-4248-a192-eb9e3809f811-kube-api-access-nj2tw\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.091741 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.091709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31ad8ce2-1537-4248-a192-eb9e3809f811-config-volume\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.091950 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.091830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.091950 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.091861 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50978806-1026-408a-a68e-a7e3515cf0bf-cert\") pod \"ingress-canary-kjjjz\" (UID: \"50978806-1026-408a-a68e-a7e3515cf0bf\") " pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:37.091950 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.091893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjt8x\" (UniqueName: \"kubernetes.io/projected/50978806-1026-408a-a68e-a7e3515cf0bf-kube-api-access-vjt8x\") pod \"ingress-canary-kjjjz\" (UID: \"50978806-1026-408a-a68e-a7e3515cf0bf\") " pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:37.091950 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.091935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj2tw\" (UniqueName: \"kubernetes.io/projected/31ad8ce2-1537-4248-a192-eb9e3809f811-kube-api-access-nj2tw\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.092176 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:37.092028 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:37.092176 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:37.092094 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:37.592074465 +0000 UTC m=+35.659522804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 18:59:37.092176 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.092026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ad8ce2-1537-4248-a192-eb9e3809f811-tmp-dir\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.092334 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.092287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31ad8ce2-1537-4248-a192-eb9e3809f811-tmp-dir\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.092403 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.092378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31ad8ce2-1537-4248-a192-eb9e3809f811-config-volume\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.105080 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.105042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj2tw\" (UniqueName: \"kubernetes.io/projected/31ad8ce2-1537-4248-a192-eb9e3809f811-kube-api-access-nj2tw\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.193147 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.193076 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50978806-1026-408a-a68e-a7e3515cf0bf-cert\") pod \"ingress-canary-kjjjz\" (UID: \"50978806-1026-408a-a68e-a7e3515cf0bf\") " pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:37.193147 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.193115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjt8x\" (UniqueName: \"kubernetes.io/projected/50978806-1026-408a-a68e-a7e3515cf0bf-kube-api-access-vjt8x\") pod \"ingress-canary-kjjjz\" (UID: \"50978806-1026-408a-a68e-a7e3515cf0bf\") " pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:37.196009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.195979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50978806-1026-408a-a68e-a7e3515cf0bf-cert\") pod \"ingress-canary-kjjjz\" (UID: \"50978806-1026-408a-a68e-a7e3515cf0bf\") " pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:37.202881 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.202855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjt8x\" (UniqueName: \"kubernetes.io/projected/50978806-1026-408a-a68e-a7e3515cf0bf-kube-api-access-vjt8x\") pod \"ingress-canary-kjjjz\" (UID: \"50978806-1026-408a-a68e-a7e3515cf0bf\") " pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:37.221767 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.221717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kjjjz" Jun 10 18:59:37.384607 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.384577 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 18:59:37.387655 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.387628 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 18:59:37.387655 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.387654 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 18:59:37.387877 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.387631 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2b6f\"" Jun 10 18:59:37.596622 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.596593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:37.596838 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:37.596792 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:37.596905 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:37.596870 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:38.596847104 +0000 UTC m=+36.664295459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 18:59:37.915786 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:37.915527 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kjjjz"] Jun 10 18:59:37.975203 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:37.975174 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50978806_1026_408a_a68e_a7e3515cf0bf.slice/crio-8a92f53588ef1a7e11dfbaf0bdcaec17fa28ba5707a7a9e1e21c0ff4b3add115 WatchSource:0}: Error finding container 8a92f53588ef1a7e11dfbaf0bdcaec17fa28ba5707a7a9e1e21c0ff4b3add115: Status 404 returned error can't find the container with id 8a92f53588ef1a7e11dfbaf0bdcaec17fa28ba5707a7a9e1e21c0ff4b3add115 Jun 10 18:59:38.384275 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.384196 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 18:59:38.384275 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.384221 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 18:59:38.387441 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.387421 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 18:59:38.388575 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.388562 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 18:59:38.388633 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.388595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j57pv\"" Jun 10 18:59:38.562661 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.560137 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerDied","Data":"5eb8b15f00a63c4f1f02168837b9c721158bf82ef133365c9123312c481411ad"} Jun 10 18:59:38.562661 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.560068 2562 generic.go:356] "Generic (PLEG): container finished" podID="09abe3a1-7968-4455-992c-d4cadad79d57" containerID="5eb8b15f00a63c4f1f02168837b9c721158bf82ef133365c9123312c481411ad" exitCode=0 Jun 10 18:59:38.564349 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.564320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kjjjz" event={"ID":"50978806-1026-408a-a68e-a7e3515cf0bf","Type":"ContainerStarted","Data":"8a92f53588ef1a7e11dfbaf0bdcaec17fa28ba5707a7a9e1e21c0ff4b3add115"} Jun 10 18:59:38.603820 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:38.603789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:38.603972 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:38.603918 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:38.604036 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:38.603986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:40.603967648 +0000 UTC m=+38.671416006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 18:59:39.571482 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:39.571449 2562 generic.go:356] "Generic (PLEG): container finished" podID="09abe3a1-7968-4455-992c-d4cadad79d57" containerID="f971050f8b9e96e18d9df10505608910565b815800aed38807c29cc53b802da9" exitCode=0 Jun 10 18:59:39.571952 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:39.571507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerDied","Data":"f971050f8b9e96e18d9df10505608910565b815800aed38807c29cc53b802da9"} Jun 10 18:59:40.577800 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:40.577573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g487k" event={"ID":"09abe3a1-7968-4455-992c-d4cadad79d57","Type":"ContainerStarted","Data":"a422c601dfa699cfbe2c7fd3de171f3531946fb563bd6c2a0a2b00f8619635a9"} Jun 10 18:59:40.579121 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:40.579094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kjjjz" event={"ID":"50978806-1026-408a-a68e-a7e3515cf0bf","Type":"ContainerStarted","Data":"f41cad26d8c6cfb59fbeb50a482543075f74ed09f786eef10558d426639057d4"} Jun 10 18:59:40.605118 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:40.605073 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g487k" podStartSLOduration=8.539734955 podStartE2EDuration="38.605057092s" totalImagesPullingTime="30.065322137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:40.603235966 +0000 UTC m=+38.670684326" watchObservedRunningTime="2026-06-10 18:59:40.605057092 +0000 UTC m=+38.672505450" Jun 10 18:59:40.616262 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:40.616238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:40.616408 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:40.616391 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:40.616456 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:40.616447 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:44.6164332 +0000 UTC m=+42.683881539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 18:59:44.648048 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:44.648005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:44.648652 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:44.648174 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:44.648652 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:44.648250 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 18:59:52.648228799 +0000 UTC m=+50.715677155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 18:59:49.215218 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.215160 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kjjjz" podStartSLOduration=11.407992856 podStartE2EDuration="13.215143179s" totalImagesPullingTime="1.807150323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:40.622114396 +0000 UTC m=+38.689562756" watchObservedRunningTime="2026-06-10 18:59:49.215143179 +0000 UTC m=+47.282591540" Jun 10 18:59:49.215825 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.215663 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667"] Jun 10 18:59:49.220800 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.220782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.225568 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.225530 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 10 18:59:49.225715 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.225545 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 18:59:49.225715 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.225595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 10 18:59:49.225715 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.225582 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 18:59:49.225907 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.225721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 10 18:59:49.226614 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.226592 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 10 18:59:49.226775 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.226736 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 18:59:49.233702 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.233680 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667"] Jun 10 18:59:49.379938 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.379893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-hub\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.379938 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.379937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxgwx\" (UniqueName: \"kubernetes.io/projected/65c8358b-6d41-4394-9a55-9732a5e84e84-kube-api-access-sxgwx\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.380179 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.380032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.380179 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.380069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c8358b-6d41-4394-9a55-9732a5e84e84-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.380179 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.380095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.380179 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.380119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-ca\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.480707 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.480590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxgwx\" (UniqueName: \"kubernetes.io/projected/65c8358b-6d41-4394-9a55-9732a5e84e84-kube-api-access-sxgwx\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.480707 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.480668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.480707 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.480697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c8358b-6d41-4394-9a55-9732a5e84e84-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.481005 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.480730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.481005 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.480785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-ca\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.481088 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.480996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-hub\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.481583 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.481559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65c8358b-6d41-4394-9a55-9732a5e84e84-additional-service-ca\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.484813 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.484789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-hub\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.484947 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.484797 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-ca\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.485009 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.484974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.485065 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.485005 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65c8358b-6d41-4394-9a55-9732a5e84e84-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.489632 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.489598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxgwx\" (UniqueName: \"kubernetes.io/projected/65c8358b-6d41-4394-9a55-9732a5e84e84-kube-api-access-sxgwx\") pod \"cluster-proxy-proxy-agent-85859f887c-cq667\" (UID: \"65c8358b-6d41-4394-9a55-9732a5e84e84\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.541477 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.541438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 18:59:49.703507 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:49.703454 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667"] Jun 10 18:59:49.707468 ip-10-0-143-108 kubenswrapper[2562]: W0610 18:59:49.707442 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65c8358b_6d41_4394_9a55_9732a5e84e84.slice/crio-fd37add6e2647186453f6361f87f0074801b4c78c575ec03fb807cfc761bdbd3 WatchSource:0}: Error finding container fd37add6e2647186453f6361f87f0074801b4c78c575ec03fb807cfc761bdbd3: Status 404 returned error can't find the container with id fd37add6e2647186453f6361f87f0074801b4c78c575ec03fb807cfc761bdbd3 Jun 10 18:59:50.604234 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:50.604172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" event={"ID":"65c8358b-6d41-4394-9a55-9732a5e84e84","Type":"ContainerStarted","Data":"fd37add6e2647186453f6361f87f0074801b4c78c575ec03fb807cfc761bdbd3"} Jun 10 18:59:52.704118 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:52.704078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 18:59:52.704541 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:52.704230 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 18:59:52.704541 ip-10-0-143-108 kubenswrapper[2562]: E0610 18:59:52.704297 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 19:00:08.704278833 +0000 UTC m=+66.771727422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 18:59:54.616011 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:54.615974 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" event={"ID":"65c8358b-6d41-4394-9a55-9732a5e84e84","Type":"ContainerStarted","Data":"11c90cde14de2434df15fed6e66bb4583f1a35618f4bf1be05de6a98ec3353dd"} Jun 10 18:59:54.616011 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:54.616015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" event={"ID":"65c8358b-6d41-4394-9a55-9732a5e84e84","Type":"ContainerStarted","Data":"484d911982bae583bd65468af343faafa205d494c0248c25fef790396b2afd50"} Jun 10 18:59:54.616523 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:54.616028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" event={"ID":"65c8358b-6d41-4394-9a55-9732a5e84e84","Type":"ContainerStarted","Data":"55180e9d02be6abea776cd1a67ea43f6b4f02273ddc1d0735858f93532473d8c"} Jun 10 18:59:54.638003 ip-10-0-143-108 kubenswrapper[2562]: I0610 18:59:54.637951 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" podStartSLOduration=1.538407037 podStartE2EDuration="5.637935553s" totalImagesPullingTime="4.099528516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 18:59:54.636293835 +0000 UTC m=+52.703742197" watchObservedRunningTime="2026-06-10 18:59:54.637935553 +0000 UTC m=+52.705383914" Jun 10 19:00:01.555316 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:01.555276 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tcn89" Jun 10 19:00:08.116792 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.116728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 19:00:08.117230 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.116837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 19:00:08.119902 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.119883 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 19:00:08.119994 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.119906 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 19:00:08.127328 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:00:08.127307 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 19:00:08.127433 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:00:08.127393 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 19:01:12.127371051 +0000 UTC m=+130.194819394 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : secret "metrics-daemon-secret" not found Jun 10 19:00:08.129606 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.129587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3180912b-789f-492d-8c91-28a8c3e3a18a-original-pull-secret\") pod \"global-pull-secret-syncer-5cl58\" (UID: \"3180912b-789f-492d-8c91-28a8c3e3a18a\") " pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 19:00:08.218008 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.217971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 19:00:08.221039 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.221010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 19:00:08.231315 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.231290 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 19:00:08.241144 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.241118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57rzw\" (UniqueName: \"kubernetes.io/projected/8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed-kube-api-access-57rzw\") pod \"network-check-target-mt65r\" (UID: \"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed\") " pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 19:00:08.299334 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.299298 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-b2b6f\"" Jun 10 19:00:08.306988 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.306967 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 19:00:08.393707 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.393677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cl58" Jun 10 19:00:08.430264 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.430222 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mt65r"] Jun 10 19:00:08.434702 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:00:08.434664 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bcd346a_f43b_40a5_9ec7_b0ed7d3b87ed.slice/crio-8c646f685302f243c7cd43eaabb9b541d56b4a55d5a3949f49850b6b18d4dd83 WatchSource:0}: Error finding container 8c646f685302f243c7cd43eaabb9b541d56b4a55d5a3949f49850b6b18d4dd83: Status 404 returned error can't find the container with id 8c646f685302f243c7cd43eaabb9b541d56b4a55d5a3949f49850b6b18d4dd83 Jun 10 19:00:08.518052 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.518022 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5cl58"] Jun 10 19:00:08.521388 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:00:08.521361 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3180912b_789f_492d_8c91_28a8c3e3a18a.slice/crio-59903d6944beac2f18974def99c11170dff709b919ee31ef8118848e306d7fb8 WatchSource:0}: Error finding container 59903d6944beac2f18974def99c11170dff709b919ee31ef8118848e306d7fb8: Status 404 returned error can't find the container with id 59903d6944beac2f18974def99c11170dff709b919ee31ef8118848e306d7fb8 Jun 10 19:00:08.650335 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.650234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mt65r" event={"ID":"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed","Type":"ContainerStarted","Data":"8c646f685302f243c7cd43eaabb9b541d56b4a55d5a3949f49850b6b18d4dd83"} Jun 10 19:00:08.651351 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.651325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5cl58" event={"ID":"3180912b-789f-492d-8c91-28a8c3e3a18a","Type":"ContainerStarted","Data":"59903d6944beac2f18974def99c11170dff709b919ee31ef8118848e306d7fb8"} Jun 10 19:00:08.722065 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:08.722030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 19:00:08.722224 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:00:08.722160 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:00:08.722359 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:00:08.722227 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 19:00:40.722208111 +0000 UTC m=+98.789656465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 19:00:13.667354 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:13.667308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5cl58" event={"ID":"3180912b-789f-492d-8c91-28a8c3e3a18a","Type":"ContainerStarted","Data":"f79bb7c28b60ced1dc07ad4ade8d431bdd3458bded690f0644bcd7438844d812"} Jun 10 19:00:13.668914 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:13.668885 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mt65r" event={"ID":"8bcd346a-f43b-40a5-9ec7-b0ed7d3b87ed","Type":"ContainerStarted","Data":"e6ac1f1ac0af9da53df2cc7195677693afcee7311840e99866553503500b2610"} Jun 10 19:00:13.669054 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:13.669034 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 19:00:13.684404 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:13.684360 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5cl58" podStartSLOduration=66.725797762 podStartE2EDuration="1m11.684346608s" totalImagesPullingTime="4.958548846s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:00:13.683991666 +0000 UTC m=+71.751440033" watchObservedRunningTime="2026-06-10 19:00:13.684346608 +0000 UTC m=+71.751794969" Jun 10 19:00:13.699502 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:13.699407 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mt65r" podStartSLOduration=66.690247324 podStartE2EDuration="1m11.699391847s" totalImagesPullingTime="5.009144523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:00:13.699268576 +0000 UTC m=+71.766716937" watchObservedRunningTime="2026-06-10 19:00:13.699391847 +0000 UTC m=+71.766840205" Jun 10 19:00:40.744429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:40.744375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 19:00:40.744872 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:00:40.744503 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:00:40.744872 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:00:40.744566 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 19:01:44.744551445 +0000 UTC m=+162.811999784 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 19:00:44.674019 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:00:44.673991 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mt65r" Jun 10 19:01:12.153617 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:01:12.153560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 19:01:12.154190 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:01:12.153706 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 19:01:12.154190 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:01:12.153790 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs podName:096826f3-d554-4194-a727-4d10576600a0 nodeName:}" failed. No retries permitted until 2026-06-10 19:03:14.15377361 +0000 UTC m=+252.221221961 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs") pod "network-metrics-daemon-c4fvk" (UID: "096826f3-d554-4194-a727-4d10576600a0") : secret "metrics-daemon-secret" not found Jun 10 19:01:39.907374 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:01:39.907327 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zcfvt" podUID="31ad8ce2-1537-4248-a192-eb9e3809f811" Jun 10 19:01:39.919578 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:01:39.919551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zcfvt" Jun 10 19:01:41.398921 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:01:41.398857 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-c4fvk" podUID="096826f3-d554-4194-a727-4d10576600a0" Jun 10 19:01:44.777980 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:01:44.777891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 19:01:44.778450 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:01:44.778086 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 19:01:44.778450 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:01:44.778199 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls podName:31ad8ce2-1537-4248-a192-eb9e3809f811 nodeName:}" failed. No retries permitted until 2026-06-10 19:03:46.778168384 +0000 UTC m=+284.845616724 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls") pod "dns-default-zcfvt" (UID: "31ad8ce2-1537-4248-a192-eb9e3809f811") : secret "dns-default-metrics-tls" not found Jun 10 19:01:54.384346 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:01:54.384299 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 19:02:26.582842 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.582807 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77bdb95798-ctt6k"] Jun 10 19:02:26.585739 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.585711 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.599304 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.599280 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 19:02:26.599436 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.599337 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 19:02:26.599436 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.599362 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 19:02:26.600082 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.600068 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rfhcn\"" Jun 10 19:02:26.610266 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.610249 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 19:02:26.622696 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.622673 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bdb95798-ctt6k"] Jun 10 19:02:26.665396 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.665519 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-image-registry-private-configuration\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.665519 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d7aecfa-f6f3-417d-9cda-8c5726989807-ca-trust-extracted\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.665519 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-trusted-ca\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.665623 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-installation-pull-secrets\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.665623 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zkrq\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-kube-api-access-2zkrq\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.665623 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-certificates\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.665623 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.665610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-bound-sa-token\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.766681 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d7aecfa-f6f3-417d-9cda-8c5726989807-ca-trust-extracted\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.766868 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-trusted-ca\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.766868 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-installation-pull-secrets\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.766868 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zkrq\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-kube-api-access-2zkrq\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.766868 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-certificates\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.766868 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-bound-sa-token\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.766868 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.767149 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.766892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-image-registry-private-configuration\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.767149 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:26.767001 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:02:26.767149 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:26.767022 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bdb95798-ctt6k: secret "image-registry-tls" not found Jun 10 19:02:26.767149 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:26.767101 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls podName:5d7aecfa-f6f3-417d-9cda-8c5726989807 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:27.267078025 +0000 UTC m=+205.334526384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls") pod "image-registry-77bdb95798-ctt6k" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807") : secret "image-registry-tls" not found Jun 10 19:02:26.767149 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.767121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d7aecfa-f6f3-417d-9cda-8c5726989807-ca-trust-extracted\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.767427 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.767410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-certificates\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.767693 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.767674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-trusted-ca\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.769361 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.769338 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-image-registry-private-configuration\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.769442 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.769359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-installation-pull-secrets\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.779403 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.779373 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-bound-sa-token\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:26.781073 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:26.781049 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zkrq\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-kube-api-access-2zkrq\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:27.270878 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:27.270823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:27.271070 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:27.270965 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:02:27.271070 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:27.270984 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bdb95798-ctt6k: secret "image-registry-tls" not found Jun 10 19:02:27.271070 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:27.271035 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls podName:5d7aecfa-f6f3-417d-9cda-8c5726989807 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:28.271021922 +0000 UTC m=+206.338470262 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls") pod "image-registry-77bdb95798-ctt6k" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807") : secret "image-registry-tls" not found Jun 10 19:02:28.279017 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:28.278966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:28.279401 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:28.279100 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:02:28.279401 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:28.279114 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bdb95798-ctt6k: secret "image-registry-tls" not found Jun 10 19:02:28.279401 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:28.279177 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls podName:5d7aecfa-f6f3-417d-9cda-8c5726989807 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:30.279159039 +0000 UTC m=+208.346607380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls") pod "image-registry-77bdb95798-ctt6k" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807") : secret "image-registry-tls" not found Jun 10 19:02:30.294227 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:30.294178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:30.294617 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:30.294326 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:02:30.294617 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:30.294345 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bdb95798-ctt6k: secret "image-registry-tls" not found Jun 10 19:02:30.294617 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:30.294410 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls podName:5d7aecfa-f6f3-417d-9cda-8c5726989807 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:34.29439353 +0000 UTC m=+212.361841869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls") pod "image-registry-77bdb95798-ctt6k" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807") : secret "image-registry-tls" not found Jun 10 19:02:34.322456 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:34.322413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:34.322933 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:34.322559 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 19:02:34.322933 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:34.322574 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77bdb95798-ctt6k: secret "image-registry-tls" not found Jun 10 19:02:34.322933 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:02:34.322638 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls podName:5d7aecfa-f6f3-417d-9cda-8c5726989807 nodeName:}" failed. No retries permitted until 2026-06-10 19:02:42.322620993 +0000 UTC m=+220.390069355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls") pod "image-registry-77bdb95798-ctt6k" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807") : secret "image-registry-tls" not found Jun 10 19:02:34.749967 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:34.749897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpqdb_d6fb0ba9-c516-4d36-a553-8f69a952afb5/dns-node-resolver/0.log" Jun 10 19:02:35.549853 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:35.549828 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k94jc_26a8bf5d-2508-46d1-a298-a4218c71f472/node-ca/0.log" Jun 10 19:02:36.349748 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:36.349721 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjjjz_50978806-1026-408a-a68e-a7e3515cf0bf/serve-healthcheck-canary/0.log" Jun 10 19:02:42.378104 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:42.378062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:42.380444 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:42.380425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"image-registry-77bdb95798-ctt6k\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:42.494885 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:42.494856 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:42.622882 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:42.622853 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77bdb95798-ctt6k"] Jun 10 19:02:42.625950 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:02:42.625925 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7aecfa_f6f3_417d_9cda_8c5726989807.slice/crio-a4534d58a77368a0571458c9d250c1e0688aa7332c8e246fe04aa1ae08da7e3e WatchSource:0}: Error finding container a4534d58a77368a0571458c9d250c1e0688aa7332c8e246fe04aa1ae08da7e3e: Status 404 returned error can't find the container with id a4534d58a77368a0571458c9d250c1e0688aa7332c8e246fe04aa1ae08da7e3e Jun 10 19:02:43.088951 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:43.088920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" event={"ID":"5d7aecfa-f6f3-417d-9cda-8c5726989807","Type":"ContainerStarted","Data":"4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db"} Jun 10 19:02:43.089114 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:43.088965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" event={"ID":"5d7aecfa-f6f3-417d-9cda-8c5726989807","Type":"ContainerStarted","Data":"a4534d58a77368a0571458c9d250c1e0688aa7332c8e246fe04aa1ae08da7e3e"} Jun 10 19:02:43.089114 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:43.089041 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:02:43.112390 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:43.112340 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" podStartSLOduration=17.112323468 podStartE2EDuration="17.112323468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:43.110663248 +0000 UTC m=+221.178111610" watchObservedRunningTime="2026-06-10 19:02:43.112323468 +0000 UTC m=+221.179771860" Jun 10 19:02:55.682641 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.682603 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bdb95798-ctt6k"] Jun 10 19:02:55.716724 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.716696 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kb8gd"] Jun 10 19:02:55.720942 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.720918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.736718 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.736695 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 19:02:55.736718 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.736711 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 19:02:55.736903 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.736711 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 19:02:55.737090 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.737076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vqmk4\"" Jun 10 19:02:55.737287 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.737273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 19:02:55.773508 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.773480 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb8gd"] Jun 10 19:02:55.869248 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.869209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df899bc2-0e43-460c-806e-3b6f114420f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.869248 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.869248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df899bc2-0e43-460c-806e-3b6f114420f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.869501 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.869320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df899bc2-0e43-460c-806e-3b6f114420f7-crio-socket\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.869501 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.869365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jp78\" (UniqueName: \"kubernetes.io/projected/df899bc2-0e43-460c-806e-3b6f114420f7-kube-api-access-7jp78\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.869501 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.869457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df899bc2-0e43-460c-806e-3b6f114420f7-data-volume\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970069 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.969981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jp78\" (UniqueName: \"kubernetes.io/projected/df899bc2-0e43-460c-806e-3b6f114420f7-kube-api-access-7jp78\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970069 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.970040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df899bc2-0e43-460c-806e-3b6f114420f7-data-volume\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970069 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.970071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df899bc2-0e43-460c-806e-3b6f114420f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970323 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.970085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df899bc2-0e43-460c-806e-3b6f114420f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970323 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.970103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df899bc2-0e43-460c-806e-3b6f114420f7-crio-socket\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970323 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.970280 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df899bc2-0e43-460c-806e-3b6f114420f7-crio-socket\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970455 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.970439 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df899bc2-0e43-460c-806e-3b6f114420f7-data-volume\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.970668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.970650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df899bc2-0e43-460c-806e-3b6f114420f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.972533 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.972510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df899bc2-0e43-460c-806e-3b6f114420f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:55.981441 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:55.981419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jp78\" (UniqueName: \"kubernetes.io/projected/df899bc2-0e43-460c-806e-3b6f114420f7-kube-api-access-7jp78\") pod \"insights-runtime-extractor-kb8gd\" (UID: \"df899bc2-0e43-460c-806e-3b6f114420f7\") " pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:56.029487 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:56.029456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kb8gd" Jun 10 19:02:56.171739 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:56.171707 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kb8gd"] Jun 10 19:02:56.172281 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:02:56.172254 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf899bc2_0e43_460c_806e_3b6f114420f7.slice/crio-a38bcf274ab5b8e7887dcdff0a0f843312d841381be84cd73c2c5ec73f007c3a WatchSource:0}: Error finding container a38bcf274ab5b8e7887dcdff0a0f843312d841381be84cd73c2c5ec73f007c3a: Status 404 returned error can't find the container with id a38bcf274ab5b8e7887dcdff0a0f843312d841381be84cd73c2c5ec73f007c3a Jun 10 19:02:57.131030 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:57.130931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8gd" event={"ID":"df899bc2-0e43-460c-806e-3b6f114420f7","Type":"ContainerStarted","Data":"3722c40004c1fdf4601e25176aac81a7adbe11c3ed500f4ab70025cc6b6ee8db"} Jun 10 19:02:57.131030 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:57.130994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8gd" event={"ID":"df899bc2-0e43-460c-806e-3b6f114420f7","Type":"ContainerStarted","Data":"41439b74c8aaa3cfee8abc2edf4286c4e616fdace0e9bd9e5d20ea4b4e6c53be"} Jun 10 19:02:57.131030 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:57.131019 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8gd" event={"ID":"df899bc2-0e43-460c-806e-3b6f114420f7","Type":"ContainerStarted","Data":"a38bcf274ab5b8e7887dcdff0a0f843312d841381be84cd73c2c5ec73f007c3a"} Jun 10 19:02:59.138504 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:59.138465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kb8gd" event={"ID":"df899bc2-0e43-460c-806e-3b6f114420f7","Type":"ContainerStarted","Data":"88088d4777f6f4f37c7d58d6e2bd17596a259cacf0c4266e872b9d5ec2bb5eb7"} Jun 10 19:02:59.159533 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:02:59.159486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kb8gd" podStartSLOduration=1.726665509 podStartE2EDuration="4.159472216s" totalImagesPullingTime="2.432806707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:02:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:02:59.158989552 +0000 UTC m=+237.226437914" watchObservedRunningTime="2026-06-10 19:02:59.159472216 +0000 UTC m=+237.226920577" Jun 10 19:03:05.687987 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:05.687945 2562 patch_prober.go:28] interesting pod/image-registry-77bdb95798-ctt6k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 19:03:05.688432 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:05.688005 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" podUID="5d7aecfa-f6f3-417d-9cda-8c5726989807" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:03:06.154639 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.154604 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59b7d965f5-z2xgw"] Jun 10 19:03:06.157628 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.157606 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.160680 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.160660 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 19:03:06.161601 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.161584 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 19:03:06.161655 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.161590 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 19:03:06.161924 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.161906 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2nbbw\"" Jun 10 19:03:06.162006 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.161908 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 19:03:06.162006 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.161990 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 19:03:06.162349 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.162335 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 19:03:06.162431 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.162416 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 19:03:06.166850 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.166833 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 19:03:06.174000 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.173983 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b7d965f5-z2xgw"] Jun 10 19:03:06.345602 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.345570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-oauth-serving-cert\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.345808 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.345608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfm28\" (UniqueName: \"kubernetes.io/projected/2d807241-0607-4be0-8acc-a79767937ada-kube-api-access-jfm28\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.345808 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.345632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-oauth-config\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.345808 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.345653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-trusted-ca-bundle\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.345808 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.345682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-service-ca\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.345953 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.345815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-console-config\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.345953 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.345852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-serving-cert\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447077 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.446995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-trusted-ca-bundle\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447077 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-service-ca\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447275 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-console-config\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447275 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-serving-cert\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447275 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-oauth-serving-cert\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447275 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfm28\" (UniqueName: \"kubernetes.io/projected/2d807241-0607-4be0-8acc-a79767937ada-kube-api-access-jfm28\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447275 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-oauth-config\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.447877 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-service-ca\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.448230 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-console-config\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.448230 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-trusted-ca-bundle\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.448385 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.447980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-oauth-serving-cert\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.449818 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.449799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-serving-cert\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.449818 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.449817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-oauth-config\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.456439 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.456418 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfm28\" (UniqueName: \"kubernetes.io/projected/2d807241-0607-4be0-8acc-a79767937ada-kube-api-access-jfm28\") pod \"console-59b7d965f5-z2xgw\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.467289 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.467262 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:06.596772 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:06.596686 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59b7d965f5-z2xgw"] Jun 10 19:03:06.599160 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:06.599137 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d807241_0607_4be0_8acc_a79767937ada.slice/crio-7d894ae6f5abfebc2f923470a092c784366bac853e2f5b68632e4d64080b5af1 WatchSource:0}: Error finding container 7d894ae6f5abfebc2f923470a092c784366bac853e2f5b68632e4d64080b5af1: Status 404 returned error can't find the container with id 7d894ae6f5abfebc2f923470a092c784366bac853e2f5b68632e4d64080b5af1 Jun 10 19:03:07.163308 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:07.163268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b7d965f5-z2xgw" event={"ID":"2d807241-0607-4be0-8acc-a79767937ada","Type":"ContainerStarted","Data":"7d894ae6f5abfebc2f923470a092c784366bac853e2f5b68632e4d64080b5af1"} Jun 10 19:03:09.914695 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.914663 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75"] Jun 10 19:03:09.916894 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.916873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:09.918463 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.918440 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cg5s6"] Jun 10 19:03:09.920367 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.920351 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.921113 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.921098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 19:03:09.922451 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.922371 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 19:03:09.922451 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.922381 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 19:03:09.922451 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.922384 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 19:03:09.922640 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.922475 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bssp8\"" Jun 10 19:03:09.922640 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.922556 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 19:03:09.922640 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.922609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 19:03:09.923259 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.923240 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 19:03:09.923778 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.923741 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 19:03:09.923884 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.923873 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g56ns\"" Jun 10 19:03:09.924069 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.924015 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 19:03:09.943066 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.943033 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75"] Jun 10 19:03:09.973241 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r98gk\" (UniqueName: \"kubernetes.io/projected/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-api-access-r98gk\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:09.973429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-sys\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:09.973429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c46ab8ff-6acf-44ef-8046-f44c15b855e5-metrics-client-ca\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6fhz\" (UniqueName: \"kubernetes.io/projected/c46ab8ff-6acf-44ef-8046-f44c15b855e5-kube-api-access-h6fhz\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973388 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-textfile\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973429 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:09.973706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-tls\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcc4915-c7d6-42e6-b931-39345c372fe9-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:09.973706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:09.973706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973578 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-wtmp\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-root\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:09.973706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:09.973618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8dcc4915-c7d6-42e6-b931-39345c372fe9-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.074346 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c46ab8ff-6acf-44ef-8046-f44c15b855e5-metrics-client-ca\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6fhz\" (UniqueName: \"kubernetes.io/projected/c46ab8ff-6acf-44ef-8046-f44c15b855e5-kube-api-access-h6fhz\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-textfile\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:03:10.074458 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074476 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.074525 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:03:10.074520 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls podName:8dcc4915-c7d6-42e6-b931-39345c372fe9 nodeName:}" failed. No retries permitted until 2026-06-10 19:03:10.57450084 +0000 UTC m=+248.641949196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-khw75" (UID: "8dcc4915-c7d6-42e6-b931-39345c372fe9") : secret "kube-state-metrics-tls" not found Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-tls\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcc4915-c7d6-42e6-b931-39345c372fe9-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-wtmp\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074672 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-root\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8dcc4915-c7d6-42e6-b931-39345c372fe9-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r98gk\" (UniqueName: \"kubernetes.io/projected/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-api-access-r98gk\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-sys\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-sys\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-textfile\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.074969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.074911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-root\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.075483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.075056 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-wtmp\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.075483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.075123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c46ab8ff-6acf-44ef-8046-f44c15b855e5-metrics-client-ca\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.075483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.075155 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-accelerators-collector-config\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.075483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.075214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8dcc4915-c7d6-42e6-b931-39345c372fe9-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.075483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.075393 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8dcc4915-c7d6-42e6-b931-39345c372fe9-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.075483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.075410 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.077501 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.077484 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.077991 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.077970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.078090 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.078007 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c46ab8ff-6acf-44ef-8046-f44c15b855e5-node-exporter-tls\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.086315 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.086285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6fhz\" (UniqueName: \"kubernetes.io/projected/c46ab8ff-6acf-44ef-8046-f44c15b855e5-kube-api-access-h6fhz\") pod \"node-exporter-cg5s6\" (UID: \"c46ab8ff-6acf-44ef-8046-f44c15b855e5\") " pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.087026 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.087000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r98gk\" (UniqueName: \"kubernetes.io/projected/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-api-access-r98gk\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.177569 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.177463 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b7d965f5-z2xgw" event={"ID":"2d807241-0607-4be0-8acc-a79767937ada","Type":"ContainerStarted","Data":"126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529"} Jun 10 19:03:10.203794 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.203727 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59b7d965f5-z2xgw" podStartSLOduration=1.666216103 podStartE2EDuration="4.203709655s" totalImagesPullingTime="2.537493552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:10.203342478 +0000 UTC m=+248.270790838" watchObservedRunningTime="2026-06-10 19:03:10.203709655 +0000 UTC m=+248.271158016" Jun 10 19:03:10.231680 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.231649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cg5s6" Jun 10 19:03:10.241163 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:10.241137 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46ab8ff_6acf_44ef_8046_f44c15b855e5.slice/crio-bc339bbdbdf213e587a1e349587681e0b642cb1f8094e0b202ebe5c5fcea946c WatchSource:0}: Error finding container bc339bbdbdf213e587a1e349587681e0b642cb1f8094e0b202ebe5c5fcea946c: Status 404 returned error can't find the container with id bc339bbdbdf213e587a1e349587681e0b642cb1f8094e0b202ebe5c5fcea946c Jun 10 19:03:10.578683 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:10.578645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:10.578867 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:03:10.578811 2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 10 19:03:10.578926 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:03:10.578868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls podName:8dcc4915-c7d6-42e6-b931-39345c372fe9 nodeName:}" failed. No retries permitted until 2026-06-10 19:03:11.578854528 +0000 UTC m=+249.646302867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-khw75" (UID: "8dcc4915-c7d6-42e6-b931-39345c372fe9") : secret "kube-state-metrics-tls" not found Jun 10 19:03:11.181986 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:11.181959 2562 generic.go:356] "Generic (PLEG): container finished" podID="c46ab8ff-6acf-44ef-8046-f44c15b855e5" containerID="41fd321ec5db0168addaa30305b8f0671351959ec70bdf27457a28562a8eaf17" exitCode=0 Jun 10 19:03:11.182392 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:11.182046 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg5s6" event={"ID":"c46ab8ff-6acf-44ef-8046-f44c15b855e5","Type":"ContainerDied","Data":"41fd321ec5db0168addaa30305b8f0671351959ec70bdf27457a28562a8eaf17"} Jun 10 19:03:11.182392 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:11.182099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg5s6" event={"ID":"c46ab8ff-6acf-44ef-8046-f44c15b855e5","Type":"ContainerStarted","Data":"bc339bbdbdf213e587a1e349587681e0b642cb1f8094e0b202ebe5c5fcea946c"} Jun 10 19:03:11.584920 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:11.584882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:11.587393 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:11.587371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8dcc4915-c7d6-42e6-b931-39345c372fe9-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-khw75\" (UID: \"8dcc4915-c7d6-42e6-b931-39345c372fe9\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:11.727688 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:11.727647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" Jun 10 19:03:11.862245 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:11.862115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75"] Jun 10 19:03:11.865792 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:11.865732 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcc4915_c7d6_42e6_b931_39345c372fe9.slice/crio-faa78f394781d8c72f3823961c63e2a2585d76c7d34e07bed828188677edf8e3 WatchSource:0}: Error finding container faa78f394781d8c72f3823961c63e2a2585d76c7d34e07bed828188677edf8e3: Status 404 returned error can't find the container with id faa78f394781d8c72f3823961c63e2a2585d76c7d34e07bed828188677edf8e3 Jun 10 19:03:12.186747 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:12.186657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg5s6" event={"ID":"c46ab8ff-6acf-44ef-8046-f44c15b855e5","Type":"ContainerStarted","Data":"a1edf995bac889f860bb04722188e41b0bf3edbfd0ea8d79e7fd158f4584a944"} Jun 10 19:03:12.186747 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:12.186723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cg5s6" event={"ID":"c46ab8ff-6acf-44ef-8046-f44c15b855e5","Type":"ContainerStarted","Data":"236b0e39293e830d565958effd5fdb943f0a72568a6cc9e71470f91bd413ef30"} Jun 10 19:03:12.187747 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:12.187728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" event={"ID":"8dcc4915-c7d6-42e6-b931-39345c372fe9","Type":"ContainerStarted","Data":"faa78f394781d8c72f3823961c63e2a2585d76c7d34e07bed828188677edf8e3"} Jun 10 19:03:12.210063 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:12.210013 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cg5s6" podStartSLOduration=2.370233969 podStartE2EDuration="3.209999331s" totalImagesPullingTime="767.654968ms" totalInitContainerRuntime="72.110394ms" isStatefulPod=true podCreationTimestamp="2026-06-10 19:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:12.208645759 +0000 UTC m=+250.276094120" watchObservedRunningTime="2026-06-10 19:03:12.209999331 +0000 UTC m=+250.277447670" Jun 10 19:03:14.174272 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.174235 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6c8fcdbb6-z8blh"] Jun 10 19:03:14.177268 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.177249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.180277 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.180255 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 19:03:14.180377 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.180259 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 19:03:14.181449 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.181424 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 19:03:14.181552 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.181506 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-b47ig1gg5sa21\"" Jun 10 19:03:14.181552 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.181523 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-9jpbr\"" Jun 10 19:03:14.181552 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.181537 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 19:03:14.189560 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.189537 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c8fcdbb6-z8blh"] Jun 10 19:03:14.197200 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.197176 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" event={"ID":"8dcc4915-c7d6-42e6-b931-39345c372fe9","Type":"ContainerStarted","Data":"427f7d344821b105f184514964015cf1008ad9153d6fcae6916488c98158eff3"} Jun 10 19:03:14.197305 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.197233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" event={"ID":"8dcc4915-c7d6-42e6-b931-39345c372fe9","Type":"ContainerStarted","Data":"70e0c7bf840634d5c01c0126b38a14f910e64f729db21e3417bc05b741d9b8d2"} Jun 10 19:03:14.197305 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.197267 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" event={"ID":"8dcc4915-c7d6-42e6-b931-39345c372fe9","Type":"ContainerStarted","Data":"23c808f1176c63b36d67b4d4df441162848615a95bd25d22788b50b13ab387c0"} Jun 10 19:03:14.202735 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-secret-metrics-server-tls\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.202824 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 19:03:14.202824 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04730161-1e2f-4c64-9833-014dfa881167-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.202890 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6hvg\" (UniqueName: \"kubernetes.io/projected/04730161-1e2f-4c64-9833-014dfa881167-kube-api-access-n6hvg\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.202890 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-secret-metrics-server-client-certs\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.202955 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-client-ca-bundle\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.202955 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/04730161-1e2f-4c64-9833-014dfa881167-metrics-server-audit-profiles\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.202955 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.202939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/04730161-1e2f-4c64-9833-014dfa881167-audit-log\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.205103 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.205087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/096826f3-d554-4194-a727-4d10576600a0-metrics-certs\") pod \"network-metrics-daemon-c4fvk\" (UID: \"096826f3-d554-4194-a727-4d10576600a0\") " pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 19:03:14.227555 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.227492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-khw75" podStartSLOduration=3.753061905 podStartE2EDuration="5.227477033s" totalImagesPullingTime="1.474415128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:14.227284625 +0000 UTC m=+252.294732987" watchObservedRunningTime="2026-06-10 19:03:14.227477033 +0000 UTC m=+252.294925395" Jun 10 19:03:14.304087 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.304054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-secret-metrics-server-tls\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.304262 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.304115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04730161-1e2f-4c64-9833-014dfa881167-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.304262 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.304157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6hvg\" (UniqueName: \"kubernetes.io/projected/04730161-1e2f-4c64-9833-014dfa881167-kube-api-access-n6hvg\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.304262 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.304225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-secret-metrics-server-client-certs\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.304262 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.304248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-client-ca-bundle\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.304461 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.304292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/04730161-1e2f-4c64-9833-014dfa881167-metrics-server-audit-profiles\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.304808 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.304782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/04730161-1e2f-4c64-9833-014dfa881167-audit-log\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.305192 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.305154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/04730161-1e2f-4c64-9833-014dfa881167-audit-log\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.305192 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.305156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04730161-1e2f-4c64-9833-014dfa881167-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.305530 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.305508 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/04730161-1e2f-4c64-9833-014dfa881167-metrics-server-audit-profiles\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.306845 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.306821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-client-ca-bundle\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.306925 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.306825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-secret-metrics-server-tls\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.307016 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.307000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/04730161-1e2f-4c64-9833-014dfa881167-secret-metrics-server-client-certs\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.317085 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.317062 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6hvg\" (UniqueName: \"kubernetes.io/projected/04730161-1e2f-4c64-9833-014dfa881167-kube-api-access-n6hvg\") pod \"metrics-server-6c8fcdbb6-z8blh\" (UID: \"04730161-1e2f-4c64-9833-014dfa881167\") " pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.487013 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.486928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:14.487462 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.487444 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j57pv\"" Jun 10 19:03:14.495405 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.495385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c4fvk" Jun 10 19:03:14.639344 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.639311 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6c8fcdbb6-z8blh"] Jun 10 19:03:14.643707 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:14.643681 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04730161_1e2f_4c64_9833_014dfa881167.slice/crio-f93df8407cf3ec2179e2b11944609bbba5a779aa3ef0d12fe65a5eea9e8182eb WatchSource:0}: Error finding container f93df8407cf3ec2179e2b11944609bbba5a779aa3ef0d12fe65a5eea9e8182eb: Status 404 returned error can't find the container with id f93df8407cf3ec2179e2b11944609bbba5a779aa3ef0d12fe65a5eea9e8182eb Jun 10 19:03:14.659343 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.659316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c4fvk"] Jun 10 19:03:14.662006 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:14.661985 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod096826f3_d554_4194_a727_4d10576600a0.slice/crio-fd71d376909cdef3e0439c74df7e97d6da403405203c72b6bf0142bacdefca42 WatchSource:0}: Error finding container fd71d376909cdef3e0439c74df7e97d6da403405203c72b6bf0142bacdefca42: Status 404 returned error can't find the container with id fd71d376909cdef3e0439c74df7e97d6da403405203c72b6bf0142bacdefca42 Jun 10 19:03:14.721129 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.721098 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-644d58885-7fwzk"] Jun 10 19:03:14.725251 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.725232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.742170 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.742108 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644d58885-7fwzk"] Jun 10 19:03:14.809907 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.809869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-oauth-serving-cert\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.809907 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.809908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfd6z\" (UniqueName: \"kubernetes.io/projected/e3a0b55d-b141-4c33-8f5a-dea077682a4d-kube-api-access-sfd6z\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.810118 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.809935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-oauth-config\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.810118 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.809960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-config\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.810118 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.810032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-serving-cert\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.810118 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.810081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-service-ca\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.810275 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.810137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-trusted-ca-bundle\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.910813 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.910751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-service-ca\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.910969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.910836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-trusted-ca-bundle\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.910969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.910905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-oauth-serving-cert\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.910969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.910928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfd6z\" (UniqueName: \"kubernetes.io/projected/e3a0b55d-b141-4c33-8f5a-dea077682a4d-kube-api-access-sfd6z\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.910969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.910954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-oauth-config\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.911170 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.910985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-config\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.911170 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.911036 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-serving-cert\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.911573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.911544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-service-ca\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.911876 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.911590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-oauth-serving-cert\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.911876 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.911699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-config\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.911876 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.911797 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-trusted-ca-bundle\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.913494 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.913463 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-serving-cert\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.913614 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.913542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-oauth-config\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:14.930955 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:14.930935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfd6z\" (UniqueName: \"kubernetes.io/projected/e3a0b55d-b141-4c33-8f5a-dea077682a4d-kube-api-access-sfd6z\") pod \"console-644d58885-7fwzk\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:15.034153 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:15.034070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:15.186034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:15.186004 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644d58885-7fwzk"] Jun 10 19:03:15.189046 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:15.189012 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a0b55d_b141_4c33_8f5a_dea077682a4d.slice/crio-09f79bdf1a33db6df9d1abb243541a956753a3fc37c71fbfd6e6d38062e7b1b3 WatchSource:0}: Error finding container 09f79bdf1a33db6df9d1abb243541a956753a3fc37c71fbfd6e6d38062e7b1b3: Status 404 returned error can't find the container with id 09f79bdf1a33db6df9d1abb243541a956753a3fc37c71fbfd6e6d38062e7b1b3 Jun 10 19:03:15.207403 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:15.207300 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" event={"ID":"04730161-1e2f-4c64-9833-014dfa881167","Type":"ContainerStarted","Data":"f93df8407cf3ec2179e2b11944609bbba5a779aa3ef0d12fe65a5eea9e8182eb"} Jun 10 19:03:15.209118 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:15.209073 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d58885-7fwzk" event={"ID":"e3a0b55d-b141-4c33-8f5a-dea077682a4d","Type":"ContainerStarted","Data":"09f79bdf1a33db6df9d1abb243541a956753a3fc37c71fbfd6e6d38062e7b1b3"} Jun 10 19:03:15.212444 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:15.212417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4fvk" event={"ID":"096826f3-d554-4194-a727-4d10576600a0","Type":"ContainerStarted","Data":"fd71d376909cdef3e0439c74df7e97d6da403405203c72b6bf0142bacdefca42"} Jun 10 19:03:15.687549 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:15.687507 2562 patch_prober.go:28] interesting pod/image-registry-77bdb95798-ctt6k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 19:03:15.687733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:15.687571 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" podUID="5d7aecfa-f6f3-417d-9cda-8c5726989807" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:03:16.218931 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.218895 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d58885-7fwzk" event={"ID":"e3a0b55d-b141-4c33-8f5a-dea077682a4d","Type":"ContainerStarted","Data":"c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893"} Jun 10 19:03:16.260748 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.260702 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-644d58885-7fwzk" podStartSLOduration=2.260688295 podStartE2EDuration="2.260688295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:16.258766439 +0000 UTC m=+254.326214790" watchObservedRunningTime="2026-06-10 19:03:16.260688295 +0000 UTC m=+254.328136634" Jun 10 19:03:16.315345 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.315317 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:03:16.320937 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.320911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.324810 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.324787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 19:03:16.324969 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.324943 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 19:03:16.328923 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.328905 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 19:03:16.330237 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.330220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 19:03:16.331524 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.331510 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 19:03:16.331612 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.331594 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 19:03:16.331778 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.331714 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6g55\"" Jun 10 19:03:16.331900 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.331882 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 19:03:16.332093 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.332054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 19:03:16.332466 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.332247 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 19:03:16.332466 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.332280 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 19:03:16.332693 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.332677 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 19:03:16.333035 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.333017 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 19:03:16.341081 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.341064 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6lmc09kf5pj6h\"" Jun 10 19:03:16.343339 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.343318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 19:03:16.350033 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.350017 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 19:03:16.407513 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.407416 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:03:16.424620 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424713 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424713 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424839 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424839 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424839 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424957 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424957 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424957 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.424957 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425178 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.424986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425178 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425178 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhmmp\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-kube-api-access-zhmmp\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425334 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425440 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425343 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425440 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425376 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425440 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425440 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425640 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.425640 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.425478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.469063 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.468994 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:16.469244 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.469084 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:03:16.469935 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.469906 2562 patch_prober.go:28] interesting pod/console-59b7d965f5-z2xgw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jun 10 19:03:16.470075 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.469949 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59b7d965f5-z2xgw" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Jun 10 19:03:16.526856 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.526822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.526863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.526888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.526925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.526949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.526976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.526998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhmmp\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-kube-api-access-zhmmp\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.527624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.528255 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.527777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.528255 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.528077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.528255 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.528127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.529850 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.528664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.529850 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.529483 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.531560 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.530318 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.532005 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.531789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.533674 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.532499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.533674 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.532829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.533674 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.533334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.533674 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.533593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.534228 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.533983 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.534355 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.534332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.534549 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.534534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.535491 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.535217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.535491 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.535448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.535491 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.535473 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.537039 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.537018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.537122 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.537106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.553865 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.553831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhmmp\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-kube-api-access-zhmmp\") pod \"prometheus-k8s-0\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.644145 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.644111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:16.813920 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:16.813889 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:03:16.817347 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:16.817316 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef8a75a_3e44_4a69_aa46_2700fcb8f6a4.slice/crio-ad28b04d3fd23cab473c8cb2b024d7ae8af77100961bb3597940623fbfdc8c64 WatchSource:0}: Error finding container ad28b04d3fd23cab473c8cb2b024d7ae8af77100961bb3597940623fbfdc8c64: Status 404 returned error can't find the container with id ad28b04d3fd23cab473c8cb2b024d7ae8af77100961bb3597940623fbfdc8c64 Jun 10 19:03:17.223819 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:17.223779 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4fvk" event={"ID":"096826f3-d554-4194-a727-4d10576600a0","Type":"ContainerStarted","Data":"c5bcc18af7ef8f87c3640bd143c4eb25af0b3af7bc0af10cc2735ec533727225"} Jun 10 19:03:17.224267 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:17.223831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c4fvk" event={"ID":"096826f3-d554-4194-a727-4d10576600a0","Type":"ContainerStarted","Data":"e56cbc18fc2a4e446dfbfe136841ff9ba84b830e565b2c4dd47909412f2d4e3a"} Jun 10 19:03:17.224971 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:17.224951 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerStarted","Data":"ad28b04d3fd23cab473c8cb2b024d7ae8af77100961bb3597940623fbfdc8c64"} Jun 10 19:03:17.226284 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:17.226260 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" event={"ID":"04730161-1e2f-4c64-9833-014dfa881167","Type":"ContainerStarted","Data":"228da20e0ecc18ab8f5262314cac6c1ef5ffafa6eebd7604266666860181018d"} Jun 10 19:03:17.253728 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:17.253686 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c4fvk" podStartSLOduration=253.641825092 podStartE2EDuration="4m15.253671604s" totalImagesPullingTime="1.611846512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:17.252640159 +0000 UTC m=+255.320088512" watchObservedRunningTime="2026-06-10 19:03:17.253671604 +0000 UTC m=+255.321119964" Jun 10 19:03:17.325798 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:17.325729 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" podStartSLOduration=1.6936985409999998 podStartE2EDuration="3.325712133s" totalImagesPullingTime="1.632013592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:17.324904746 +0000 UTC m=+255.392353121" watchObservedRunningTime="2026-06-10 19:03:17.325712133 +0000 UTC m=+255.393160537" Jun 10 19:03:18.231101 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:18.231066 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" exitCode=0 Jun 10 19:03:18.231470 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:18.231155 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b"} Jun 10 19:03:20.702500 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.702459 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" podUID="5d7aecfa-f6f3-417d-9cda-8c5726989807" containerName="registry" containerID="cri-o://4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db" gracePeriod=30 Jun 10 19:03:20.945445 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.945421 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:03:20.970664 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970606 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.970664 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970640 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-bound-sa-token\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.970830 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970676 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-image-registry-private-configuration\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.970830 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970712 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-installation-pull-secrets\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.970830 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970785 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-trusted-ca\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.970830 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970809 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zkrq\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-kube-api-access-2zkrq\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.971025 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970843 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d7aecfa-f6f3-417d-9cda-8c5726989807-ca-trust-extracted\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.971025 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.970887 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-certificates\") pod \"5d7aecfa-f6f3-417d-9cda-8c5726989807\" (UID: \"5d7aecfa-f6f3-417d-9cda-8c5726989807\") " Jun 10 19:03:20.971353 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.971297 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:03:20.971487 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.971397 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:03:20.973432 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.973389 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:03:20.973526 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.973469 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:03:20.973526 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.973469 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:03:20.973621 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.973536 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-kube-api-access-2zkrq" (OuterVolumeSpecName: "kube-api-access-2zkrq") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "kube-api-access-2zkrq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:03:20.973621 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.973534 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:03:20.981511 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:20.981484 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7aecfa-f6f3-417d-9cda-8c5726989807-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5d7aecfa-f6f3-417d-9cda-8c5726989807" (UID: "5d7aecfa-f6f3-417d-9cda-8c5726989807"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:03:21.071672 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071637 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-tls\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.071672 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071665 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-bound-sa-token\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.071672 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071677 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-image-registry-private-configuration\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.071964 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071687 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d7aecfa-f6f3-417d-9cda-8c5726989807-installation-pull-secrets\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.071964 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071697 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-trusted-ca\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.071964 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071706 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zkrq\" (UniqueName: \"kubernetes.io/projected/5d7aecfa-f6f3-417d-9cda-8c5726989807-kube-api-access-2zkrq\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.071964 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071713 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d7aecfa-f6f3-417d-9cda-8c5726989807-ca-trust-extracted\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.071964 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.071722 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d7aecfa-f6f3-417d-9cda-8c5726989807-registry-certificates\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:03:21.243806 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.243696 2562 generic.go:356] "Generic (PLEG): container finished" podID="5d7aecfa-f6f3-417d-9cda-8c5726989807" containerID="4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db" exitCode=0 Jun 10 19:03:21.243806 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.243745 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" Jun 10 19:03:21.244007 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.243797 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" event={"ID":"5d7aecfa-f6f3-417d-9cda-8c5726989807","Type":"ContainerDied","Data":"4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db"} Jun 10 19:03:21.244007 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.243859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77bdb95798-ctt6k" event={"ID":"5d7aecfa-f6f3-417d-9cda-8c5726989807","Type":"ContainerDied","Data":"a4534d58a77368a0571458c9d250c1e0688aa7332c8e246fe04aa1ae08da7e3e"} Jun 10 19:03:21.245024 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.245006 2562 scope.go:117] "RemoveContainer" containerID="4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db" Jun 10 19:03:21.254937 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.254917 2562 scope.go:117] "RemoveContainer" containerID="4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db" Jun 10 19:03:21.255232 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:03:21.255198 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db\": container with ID starting with 4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db not found: ID does not exist" containerID="4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db" Jun 10 19:03:21.255323 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.255231 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db"} err="failed to get container status \"4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db\": rpc error: code = NotFound desc = could not find container \"4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db\": container with ID starting with 4878bd266bca6835ca1cc01405995fe45fe4c256307d1be6649b26ac3b9775db not found: ID does not exist" Jun 10 19:03:21.273510 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.273478 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77bdb95798-ctt6k"] Jun 10 19:03:21.287809 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:21.287781 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77bdb95798-ctt6k"] Jun 10 19:03:22.389113 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:22.389073 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7aecfa-f6f3-417d-9cda-8c5726989807" path="/var/lib/kubelet/pods/5d7aecfa-f6f3-417d-9cda-8c5726989807/volumes" Jun 10 19:03:23.255358 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:23.255326 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerStarted","Data":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} Jun 10 19:03:23.255520 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:23.255398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerStarted","Data":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} Jun 10 19:03:25.034554 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:25.034510 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:25.035060 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:25.034588 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:03:25.036078 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:25.036048 2562 patch_prober.go:28] interesting pod/console-644d58885-7fwzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 10 19:03:25.036212 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:25.036098 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-644d58885-7fwzk" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 10 19:03:25.266424 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:25.266393 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerStarted","Data":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} Jun 10 19:03:26.273468 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:26.273424 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerStarted","Data":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} Jun 10 19:03:26.273856 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:26.273518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerStarted","Data":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} Jun 10 19:03:26.273856 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:26.273546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerStarted","Data":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} Jun 10 19:03:26.324705 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:26.324641 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.527424636 podStartE2EDuration="10.324621547s" totalImagesPullingTime="7.778879616s" totalInitContainerRuntime="18.317295ms" isStatefulPod=false podCreationTimestamp="2026-06-10 19:03:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:26.322540349 +0000 UTC m=+264.389988711" watchObservedRunningTime="2026-06-10 19:03:26.324621547 +0000 UTC m=+264.392069909" Jun 10 19:03:26.467904 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:26.467858 2562 patch_prober.go:28] interesting pod/console-59b7d965f5-z2xgw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jun 10 19:03:26.468065 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:26.467911 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59b7d965f5-z2xgw" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Jun 10 19:03:26.644870 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:26.644835 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:03:34.487845 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:34.487809 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:34.488239 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:34.487904 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:35.035405 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:35.035374 2562 patch_prober.go:28] interesting pod/console-644d58885-7fwzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 10 19:03:35.035576 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:35.035437 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-644d58885-7fwzk" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 10 19:03:36.468506 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:36.468470 2562 patch_prober.go:28] interesting pod/console-59b7d965f5-z2xgw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jun 10 19:03:36.469184 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:36.468523 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59b7d965f5-z2xgw" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Jun 10 19:03:42.920681 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:03:42.920641 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zcfvt" podUID="31ad8ce2-1537-4248-a192-eb9e3809f811" Jun 10 19:03:43.332013 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:43.331985 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zcfvt" Jun 10 19:03:45.035267 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:45.035232 2562 patch_prober.go:28] interesting pod/console-644d58885-7fwzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 10 19:03:45.035631 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:45.035295 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-644d58885-7fwzk" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 10 19:03:46.468152 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:46.468109 2562 patch_prober.go:28] interesting pod/console-59b7d965f5-z2xgw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jun 10 19:03:46.468521 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:46.468163 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59b7d965f5-z2xgw" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Jun 10 19:03:46.801929 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:46.801894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 19:03:46.804460 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:46.804425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31ad8ce2-1537-4248-a192-eb9e3809f811-metrics-tls\") pod \"dns-default-zcfvt\" (UID: \"31ad8ce2-1537-4248-a192-eb9e3809f811\") " pod="openshift-dns/dns-default-zcfvt" Jun 10 19:03:46.936206 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:46.936174 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77lp9\"" Jun 10 19:03:46.943538 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:46.943511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zcfvt" Jun 10 19:03:47.078676 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:47.078590 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zcfvt"] Jun 10 19:03:47.082085 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:03:47.082055 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31ad8ce2_1537_4248_a192_eb9e3809f811.slice/crio-8c922e4ee0e16b8760ffb277176202556eeb783f699f36e0f7c432bd6d186311 WatchSource:0}: Error finding container 8c922e4ee0e16b8760ffb277176202556eeb783f699f36e0f7c432bd6d186311: Status 404 returned error can't find the container with id 8c922e4ee0e16b8760ffb277176202556eeb783f699f36e0f7c432bd6d186311 Jun 10 19:03:47.349578 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:47.349492 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zcfvt" event={"ID":"31ad8ce2-1537-4248-a192-eb9e3809f811","Type":"ContainerStarted","Data":"8c922e4ee0e16b8760ffb277176202556eeb783f699f36e0f7c432bd6d186311"} Jun 10 19:03:49.543604 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:49.543560 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" podUID="65c8358b-6d41-4394-9a55-9732a5e84e84" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 19:03:50.363351 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:50.363313 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zcfvt" event={"ID":"31ad8ce2-1537-4248-a192-eb9e3809f811","Type":"ContainerStarted","Data":"3a93b5b2c3f3f9b039fc6fc2e2a9d49430003bb2f25cd89c0300c18c495aed2b"} Jun 10 19:03:50.363544 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:50.363368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zcfvt" event={"ID":"31ad8ce2-1537-4248-a192-eb9e3809f811","Type":"ContainerStarted","Data":"92c630c8cbca0fd2269d551693c30c5b52ddf8a8d340f8e02be56964f356480a"} Jun 10 19:03:50.363544 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:50.363436 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zcfvt" Jun 10 19:03:50.390935 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:50.390888 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zcfvt" podStartSLOduration=251.89528737 podStartE2EDuration="4m14.390872307s" totalImagesPullingTime="2.495584937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 18:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:03:50.389834541 +0000 UTC m=+288.457282902" watchObservedRunningTime="2026-06-10 19:03:50.390872307 +0000 UTC m=+288.458320667" Jun 10 19:03:54.493129 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:54.493100 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:54.497145 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:54.497118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6c8fcdbb6-z8blh" Jun 10 19:03:55.034515 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:55.034470 2562 patch_prober.go:28] interesting pod/console-644d58885-7fwzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 10 19:03:55.034671 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:55.034536 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-644d58885-7fwzk" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 10 19:03:56.021543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:56.021500 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-khw75_8dcc4915-c7d6-42e6-b931-39345c372fe9/kube-state-metrics/0.log" Jun 10 19:03:56.217466 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:56.217437 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-khw75_8dcc4915-c7d6-42e6-b931-39345c372fe9/kube-rbac-proxy-main/0.log" Jun 10 19:03:56.417134 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:56.417086 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-khw75_8dcc4915-c7d6-42e6-b931-39345c372fe9/kube-rbac-proxy-self/0.log" Jun 10 19:03:56.467675 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:56.467642 2562 patch_prober.go:28] interesting pod/console-59b7d965f5-z2xgw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jun 10 19:03:56.467898 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:56.467706 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-59b7d965f5-z2xgw" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Jun 10 19:03:56.617288 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:56.617252 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c8fcdbb6-z8blh_04730161-1e2f-4c64-9833-014dfa881167/metrics-server/0.log" Jun 10 19:03:57.616715 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:57.616684 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg5s6_c46ab8ff-6acf-44ef-8046-f44c15b855e5/init-textfile/0.log" Jun 10 19:03:57.818087 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:57.818035 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg5s6_c46ab8ff-6acf-44ef-8046-f44c15b855e5/node-exporter/0.log" Jun 10 19:03:58.016903 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:58.016820 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg5s6_c46ab8ff-6acf-44ef-8046-f44c15b855e5/kube-rbac-proxy/0.log" Jun 10 19:03:59.417248 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:59.417214 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/init-config-reloader/0.log" Jun 10 19:03:59.543289 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:59.543253 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" podUID="65c8358b-6d41-4394-9a55-9732a5e84e84" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 19:03:59.618603 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:59.618571 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/prometheus/0.log" Jun 10 19:03:59.817466 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:03:59.817426 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/config-reloader/0.log" Jun 10 19:04:00.017282 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:00.017245 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/thanos-sidecar/0.log" Jun 10 19:04:00.217824 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:00.217721 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/kube-rbac-proxy-web/0.log" Jun 10 19:04:00.369111 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:00.369080 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zcfvt" Jun 10 19:04:00.416703 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:00.416666 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/kube-rbac-proxy/0.log" Jun 10 19:04:00.617198 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:00.617169 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/kube-rbac-proxy-thanos/0.log" Jun 10 19:04:02.331741 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:02.331718 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 19:04:03.218875 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:03.218846 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59b7d965f5-z2xgw_2d807241-0607-4be0-8acc-a79767937ada/console/0.log" Jun 10 19:04:03.417648 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:03.417612 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-644d58885-7fwzk_e3a0b55d-b141-4c33-8f5a-dea077682a4d/console/0.log" Jun 10 19:04:04.817347 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:04.817318 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zcfvt_31ad8ce2-1537-4248-a192-eb9e3809f811/dns/0.log" Jun 10 19:04:05.016905 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:05.016874 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zcfvt_31ad8ce2-1537-4248-a192-eb9e3809f811/kube-rbac-proxy/0.log" Jun 10 19:04:05.038607 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:05.038581 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:04:05.042374 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:05.042348 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:04:05.130723 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:05.130635 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b7d965f5-z2xgw"] Jun 10 19:04:05.616745 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:05.616719 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpqdb_d6fb0ba9-c516-4d36-a553-8f69a952afb5/dns-node-resolver/0.log" Jun 10 19:04:06.417630 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:06.417590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k94jc_26a8bf5d-2508-46d1-a298-a4218c71f472/node-ca/0.log" Jun 10 19:04:07.216547 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:07.216518 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjjjz_50978806-1026-408a-a68e-a7e3515cf0bf/serve-healthcheck-canary/0.log" Jun 10 19:04:09.543782 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:09.543723 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" podUID="65c8358b-6d41-4394-9a55-9732a5e84e84" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 10 19:04:09.544229 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:09.543911 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" Jun 10 19:04:09.544582 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:09.544550 2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"11c90cde14de2434df15fed6e66bb4583f1a35618f4bf1be05de6a98ec3353dd"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 10 19:04:09.544724 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:09.544600 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" podUID="65c8358b-6d41-4394-9a55-9732a5e84e84" containerName="service-proxy" containerID="cri-o://11c90cde14de2434df15fed6e66bb4583f1a35618f4bf1be05de6a98ec3353dd" gracePeriod=30 Jun 10 19:04:10.438295 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:10.438255 2562 generic.go:356] "Generic (PLEG): container finished" podID="65c8358b-6d41-4394-9a55-9732a5e84e84" containerID="11c90cde14de2434df15fed6e66bb4583f1a35618f4bf1be05de6a98ec3353dd" exitCode=2 Jun 10 19:04:10.438488 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:10.438332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" event={"ID":"65c8358b-6d41-4394-9a55-9732a5e84e84","Type":"ContainerDied","Data":"11c90cde14de2434df15fed6e66bb4583f1a35618f4bf1be05de6a98ec3353dd"} Jun 10 19:04:10.438488 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:10.438382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85859f887c-cq667" event={"ID":"65c8358b-6d41-4394-9a55-9732a5e84e84","Type":"ContainerStarted","Data":"c94c8bdc9f8d7c5e1b5a8315a7282bfb48bae176e94fe37ae54f42811b4f67d5"} Jun 10 19:04:16.644365 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:16.644312 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:16.665133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:16.665105 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:17.477694 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:17.477669 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:30.150489 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.150431 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59b7d965f5-z2xgw" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" containerID="cri-o://126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529" gracePeriod=15 Jun 10 19:04:30.401257 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.401197 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:04:30.507734 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.507698 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d807241-0607-4be0-8acc-a79767937ada" containerID="126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529" exitCode=0 Jun 10 19:04:30.507734 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.507736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b7d965f5-z2xgw" event={"ID":"2d807241-0607-4be0-8acc-a79767937ada","Type":"ContainerDied","Data":"126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529"} Jun 10 19:04:30.508000 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.507785 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59b7d965f5-z2xgw" Jun 10 19:04:30.508000 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.507820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59b7d965f5-z2xgw" event={"ID":"2d807241-0607-4be0-8acc-a79767937ada","Type":"ContainerDied","Data":"7d894ae6f5abfebc2f923470a092c784366bac853e2f5b68632e4d64080b5af1"} Jun 10 19:04:30.508000 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.507840 2562 scope.go:117] "RemoveContainer" containerID="126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529" Jun 10 19:04:30.518113 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.518088 2562 scope.go:117] "RemoveContainer" containerID="126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529" Jun 10 19:04:30.518365 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:30.518344 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529\": container with ID starting with 126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529 not found: ID does not exist" containerID="126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529" Jun 10 19:04:30.518433 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.518373 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529"} err="failed to get container status \"126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529\": rpc error: code = NotFound desc = could not find container \"126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529\": container with ID starting with 126719e99cc264a82b3950b3fae0ebc4ce40942c9010186e56c5ab21ab217529 not found: ID does not exist" Jun 10 19:04:30.558879 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.558845 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfm28\" (UniqueName: \"kubernetes.io/projected/2d807241-0607-4be0-8acc-a79767937ada-kube-api-access-jfm28\") pod \"2d807241-0607-4be0-8acc-a79767937ada\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " Jun 10 19:04:30.559025 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.558891 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-oauth-serving-cert\") pod \"2d807241-0607-4be0-8acc-a79767937ada\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " Jun 10 19:04:30.559025 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.558924 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-service-ca\") pod \"2d807241-0607-4be0-8acc-a79767937ada\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " Jun 10 19:04:30.559025 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.558965 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-serving-cert\") pod \"2d807241-0607-4be0-8acc-a79767937ada\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " Jun 10 19:04:30.559176 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559108 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-oauth-config\") pod \"2d807241-0607-4be0-8acc-a79767937ada\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " Jun 10 19:04:30.559176 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559166 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-trusted-ca-bundle\") pod \"2d807241-0607-4be0-8acc-a79767937ada\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " Jun 10 19:04:30.559278 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559208 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-console-config\") pod \"2d807241-0607-4be0-8acc-a79767937ada\" (UID: \"2d807241-0607-4be0-8acc-a79767937ada\") " Jun 10 19:04:30.559347 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559325 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d807241-0607-4be0-8acc-a79767937ada" (UID: "2d807241-0607-4be0-8acc-a79767937ada"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:30.559347 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559333 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d807241-0607-4be0-8acc-a79767937ada" (UID: "2d807241-0607-4be0-8acc-a79767937ada"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:30.559634 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559604 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d807241-0607-4be0-8acc-a79767937ada" (UID: "2d807241-0607-4be0-8acc-a79767937ada"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:30.559634 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559612 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-console-config" (OuterVolumeSpecName: "console-config") pod "2d807241-0607-4be0-8acc-a79767937ada" (UID: "2d807241-0607-4be0-8acc-a79767937ada"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:30.559803 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559748 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-oauth-serving-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:30.559803 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.559795 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-service-ca\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:30.561402 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.561367 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d807241-0607-4be0-8acc-a79767937ada-kube-api-access-jfm28" (OuterVolumeSpecName: "kube-api-access-jfm28") pod "2d807241-0607-4be0-8acc-a79767937ada" (UID: "2d807241-0607-4be0-8acc-a79767937ada"). InnerVolumeSpecName "kube-api-access-jfm28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:30.561402 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.561385 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d807241-0607-4be0-8acc-a79767937ada" (UID: "2d807241-0607-4be0-8acc-a79767937ada"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:30.561523 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.561442 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d807241-0607-4be0-8acc-a79767937ada" (UID: "2d807241-0607-4be0-8acc-a79767937ada"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:30.661088 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.660995 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfm28\" (UniqueName: \"kubernetes.io/projected/2d807241-0607-4be0-8acc-a79767937ada-kube-api-access-jfm28\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:30.661088 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.661029 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-serving-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:30.661088 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.661038 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d807241-0607-4be0-8acc-a79767937ada-console-oauth-config\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:30.661088 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.661048 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-trusted-ca-bundle\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:30.661088 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.661056 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d807241-0607-4be0-8acc-a79767937ada-console-config\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:30.831123 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.831095 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59b7d965f5-z2xgw"] Jun 10 19:04:30.835863 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:30.835838 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59b7d965f5-z2xgw"] Jun 10 19:04:32.388301 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:32.388268 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d807241-0607-4be0-8acc-a79767937ada" path="/var/lib/kubelet/pods/2d807241-0607-4be0-8acc-a79767937ada/volumes" Jun 10 19:04:34.879260 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:34.879229 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:04:34.879705 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:34.879515 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy" containerID="cri-o://26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" gracePeriod=600 Jun 10 19:04:34.879705 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:34.879536 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="thanos-sidecar" containerID="cri-o://c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" gracePeriod=600 Jun 10 19:04:34.879845 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:34.879511 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="prometheus" containerID="cri-o://a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" gracePeriod=600 Jun 10 19:04:34.880124 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:34.880095 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" gracePeriod=600 Jun 10 19:04:34.880668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:34.880371 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-web" containerID="cri-o://527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" gracePeriod=600 Jun 10 19:04:34.880668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:34.880567 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="config-reloader" containerID="cri-o://ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" gracePeriod=600 Jun 10 19:04:35.151940 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.151916 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.296738 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.296704 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config-out\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.296738 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.296738 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-tls-assets\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.296947 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.296787 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.296947 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.296873 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-metrics-client-ca\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297070 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297050 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-0\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297123 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297084 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297123 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297109 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-trusted-ca-bundle\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297227 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297161 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-web-config\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297227 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297202 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-tls\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297325 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297233 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-db\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297325 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297259 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-grpc-tls\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297325 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297301 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-kube-rbac-proxy\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297470 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297333 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-serving-certs-ca-bundle\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297470 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297364 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-kubelet-serving-ca-bundle\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297470 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297387 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhmmp\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-kube-api-access-zhmmp\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297470 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297411 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297470 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297435 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-metrics-client-certs\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297714 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297478 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-thanos-prometheus-http-client-file\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297714 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297507 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-2\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.297714 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297548 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-1\") pod \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\" (UID: \"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4\") " Jun 10 19:04:35.299660 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297256 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:35.299801 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.297792 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:35.299801 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.298087 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:35.299801 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.298516 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:35.299801 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.299003 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:35.299801 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.299285 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:04:35.300077 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.300031 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:35.300173 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.300146 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.300346 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.300315 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.300424 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.300403 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.300560 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.300494 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config-out" (OuterVolumeSpecName: "config-out") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 19:04:35.300780 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.300663 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:35.301012 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.300982 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:04:35.302212 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.302184 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.302315 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.302226 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-kube-api-access-zhmmp" (OuterVolumeSpecName: "kube-api-access-zhmmp") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "kube-api-access-zhmmp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:04:35.302485 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.302452 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.302485 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.302467 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.302604 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.302528 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.302897 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.302878 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config" (OuterVolumeSpecName: "config") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.311346 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.311323 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-web-config" (OuterVolumeSpecName: "web-config") pod "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" (UID: "4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.398975 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399004 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhmmp\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-kube-api-access-zhmmp\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399014 2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399024 2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-metrics-client-certs\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399033 2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399042 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399051 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399059 2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-config-out\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399058 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399066 2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-tls-assets\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399074 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399083 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-metrics-client-ca\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399090 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399099 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399107 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399115 2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-web-config\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399122 2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399130 2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-prometheus-k8s-db\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399138 2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-grpc-tls\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399146 2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-secret-kube-rbac-proxy\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.399420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.399155 2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:04:35.527989 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.527957 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" exitCode=0 Jun 10 19:04:35.527989 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.527983 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" exitCode=0 Jun 10 19:04:35.527989 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.527991 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" exitCode=0 Jun 10 19:04:35.527989 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.527998 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" exitCode=0 Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528006 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" exitCode=0 Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528013 2562 generic.go:356] "Generic (PLEG): container finished" podID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" exitCode=0 Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528035 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528036 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528170 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528187 2562 scope.go:117] "RemoveContainer" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528202 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} Jun 10 19:04:35.528302 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.528283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4","Type":"ContainerDied","Data":"ad28b04d3fd23cab473c8cb2b024d7ae8af77100961bb3597940623fbfdc8c64"} Jun 10 19:04:35.536242 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.536222 2562 scope.go:117] "RemoveContainer" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.542879 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.542857 2562 scope.go:117] "RemoveContainer" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.549283 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.549265 2562 scope.go:117] "RemoveContainer" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.555749 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.555732 2562 scope.go:117] "RemoveContainer" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.562113 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.562084 2562 scope.go:117] "RemoveContainer" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.565360 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.565339 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:04:35.569423 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.569406 2562 scope.go:117] "RemoveContainer" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.576674 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.576658 2562 scope.go:117] "RemoveContainer" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.576920 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.576902 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:04:35.576979 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:35.576921 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": container with ID starting with b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e not found: ID does not exist" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.576979 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.576946 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} err="failed to get container status \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": rpc error: code = NotFound desc = could not find container \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": container with ID starting with b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e not found: ID does not exist" Jun 10 19:04:35.576979 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.576964 2562 scope.go:117] "RemoveContainer" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.577215 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:35.577198 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": container with ID starting with 26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2 not found: ID does not exist" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.577258 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.577219 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} err="failed to get container status \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": rpc error: code = NotFound desc = could not find container \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": container with ID starting with 26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2 not found: ID does not exist" Jun 10 19:04:35.577258 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.577237 2562 scope.go:117] "RemoveContainer" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.577503 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:35.577485 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": container with ID starting with 527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17 not found: ID does not exist" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.577547 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.577508 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} err="failed to get container status \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": rpc error: code = NotFound desc = could not find container \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": container with ID starting with 527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17 not found: ID does not exist" Jun 10 19:04:35.577547 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.577522 2562 scope.go:117] "RemoveContainer" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.577789 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:35.577769 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": container with ID starting with c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c not found: ID does not exist" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.577840 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.577792 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} err="failed to get container status \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": rpc error: code = NotFound desc = could not find container \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": container with ID starting with c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c not found: ID does not exist" Jun 10 19:04:35.577840 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.577807 2562 scope.go:117] "RemoveContainer" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.578065 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:35.578051 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": container with ID starting with ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4 not found: ID does not exist" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.578123 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578068 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} err="failed to get container status \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": rpc error: code = NotFound desc = could not find container \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": container with ID starting with ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4 not found: ID does not exist" Jun 10 19:04:35.578123 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578079 2562 scope.go:117] "RemoveContainer" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.578306 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:35.578289 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": container with ID starting with a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938 not found: ID does not exist" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.578347 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578309 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} err="failed to get container status \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": rpc error: code = NotFound desc = could not find container \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": container with ID starting with a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938 not found: ID does not exist" Jun 10 19:04:35.578347 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578324 2562 scope.go:117] "RemoveContainer" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.578545 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:04:35.578533 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": container with ID starting with fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b not found: ID does not exist" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.578591 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578547 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b"} err="failed to get container status \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": rpc error: code = NotFound desc = could not find container \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": container with ID starting with fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b not found: ID does not exist" Jun 10 19:04:35.578591 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578558 2562 scope.go:117] "RemoveContainer" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.578785 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578750 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} err="failed to get container status \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": rpc error: code = NotFound desc = could not find container \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": container with ID starting with b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e not found: ID does not exist" Jun 10 19:04:35.578847 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.578788 2562 scope.go:117] "RemoveContainer" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.579025 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579007 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} err="failed to get container status \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": rpc error: code = NotFound desc = could not find container \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": container with ID starting with 26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2 not found: ID does not exist" Jun 10 19:04:35.579070 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579025 2562 scope.go:117] "RemoveContainer" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.579225 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579204 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} err="failed to get container status \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": rpc error: code = NotFound desc = could not find container \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": container with ID starting with 527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17 not found: ID does not exist" Jun 10 19:04:35.579293 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579227 2562 scope.go:117] "RemoveContainer" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.579428 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579412 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} err="failed to get container status \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": rpc error: code = NotFound desc = could not find container \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": container with ID starting with c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c not found: ID does not exist" Jun 10 19:04:35.579475 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579428 2562 scope.go:117] "RemoveContainer" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.579637 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579621 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} err="failed to get container status \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": rpc error: code = NotFound desc = could not find container \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": container with ID starting with ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4 not found: ID does not exist" Jun 10 19:04:35.579701 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579638 2562 scope.go:117] "RemoveContainer" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.579916 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579897 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} err="failed to get container status \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": rpc error: code = NotFound desc = could not find container \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": container with ID starting with a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938 not found: ID does not exist" Jun 10 19:04:35.579972 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.579918 2562 scope.go:117] "RemoveContainer" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.580158 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580140 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b"} err="failed to get container status \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": rpc error: code = NotFound desc = could not find container \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": container with ID starting with fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b not found: ID does not exist" Jun 10 19:04:35.580225 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580159 2562 scope.go:117] "RemoveContainer" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.580375 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580357 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} err="failed to get container status \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": rpc error: code = NotFound desc = could not find container \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": container with ID starting with b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e not found: ID does not exist" Jun 10 19:04:35.580420 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580376 2562 scope.go:117] "RemoveContainer" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.580562 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580546 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} err="failed to get container status \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": rpc error: code = NotFound desc = could not find container \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": container with ID starting with 26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2 not found: ID does not exist" Jun 10 19:04:35.580602 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580563 2562 scope.go:117] "RemoveContainer" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.580803 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580743 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} err="failed to get container status \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": rpc error: code = NotFound desc = could not find container \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": container with ID starting with 527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17 not found: ID does not exist" Jun 10 19:04:35.580882 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.580805 2562 scope.go:117] "RemoveContainer" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.581037 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581019 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} err="failed to get container status \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": rpc error: code = NotFound desc = could not find container \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": container with ID starting with c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c not found: ID does not exist" Jun 10 19:04:35.581082 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581038 2562 scope.go:117] "RemoveContainer" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.581233 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581212 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} err="failed to get container status \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": rpc error: code = NotFound desc = could not find container \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": container with ID starting with ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4 not found: ID does not exist" Jun 10 19:04:35.581276 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581235 2562 scope.go:117] "RemoveContainer" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.581425 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581410 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} err="failed to get container status \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": rpc error: code = NotFound desc = could not find container \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": container with ID starting with a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938 not found: ID does not exist" Jun 10 19:04:35.581466 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581424 2562 scope.go:117] "RemoveContainer" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.581630 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581610 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b"} err="failed to get container status \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": rpc error: code = NotFound desc = could not find container \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": container with ID starting with fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b not found: ID does not exist" Jun 10 19:04:35.581698 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581631 2562 scope.go:117] "RemoveContainer" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.581862 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581843 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} err="failed to get container status \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": rpc error: code = NotFound desc = could not find container \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": container with ID starting with b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e not found: ID does not exist" Jun 10 19:04:35.581912 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.581862 2562 scope.go:117] "RemoveContainer" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.582047 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582029 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} err="failed to get container status \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": rpc error: code = NotFound desc = could not find container \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": container with ID starting with 26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2 not found: ID does not exist" Jun 10 19:04:35.582107 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582048 2562 scope.go:117] "RemoveContainer" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.582255 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582238 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} err="failed to get container status \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": rpc error: code = NotFound desc = could not find container \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": container with ID starting with 527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17 not found: ID does not exist" Jun 10 19:04:35.582298 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582255 2562 scope.go:117] "RemoveContainer" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.582461 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582439 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} err="failed to get container status \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": rpc error: code = NotFound desc = could not find container \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": container with ID starting with c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c not found: ID does not exist" Jun 10 19:04:35.582548 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582464 2562 scope.go:117] "RemoveContainer" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.582706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582690 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} err="failed to get container status \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": rpc error: code = NotFound desc = could not find container \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": container with ID starting with ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4 not found: ID does not exist" Jun 10 19:04:35.582777 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582706 2562 scope.go:117] "RemoveContainer" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.582935 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582915 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} err="failed to get container status \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": rpc error: code = NotFound desc = could not find container \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": container with ID starting with a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938 not found: ID does not exist" Jun 10 19:04:35.582972 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.582935 2562 scope.go:117] "RemoveContainer" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.583154 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583138 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b"} err="failed to get container status \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": rpc error: code = NotFound desc = could not find container \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": container with ID starting with fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b not found: ID does not exist" Jun 10 19:04:35.583199 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583155 2562 scope.go:117] "RemoveContainer" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.583372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583352 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} err="failed to get container status \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": rpc error: code = NotFound desc = could not find container \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": container with ID starting with b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e not found: ID does not exist" Jun 10 19:04:35.583411 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583378 2562 scope.go:117] "RemoveContainer" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.583566 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583549 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} err="failed to get container status \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": rpc error: code = NotFound desc = could not find container \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": container with ID starting with 26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2 not found: ID does not exist" Jun 10 19:04:35.583603 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583566 2562 scope.go:117] "RemoveContainer" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.583783 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583748 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} err="failed to get container status \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": rpc error: code = NotFound desc = could not find container \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": container with ID starting with 527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17 not found: ID does not exist" Jun 10 19:04:35.583841 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583784 2562 scope.go:117] "RemoveContainer" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.583984 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583969 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} err="failed to get container status \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": rpc error: code = NotFound desc = could not find container \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": container with ID starting with c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c not found: ID does not exist" Jun 10 19:04:35.584023 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.583993 2562 scope.go:117] "RemoveContainer" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.584234 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584212 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} err="failed to get container status \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": rpc error: code = NotFound desc = could not find container \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": container with ID starting with ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4 not found: ID does not exist" Jun 10 19:04:35.584234 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584233 2562 scope.go:117] "RemoveContainer" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.584472 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584454 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} err="failed to get container status \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": rpc error: code = NotFound desc = could not find container \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": container with ID starting with a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938 not found: ID does not exist" Jun 10 19:04:35.584520 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584482 2562 scope.go:117] "RemoveContainer" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.584705 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584688 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b"} err="failed to get container status \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": rpc error: code = NotFound desc = could not find container \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": container with ID starting with fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b not found: ID does not exist" Jun 10 19:04:35.584705 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584707 2562 scope.go:117] "RemoveContainer" containerID="b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e" Jun 10 19:04:35.584968 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584951 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e"} err="failed to get container status \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": rpc error: code = NotFound desc = could not find container \"b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e\": container with ID starting with b88c5a3d3bd7ac79a1e611a78055743bce54ffc7711c4e13b3cdfb95d9ad114e not found: ID does not exist" Jun 10 19:04:35.585018 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.584968 2562 scope.go:117] "RemoveContainer" containerID="26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2" Jun 10 19:04:35.585208 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585191 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2"} err="failed to get container status \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": rpc error: code = NotFound desc = could not find container \"26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2\": container with ID starting with 26f82070b6895e61a86c77114d6d29657af65d6fdc743c99a5290b388d5824c2 not found: ID does not exist" Jun 10 19:04:35.585258 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585208 2562 scope.go:117] "RemoveContainer" containerID="527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17" Jun 10 19:04:35.585436 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585420 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17"} err="failed to get container status \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": rpc error: code = NotFound desc = could not find container \"527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17\": container with ID starting with 527a77de6ec2755558ac6761f8f6d08ff1685c26fcf74361dd4715aefb1c5c17 not found: ID does not exist" Jun 10 19:04:35.585479 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585437 2562 scope.go:117] "RemoveContainer" containerID="c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c" Jun 10 19:04:35.585659 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585644 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c"} err="failed to get container status \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": rpc error: code = NotFound desc = could not find container \"c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c\": container with ID starting with c4700b6fa91dbabfac0342ce67df87175e6fec685d86055a359e3bf06609737c not found: ID does not exist" Jun 10 19:04:35.585702 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585659 2562 scope.go:117] "RemoveContainer" containerID="ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4" Jun 10 19:04:35.585918 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585901 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4"} err="failed to get container status \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": rpc error: code = NotFound desc = could not find container \"ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4\": container with ID starting with ee0647f0a12c58c2b2119b526c9fcd373e1d8a1806ed88d723fd3202b3cf5ff4 not found: ID does not exist" Jun 10 19:04:35.585977 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.585919 2562 scope.go:117] "RemoveContainer" containerID="a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938" Jun 10 19:04:35.586131 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.586110 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938"} err="failed to get container status \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": rpc error: code = NotFound desc = could not find container \"a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938\": container with ID starting with a0b80835f7f8a42c3eb26f849f8b2cefc824eae3e291aee5c0fe941ed1440938 not found: ID does not exist" Jun 10 19:04:35.586176 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.586132 2562 scope.go:117] "RemoveContainer" containerID="fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b" Jun 10 19:04:35.586332 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.586318 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b"} err="failed to get container status \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": rpc error: code = NotFound desc = could not find container \"fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b\": container with ID starting with fbc8c9edec47a5e3f79f8078e4e46ff6af75a460a926f2f869cf909a75dc501b not found: ID does not exist" Jun 10 19:04:35.622228 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622201 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:04:35.622448 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622435 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-web" Jun 10 19:04:35.622496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622450 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-web" Jun 10 19:04:35.622496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622463 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy" Jun 10 19:04:35.622496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622469 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy" Jun 10 19:04:35.622496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622477 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-thanos" Jun 10 19:04:35.622496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622483 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-thanos" Jun 10 19:04:35.622496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622489 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="prometheus" Jun 10 19:04:35.622496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622495 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="prometheus" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622505 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7aecfa-f6f3-417d-9cda-8c5726989807" containerName="registry" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622510 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7aecfa-f6f3-417d-9cda-8c5726989807" containerName="registry" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622517 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622522 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622527 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="init-config-reloader" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622533 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="init-config-reloader" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622538 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="config-reloader" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622544 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="config-reloader" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622550 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="thanos-sidecar" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622555 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="thanos-sidecar" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622591 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7aecfa-f6f3-417d-9cda-8c5726989807" containerName="registry" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622597 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d807241-0607-4be0-8acc-a79767937ada" containerName="console" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622602 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="prometheus" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622608 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-web" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622614 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622620 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="config-reloader" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622625 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="thanos-sidecar" Jun 10 19:04:35.622684 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.622630 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" containerName="kube-rbac-proxy-thanos" Jun 10 19:04:35.627459 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.627445 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.630215 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.630194 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 19:04:35.631497 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.631480 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 19:04:35.631710 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.631684 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 19:04:35.631710 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.631687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 19:04:35.632216 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.632200 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 19:04:35.632482 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.632464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 19:04:35.632482 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.632475 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6lmc09kf5pj6h\"" Jun 10 19:04:35.632650 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.632531 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 19:04:35.632953 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.632938 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 19:04:35.633668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.633499 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 19:04:35.633668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.633543 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 19:04:35.633668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.633499 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 19:04:35.634340 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.634233 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n6g55\"" Jun 10 19:04:35.634461 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.634370 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 19:04:35.634974 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.634957 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 19:04:35.639709 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.639693 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 19:04:35.654864 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.654809 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:04:35.701007 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.700978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701159 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701159 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-web-config\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701159 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-config\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701159 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701159 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkztz\" (UniqueName: \"kubernetes.io/projected/1942bc76-099a-49b4-972b-0805b2c18943-kube-api-access-qkztz\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1942bc76-099a-49b4-972b-0805b2c18943-config-out\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1942bc76-099a-49b4-972b-0805b2c18943-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.701706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.701585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.802572 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.802733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkztz\" (UniqueName: \"kubernetes.io/projected/1942bc76-099a-49b4-972b-0805b2c18943-kube-api-access-qkztz\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.802733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.802733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.802733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802661 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.802733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1942bc76-099a-49b4-972b-0805b2c18943-config-out\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1942bc76-099a-49b4-972b-0805b2c18943-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.802981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803034 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-web-config\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-config\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803779 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.803779 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.803729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.805517 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.804188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.805517 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.804555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.805517 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.805124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.805517 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.805152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.805856 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.805691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1942bc76-099a-49b4-972b-0805b2c18943-config-out\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.806248 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.806170 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.806360 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.806268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.806360 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.806298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.807173 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.807127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-web-config\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.807599 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.807564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1942bc76-099a-49b4-972b-0805b2c18943-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.807796 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.807774 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.808066 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.808036 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.808530 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.808511 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.808617 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.808602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1942bc76-099a-49b4-972b-0805b2c18943-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.808671 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.808655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.809013 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.808997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1942bc76-099a-49b4-972b-0805b2c18943-config\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.815359 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.815343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkztz\" (UniqueName: \"kubernetes.io/projected/1942bc76-099a-49b4-972b-0805b2c18943-kube-api-access-qkztz\") pod \"prometheus-k8s-0\" (UID: \"1942bc76-099a-49b4-972b-0805b2c18943\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:35.937654 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:35.937618 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:36.088777 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:36.088726 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 19:04:36.092121 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:04:36.092094 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1942bc76_099a_49b4_972b_0805b2c18943.slice/crio-42983360b6864fd7576e4bd705c45ee21885e913ee630dbd78146503cc185aff WatchSource:0}: Error finding container 42983360b6864fd7576e4bd705c45ee21885e913ee630dbd78146503cc185aff: Status 404 returned error can't find the container with id 42983360b6864fd7576e4bd705c45ee21885e913ee630dbd78146503cc185aff Jun 10 19:04:36.388813 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:36.388781 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4" path="/var/lib/kubelet/pods/4ef8a75a-3e44-4a69-aa46-2700fcb8f6a4/volumes" Jun 10 19:04:36.537569 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:36.537478 2562 generic.go:356] "Generic (PLEG): container finished" podID="1942bc76-099a-49b4-972b-0805b2c18943" containerID="f2cdcaecfe48d2536987804e26d45e7c88218fcfb43b4052c26f009b0a0dec3e" exitCode=0 Jun 10 19:04:36.537569 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:36.537559 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerDied","Data":"f2cdcaecfe48d2536987804e26d45e7c88218fcfb43b4052c26f009b0a0dec3e"} Jun 10 19:04:36.537803 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:36.537645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerStarted","Data":"42983360b6864fd7576e4bd705c45ee21885e913ee630dbd78146503cc185aff"} Jun 10 19:04:37.545832 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:37.545782 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerStarted","Data":"9c6a637df7bb9a06070546a108e9e130a258d14058c21d6e26161d7fc3f63ad5"} Jun 10 19:04:37.546307 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:37.545859 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerStarted","Data":"a068d1847a9d94c629ef0a281502496e8c2da4db3d3dae928c3bc074aa08093c"} Jun 10 19:04:37.546307 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:37.545886 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerStarted","Data":"22ad4082691d03574a05a5d5f9f69e59cece54dd0e0537c60f4afbcdacf334bf"} Jun 10 19:04:37.546307 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:37.545911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerStarted","Data":"7852a53fa5ecb929f43e715719cc29a7cbe5253441ffe24bd54bbbec33348f12"} Jun 10 19:04:37.546307 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:37.545936 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerStarted","Data":"1dde68733c39310cc85267abcd1c8e2e0d6b80b56d1bfa0e60f9ef9f5aa56e05"} Jun 10 19:04:37.546307 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:37.545959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1942bc76-099a-49b4-972b-0805b2c18943","Type":"ContainerStarted","Data":"4e9189adec7be466eccafb09320354dae9fed5651ca5a0f761cd03d6e697e9cf"} Jun 10 19:04:37.576817 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:37.576740 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5535825279999997 podStartE2EDuration="2.576720054s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.137526ms" isStatefulPod=false podCreationTimestamp="2026-06-10 19:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:04:37.575614131 +0000 UTC m=+335.643062515" watchObservedRunningTime="2026-06-10 19:04:37.576720054 +0000 UTC m=+335.644168418" Jun 10 19:04:40.938471 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:40.938379 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:04:49.891015 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:04:49.890935 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644d58885-7fwzk"] Jun 10 19:05:14.911082 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:14.911019 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-644d58885-7fwzk" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" containerID="cri-o://c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893" gracePeriod=15 Jun 10 19:05:15.039383 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.039347 2562 patch_prober.go:28] interesting pod/console-644d58885-7fwzk container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" start-of-body= Jun 10 19:05:15.039533 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.039420 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-644d58885-7fwzk" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" probeResult="failure" output="Get \"https://10.133.0.14:8443/health\": dial tcp 10.133.0.14:8443: connect: connection refused" Jun 10 19:05:15.169480 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.169405 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:05:15.223687 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.223653 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-serving-cert\") pod \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " Jun 10 19:05:15.223899 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.223710 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-service-ca\") pod \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " Jun 10 19:05:15.223899 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.223747 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-oauth-config\") pod \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " Jun 10 19:05:15.223899 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.223775 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-config\") pod \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " Jun 10 19:05:15.223899 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.223803 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-trusted-ca-bundle\") pod \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " Jun 10 19:05:15.223899 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.223826 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-oauth-serving-cert\") pod \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " Jun 10 19:05:15.223899 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.223842 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfd6z\" (UniqueName: \"kubernetes.io/projected/e3a0b55d-b141-4c33-8f5a-dea077682a4d-kube-api-access-sfd6z\") pod \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\" (UID: \"e3a0b55d-b141-4c33-8f5a-dea077682a4d\") " Jun 10 19:05:15.224256 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.224227 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-config" (OuterVolumeSpecName: "console-config") pod "e3a0b55d-b141-4c33-8f5a-dea077682a4d" (UID: "e3a0b55d-b141-4c33-8f5a-dea077682a4d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:05:15.224352 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.224331 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3a0b55d-b141-4c33-8f5a-dea077682a4d" (UID: "e3a0b55d-b141-4c33-8f5a-dea077682a4d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:05:15.224465 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.224323 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3a0b55d-b141-4c33-8f5a-dea077682a4d" (UID: "e3a0b55d-b141-4c33-8f5a-dea077682a4d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:05:15.224465 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.224342 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3a0b55d-b141-4c33-8f5a-dea077682a4d" (UID: "e3a0b55d-b141-4c33-8f5a-dea077682a4d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 19:05:15.226222 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.226195 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3a0b55d-b141-4c33-8f5a-dea077682a4d-kube-api-access-sfd6z" (OuterVolumeSpecName: "kube-api-access-sfd6z") pod "e3a0b55d-b141-4c33-8f5a-dea077682a4d" (UID: "e3a0b55d-b141-4c33-8f5a-dea077682a4d"). InnerVolumeSpecName "kube-api-access-sfd6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:05:15.226456 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.226435 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3a0b55d-b141-4c33-8f5a-dea077682a4d" (UID: "e3a0b55d-b141-4c33-8f5a-dea077682a4d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:05:15.226520 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.226482 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3a0b55d-b141-4c33-8f5a-dea077682a4d" (UID: "e3a0b55d-b141-4c33-8f5a-dea077682a4d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:05:15.324424 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.324385 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-service-ca\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:05:15.324424 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.324417 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-oauth-config\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:05:15.324424 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.324428 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-config\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:05:15.324424 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.324436 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-trusted-ca-bundle\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:05:15.324691 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.324445 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3a0b55d-b141-4c33-8f5a-dea077682a4d-oauth-serving-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:05:15.324691 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.324454 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfd6z\" (UniqueName: \"kubernetes.io/projected/e3a0b55d-b141-4c33-8f5a-dea077682a4d-kube-api-access-sfd6z\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:05:15.324691 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.324462 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3a0b55d-b141-4c33-8f5a-dea077682a4d-console-serving-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:05:15.680121 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.680086 2562 generic.go:356] "Generic (PLEG): container finished" podID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerID="c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893" exitCode=0 Jun 10 19:05:15.680300 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.680138 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644d58885-7fwzk" Jun 10 19:05:15.680300 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.680174 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d58885-7fwzk" event={"ID":"e3a0b55d-b141-4c33-8f5a-dea077682a4d","Type":"ContainerDied","Data":"c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893"} Jun 10 19:05:15.680300 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.680225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644d58885-7fwzk" event={"ID":"e3a0b55d-b141-4c33-8f5a-dea077682a4d","Type":"ContainerDied","Data":"09f79bdf1a33db6df9d1abb243541a956753a3fc37c71fbfd6e6d38062e7b1b3"} Jun 10 19:05:15.680300 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.680245 2562 scope.go:117] "RemoveContainer" containerID="c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893" Jun 10 19:05:15.688716 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.688694 2562 scope.go:117] "RemoveContainer" containerID="c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893" Jun 10 19:05:15.689010 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:05:15.688987 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893\": container with ID starting with c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893 not found: ID does not exist" containerID="c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893" Jun 10 19:05:15.689113 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.689017 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893"} err="failed to get container status \"c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893\": rpc error: code = NotFound desc = could not find container \"c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893\": container with ID starting with c633374df2275eb603e17aa337839376302f1e816ce63ac90e20a9b0c1d99893 not found: ID does not exist" Jun 10 19:05:15.704876 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.704843 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644d58885-7fwzk"] Jun 10 19:05:15.709063 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:15.709037 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-644d58885-7fwzk"] Jun 10 19:05:16.389054 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:16.389023 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" path="/var/lib/kubelet/pods/e3a0b55d-b141-4c33-8f5a-dea077682a4d/volumes" Jun 10 19:05:35.938447 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:35.938410 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:05:35.954110 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:35.954079 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:05:36.773099 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:05:36.773076 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 19:08:37.925784 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.925735 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9"] Jun 10 19:08:37.926215 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.926029 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" Jun 10 19:08:37.926215 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.926041 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" Jun 10 19:08:37.926215 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.926082 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3a0b55d-b141-4c33-8f5a-dea077682a4d" containerName="console" Jun 10 19:08:37.928780 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.928746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:37.931504 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.931483 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 19:08:37.932535 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.932515 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 19:08:37.932627 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.932558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5pgh5\"" Jun 10 19:08:37.938819 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.938799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9"] Jun 10 19:08:37.995154 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.995103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f429cfa-205a-40ba-9e31-f090165b2249-tmp\") pod \"openshift-lws-operator-fd8ccff4c-86kc9\" (UID: \"5f429cfa-205a-40ba-9e31-f090165b2249\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:37.995154 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:37.995155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfz2z\" (UniqueName: \"kubernetes.io/projected/5f429cfa-205a-40ba-9e31-f090165b2249-kube-api-access-dfz2z\") pod \"openshift-lws-operator-fd8ccff4c-86kc9\" (UID: \"5f429cfa-205a-40ba-9e31-f090165b2249\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:38.096204 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.096166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f429cfa-205a-40ba-9e31-f090165b2249-tmp\") pod \"openshift-lws-operator-fd8ccff4c-86kc9\" (UID: \"5f429cfa-205a-40ba-9e31-f090165b2249\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:38.096204 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.096206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfz2z\" (UniqueName: \"kubernetes.io/projected/5f429cfa-205a-40ba-9e31-f090165b2249-kube-api-access-dfz2z\") pod \"openshift-lws-operator-fd8ccff4c-86kc9\" (UID: \"5f429cfa-205a-40ba-9e31-f090165b2249\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:38.096591 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.096566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f429cfa-205a-40ba-9e31-f090165b2249-tmp\") pod \"openshift-lws-operator-fd8ccff4c-86kc9\" (UID: \"5f429cfa-205a-40ba-9e31-f090165b2249\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:38.105237 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.105211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfz2z\" (UniqueName: \"kubernetes.io/projected/5f429cfa-205a-40ba-9e31-f090165b2249-kube-api-access-dfz2z\") pod \"openshift-lws-operator-fd8ccff4c-86kc9\" (UID: \"5f429cfa-205a-40ba-9e31-f090165b2249\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:38.238060 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.237973 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" Jun 10 19:08:38.361729 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.361698 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9"] Jun 10 19:08:38.364859 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:08:38.364830 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f429cfa_205a_40ba_9e31_f090165b2249.slice/crio-c0b2dbd3ec7f5b6a1dd7874fcbf355fa6d880a7598eb6eda22a70b2ed1c71426 WatchSource:0}: Error finding container c0b2dbd3ec7f5b6a1dd7874fcbf355fa6d880a7598eb6eda22a70b2ed1c71426: Status 404 returned error can't find the container with id c0b2dbd3ec7f5b6a1dd7874fcbf355fa6d880a7598eb6eda22a70b2ed1c71426 Jun 10 19:08:38.366728 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.366710 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:08:38.397724 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:38.397694 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" event={"ID":"5f429cfa-205a-40ba-9e31-f090165b2249","Type":"ContainerStarted","Data":"c0b2dbd3ec7f5b6a1dd7874fcbf355fa6d880a7598eb6eda22a70b2ed1c71426"} Jun 10 19:08:41.411836 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:41.411802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" event={"ID":"5f429cfa-205a-40ba-9e31-f090165b2249","Type":"ContainerStarted","Data":"91c55556da1756fe7277e9aeb3f56502bfc98cf188ff215cee204f63a38e4cfe"} Jun 10 19:08:41.429396 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:41.429350 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-86kc9" podStartSLOduration=1.7606861980000001 podStartE2EDuration="4.429337137s" totalImagesPullingTime="2.668650939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:08:41.428266258 +0000 UTC m=+579.495714623" watchObservedRunningTime="2026-06-10 19:08:41.429337137 +0000 UTC m=+579.496785497" Jun 10 19:08:57.836315 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.836279 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc"] Jun 10 19:08:57.839680 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.839662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:57.844747 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.844722 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 19:08:57.844908 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.844817 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 19:08:57.845532 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.845516 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hkg4t\"" Jun 10 19:08:57.845887 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.845870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 19:08:57.850650 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.850631 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 19:08:57.867972 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.867943 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc"] Jun 10 19:08:57.943169 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.943133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50dae548-1ce0-4865-92a6-7051a0cac042-tmp\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:57.943169 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.943173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50dae548-1ce0-4865-92a6-7051a0cac042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:57.943377 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.943193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50dae548-1ce0-4865-92a6-7051a0cac042-manifests\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:57.943377 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.943237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z86v\" (UniqueName: \"kubernetes.io/projected/50dae548-1ce0-4865-92a6-7051a0cac042-kube-api-access-2z86v\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:57.943377 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:57.943294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50dae548-1ce0-4865-92a6-7051a0cac042-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.043947 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.043910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50dae548-1ce0-4865-92a6-7051a0cac042-tmp\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.044150 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.043974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50dae548-1ce0-4865-92a6-7051a0cac042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.044150 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.043998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50dae548-1ce0-4865-92a6-7051a0cac042-manifests\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.044150 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.044015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z86v\" (UniqueName: \"kubernetes.io/projected/50dae548-1ce0-4865-92a6-7051a0cac042-kube-api-access-2z86v\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.044150 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.044074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50dae548-1ce0-4865-92a6-7051a0cac042-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.044473 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.044428 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/50dae548-1ce0-4865-92a6-7051a0cac042-manifests\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.046471 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.046449 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50dae548-1ce0-4865-92a6-7051a0cac042-tmp\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.046572 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.046551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/50dae548-1ce0-4865-92a6-7051a0cac042-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.046700 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.046678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50dae548-1ce0-4865-92a6-7051a0cac042-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.059343 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.059312 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z86v\" (UniqueName: \"kubernetes.io/projected/50dae548-1ce0-4865-92a6-7051a0cac042-kube-api-access-2z86v\") pod \"opendatahub-operator-controller-manager-5d769b9458-rjtgc\" (UID: \"50dae548-1ce0-4865-92a6-7051a0cac042\") " pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.150410 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.150318 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:08:58.323453 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.323417 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc"] Jun 10 19:08:58.327604 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:08:58.327576 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50dae548_1ce0_4865_92a6_7051a0cac042.slice/crio-6d67e23d2b13702ab29729f2b0c9ea286068d9d974279d8e712a23c836ec6c1b WatchSource:0}: Error finding container 6d67e23d2b13702ab29729f2b0c9ea286068d9d974279d8e712a23c836ec6c1b: Status 404 returned error can't find the container with id 6d67e23d2b13702ab29729f2b0c9ea286068d9d974279d8e712a23c836ec6c1b Jun 10 19:08:58.477351 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:08:58.477228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" event={"ID":"50dae548-1ce0-4865-92a6-7051a0cac042","Type":"ContainerStarted","Data":"6d67e23d2b13702ab29729f2b0c9ea286068d9d974279d8e712a23c836ec6c1b"} Jun 10 19:09:01.490646 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:01.490613 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" event={"ID":"50dae548-1ce0-4865-92a6-7051a0cac042","Type":"ContainerStarted","Data":"cc4d2c35deb954ddf5f07636bf9237094d4e937021bab3bfae4069073d5ccd75"} Jun 10 19:09:02.495608 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:02.495572 2562 generic.go:356] "Generic (PLEG): container finished" podID="50dae548-1ce0-4865-92a6-7051a0cac042" containerID="cc4d2c35deb954ddf5f07636bf9237094d4e937021bab3bfae4069073d5ccd75" exitCode=0 Jun 10 19:09:02.496037 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:02.495665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" event={"ID":"50dae548-1ce0-4865-92a6-7051a0cac042","Type":"ContainerDied","Data":"cc4d2c35deb954ddf5f07636bf9237094d4e937021bab3bfae4069073d5ccd75"} Jun 10 19:09:03.500764 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:03.500724 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" event={"ID":"50dae548-1ce0-4865-92a6-7051a0cac042","Type":"ContainerStarted","Data":"766c8ab6fba466e1dcfbd6c7a1753905eba8c624ebd212401e59ccefb90adf0e"} Jun 10 19:09:03.503201 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:03.500834 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:09:03.524808 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:03.524740 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" podStartSLOduration=2.167295045 podStartE2EDuration="6.524723035s" totalImagesPullingTime="3.437348224s" totalInitContainerRuntime="920.079766ms" isStatefulPod=false podCreationTimestamp="2026-06-10 19:08:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:03.522676279 +0000 UTC m=+601.590124641" watchObservedRunningTime="2026-06-10 19:09:03.524723035 +0000 UTC m=+601.592171457" Jun 10 19:09:14.507186 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:14.507104 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d769b9458-rjtgc" Jun 10 19:09:16.912230 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:16.912198 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8"] Jun 10 19:09:16.974296 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:16.974267 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8"] Jun 10 19:09:16.974461 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:16.974363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:16.979185 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:16.979140 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 19:09:16.979185 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:16.979150 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tvmnb\"" Jun 10 19:09:16.979373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:16.979163 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 19:09:16.979373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:16.979337 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 19:09:17.109019 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.108978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3980eccc-ca36-4b0e-aaef-c6d548475cfd-manager-config\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.109207 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.109035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clfbf\" (UniqueName: \"kubernetes.io/projected/3980eccc-ca36-4b0e-aaef-c6d548475cfd-kube-api-access-clfbf\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.109207 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.109062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3980eccc-ca36-4b0e-aaef-c6d548475cfd-cert\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.109207 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.109122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3980eccc-ca36-4b0e-aaef-c6d548475cfd-metrics-cert\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.210284 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.210245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3980eccc-ca36-4b0e-aaef-c6d548475cfd-metrics-cert\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.210485 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.210308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3980eccc-ca36-4b0e-aaef-c6d548475cfd-manager-config\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.210485 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.210356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clfbf\" (UniqueName: \"kubernetes.io/projected/3980eccc-ca36-4b0e-aaef-c6d548475cfd-kube-api-access-clfbf\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.210485 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.210387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3980eccc-ca36-4b0e-aaef-c6d548475cfd-cert\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.211142 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.211033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3980eccc-ca36-4b0e-aaef-c6d548475cfd-manager-config\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.213070 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.213044 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3980eccc-ca36-4b0e-aaef-c6d548475cfd-cert\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.213173 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.213051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3980eccc-ca36-4b0e-aaef-c6d548475cfd-metrics-cert\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.239632 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.239605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clfbf\" (UniqueName: \"kubernetes.io/projected/3980eccc-ca36-4b0e-aaef-c6d548475cfd-kube-api-access-clfbf\") pod \"lws-controller-manager-7fb85c7977-n4ww8\" (UID: \"3980eccc-ca36-4b0e-aaef-c6d548475cfd\") " pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.283782 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.283738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:17.439123 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.439082 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8"] Jun 10 19:09:17.446058 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:09:17.446003 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3980eccc_ca36_4b0e_aaef_c6d548475cfd.slice/crio-035fb4920a73401af90d33d506b24a0267fbe99b8b01e73c958d15dc272e3eca WatchSource:0}: Error finding container 035fb4920a73401af90d33d506b24a0267fbe99b8b01e73c958d15dc272e3eca: Status 404 returned error can't find the container with id 035fb4920a73401af90d33d506b24a0267fbe99b8b01e73c958d15dc272e3eca Jun 10 19:09:17.557651 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:17.557615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" event={"ID":"3980eccc-ca36-4b0e-aaef-c6d548475cfd","Type":"ContainerStarted","Data":"035fb4920a73401af90d33d506b24a0267fbe99b8b01e73c958d15dc272e3eca"} Jun 10 19:09:20.571970 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:20.571932 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" event={"ID":"3980eccc-ca36-4b0e-aaef-c6d548475cfd","Type":"ContainerStarted","Data":"dd6a92018c283fd996a8371904ab8e81462bf80d80fbb53496a78c019824175a"} Jun 10 19:09:20.572437 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:20.572016 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:20.591576 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:20.591517 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" podStartSLOduration=2.103424898 podStartE2EDuration="4.591500693s" totalImagesPullingTime="2.488075795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:20.590881949 +0000 UTC m=+618.658330310" watchObservedRunningTime="2026-06-10 19:09:20.591500693 +0000 UTC m=+618.658949054" Jun 10 19:09:31.578774 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:31.578728 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fb85c7977-n4ww8" Jun 10 19:09:47.588338 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.588304 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-66f6b98bc9-w7lbt"] Jun 10 19:09:47.591733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.591716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:47.595803 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.595781 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xgxb8\"" Jun 10 19:09:47.596179 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.596163 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 19:09:47.606243 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.606219 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66f6b98bc9-w7lbt"] Jun 10 19:09:47.680104 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.680075 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/54a93f46-f6f3-45a9-89d4-6362ae2ff671-redirect-config\") pod \"dashboard-redirect-66f6b98bc9-w7lbt\" (UID: \"54a93f46-f6f3-45a9-89d4-6362ae2ff671\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:47.680270 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.680132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2p82\" (UniqueName: \"kubernetes.io/projected/54a93f46-f6f3-45a9-89d4-6362ae2ff671-kube-api-access-c2p82\") pod \"dashboard-redirect-66f6b98bc9-w7lbt\" (UID: \"54a93f46-f6f3-45a9-89d4-6362ae2ff671\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:47.780902 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.780867 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/54a93f46-f6f3-45a9-89d4-6362ae2ff671-redirect-config\") pod \"dashboard-redirect-66f6b98bc9-w7lbt\" (UID: \"54a93f46-f6f3-45a9-89d4-6362ae2ff671\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:47.781049 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.780918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2p82\" (UniqueName: \"kubernetes.io/projected/54a93f46-f6f3-45a9-89d4-6362ae2ff671-kube-api-access-c2p82\") pod \"dashboard-redirect-66f6b98bc9-w7lbt\" (UID: \"54a93f46-f6f3-45a9-89d4-6362ae2ff671\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:47.781606 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.781587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/54a93f46-f6f3-45a9-89d4-6362ae2ff671-redirect-config\") pod \"dashboard-redirect-66f6b98bc9-w7lbt\" (UID: \"54a93f46-f6f3-45a9-89d4-6362ae2ff671\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:47.790478 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.790443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2p82\" (UniqueName: \"kubernetes.io/projected/54a93f46-f6f3-45a9-89d4-6362ae2ff671-kube-api-access-c2p82\") pod \"dashboard-redirect-66f6b98bc9-w7lbt\" (UID: \"54a93f46-f6f3-45a9-89d4-6362ae2ff671\") " pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:47.901245 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:47.901183 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" Jun 10 19:09:48.027372 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:48.027345 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-66f6b98bc9-w7lbt"] Jun 10 19:09:48.029651 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:09:48.029625 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a93f46_f6f3_45a9_89d4_6362ae2ff671.slice/crio-0c1e135af65f6635605e4e7fa8592c814cf5a093af5cbb22f67028a7ec1dacfc WatchSource:0}: Error finding container 0c1e135af65f6635605e4e7fa8592c814cf5a093af5cbb22f67028a7ec1dacfc: Status 404 returned error can't find the container with id 0c1e135af65f6635605e4e7fa8592c814cf5a093af5cbb22f67028a7ec1dacfc Jun 10 19:09:48.675937 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:48.675903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" event={"ID":"54a93f46-f6f3-45a9-89d4-6362ae2ff671","Type":"ContainerStarted","Data":"0c1e135af65f6635605e4e7fa8592c814cf5a093af5cbb22f67028a7ec1dacfc"} Jun 10 19:09:53.698941 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:53.698896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" event={"ID":"54a93f46-f6f3-45a9-89d4-6362ae2ff671","Type":"ContainerStarted","Data":"264d219a037ee6b501d64e7a91140e4de7ad290bf270039c93c9a088b813ce28"} Jun 10 19:09:53.724151 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:09:53.724091 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-66f6b98bc9-w7lbt" podStartSLOduration=1.797805926 podStartE2EDuration="6.724074783s" totalImagesPullingTime="4.926268857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:09:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:09:53.721643559 +0000 UTC m=+651.789091920" watchObservedRunningTime="2026-06-10 19:09:53.724074783 +0000 UTC m=+651.791523143" Jun 10 19:10:06.910861 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:06.910823 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6"] Jun 10 19:10:06.916435 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:06.916414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:06.918988 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:06.918963 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6h7zp\"" Jun 10 19:10:06.919098 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:06.919068 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 19:10:06.919185 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:06.919168 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 19:10:06.919245 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:06.919220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 19:10:06.928199 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:06.928175 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6"] Jun 10 19:10:07.050007 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.049971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050210 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050210 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050210 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cl6c\" (UniqueName: \"kubernetes.io/projected/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-kube-api-access-4cl6c\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050210 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050434 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050434 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050434 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.050434 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.050356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151387 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151397 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cl6c\" (UniqueName: \"kubernetes.io/projected/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-kube-api-access-4cl6c\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151968 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151968 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.151968 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.151904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.152126 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.152025 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.152126 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.152093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.152239 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.152221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.154297 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.154273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.154434 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.154417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.163440 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.163341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.163605 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.163573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cl6c\" (UniqueName: \"kubernetes.io/projected/af9499c3-c6f0-4c9f-bba2-38be8f677ef5-kube-api-access-4cl6c\") pod \"data-science-gateway-data-science-gateway-class-74759f9795h4bg6\" (UID: \"af9499c3-c6f0-4c9f-bba2-38be8f677ef5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.227477 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.227442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:07.364788 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.364740 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6"] Jun 10 19:10:07.367059 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:10:07.367028 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9499c3_c6f0_4c9f_bba2_38be8f677ef5.slice/crio-2881ff1413967d8b57e2cacba93bb1e083b2aa4d653a2459e644f2ba9ebf0822 WatchSource:0}: Error finding container 2881ff1413967d8b57e2cacba93bb1e083b2aa4d653a2459e644f2ba9ebf0822: Status 404 returned error can't find the container with id 2881ff1413967d8b57e2cacba93bb1e083b2aa4d653a2459e644f2ba9ebf0822 Jun 10 19:10:07.754041 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:07.754004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" event={"ID":"af9499c3-c6f0-4c9f-bba2-38be8f677ef5","Type":"ContainerStarted","Data":"2881ff1413967d8b57e2cacba93bb1e083b2aa4d653a2459e644f2ba9ebf0822"} Jun 10 19:10:10.712167 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:10.712123 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:10:10.712458 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:10.712197 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:10:10.712458 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:10.712223 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:10:11.774648 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:11.774611 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" event={"ID":"af9499c3-c6f0-4c9f-bba2-38be8f677ef5","Type":"ContainerStarted","Data":"b753f1a64d3442b484f7838ace03a47290b2cc3721caed532fc1a6a59bdff5fd"} Jun 10 19:10:11.797811 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:11.797731 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" podStartSLOduration=2.455013099 podStartE2EDuration="5.797714932s" totalImagesPullingTime="3.342701833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:10:11.795549148 +0000 UTC m=+669.862997597" watchObservedRunningTime="2026-06-10 19:10:11.797714932 +0000 UTC m=+669.865163352" Jun 10 19:10:12.228640 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:12.228601 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:12.233659 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:12.233629 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:12.779416 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:12.779385 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:12.780482 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:12.780458 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795h4bg6" Jun 10 19:10:18.391513 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.391481 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgvzj"] Jun 10 19:10:18.393565 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.393547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:18.399055 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.399034 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 19:10:18.399184 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.399126 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 19:10:18.400406 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.400203 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-f67qn\"" Jun 10 19:10:18.411161 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.411132 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgvzj"] Jun 10 19:10:18.453844 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.453809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqwkl\" (UniqueName: \"kubernetes.io/projected/595cf1ea-6f4f-4227-b79c-293b4d5cffcd-kube-api-access-jqwkl\") pod \"kuadrant-operator-catalog-vgvzj\" (UID: \"595cf1ea-6f4f-4227-b79c-293b4d5cffcd\") " pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:18.555330 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.555292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqwkl\" (UniqueName: \"kubernetes.io/projected/595cf1ea-6f4f-4227-b79c-293b4d5cffcd-kube-api-access-jqwkl\") pod \"kuadrant-operator-catalog-vgvzj\" (UID: \"595cf1ea-6f4f-4227-b79c-293b4d5cffcd\") " pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:18.565556 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.565525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqwkl\" (UniqueName: \"kubernetes.io/projected/595cf1ea-6f4f-4227-b79c-293b4d5cffcd-kube-api-access-jqwkl\") pod \"kuadrant-operator-catalog-vgvzj\" (UID: \"595cf1ea-6f4f-4227-b79c-293b4d5cffcd\") " pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:18.703182 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.703091 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:18.845321 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:18.845290 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vgvzj"] Jun 10 19:10:18.848468 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:10:18.848426 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595cf1ea_6f4f_4227_b79c_293b4d5cffcd.slice/crio-8ecd3e4e253564a07140d0966d06bb00a8468b103e4f3614942b6ff600c44804 WatchSource:0}: Error finding container 8ecd3e4e253564a07140d0966d06bb00a8468b103e4f3614942b6ff600c44804: Status 404 returned error can't find the container with id 8ecd3e4e253564a07140d0966d06bb00a8468b103e4f3614942b6ff600c44804 Jun 10 19:10:19.810188 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:19.810152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" event={"ID":"595cf1ea-6f4f-4227-b79c-293b4d5cffcd","Type":"ContainerStarted","Data":"8ecd3e4e253564a07140d0966d06bb00a8468b103e4f3614942b6ff600c44804"} Jun 10 19:10:21.822488 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:21.822448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" event={"ID":"595cf1ea-6f4f-4227-b79c-293b4d5cffcd","Type":"ContainerStarted","Data":"9c219754af953d694c9d1cf425ca89a0f8aa6e220813634ead88f7bec7ad60b9"} Jun 10 19:10:21.841349 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:21.841304 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" podStartSLOduration=1.4147571349999999 podStartE2EDuration="3.841289155s" totalImagesPullingTime="2.42653202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:10:21.840419195 +0000 UTC m=+679.907867557" watchObservedRunningTime="2026-06-10 19:10:21.841289155 +0000 UTC m=+679.908737517" Jun 10 19:10:28.704155 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:28.704117 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:28.704575 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:28.704176 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:28.727067 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:28.727030 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:28.871253 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:28.871219 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vgvzj" Jun 10 19:10:49.652528 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.652452 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-grrws"] Jun 10 19:10:49.655653 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.655632 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" Jun 10 19:10:49.658452 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.658422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-g224q\"" Jun 10 19:10:49.677198 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.677165 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-grrws"] Jun 10 19:10:49.834401 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.834357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znj7t\" (UniqueName: \"kubernetes.io/projected/24ccb837-98df-4e98-8979-8b7d336bb6fb-kube-api-access-znj7t\") pod \"authorino-operator-75cc8d5cb7-grrws\" (UID: \"24ccb837-98df-4e98-8979-8b7d336bb6fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" Jun 10 19:10:49.935491 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.935408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znj7t\" (UniqueName: \"kubernetes.io/projected/24ccb837-98df-4e98-8979-8b7d336bb6fb-kube-api-access-znj7t\") pod \"authorino-operator-75cc8d5cb7-grrws\" (UID: \"24ccb837-98df-4e98-8979-8b7d336bb6fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" Jun 10 19:10:49.946557 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.946529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znj7t\" (UniqueName: \"kubernetes.io/projected/24ccb837-98df-4e98-8979-8b7d336bb6fb-kube-api-access-znj7t\") pod \"authorino-operator-75cc8d5cb7-grrws\" (UID: \"24ccb837-98df-4e98-8979-8b7d336bb6fb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" Jun 10 19:10:49.966478 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:49.966449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" Jun 10 19:10:50.103610 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:50.103578 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-grrws"] Jun 10 19:10:50.106234 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:10:50.106209 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ccb837_98df_4e98_8979_8b7d336bb6fb.slice/crio-90e5768a034eab0a3cb3efccff90b4a9e3a4f0287b2947a61ee93277fffacff0 WatchSource:0}: Error finding container 90e5768a034eab0a3cb3efccff90b4a9e3a4f0287b2947a61ee93277fffacff0: Status 404 returned error can't find the container with id 90e5768a034eab0a3cb3efccff90b4a9e3a4f0287b2947a61ee93277fffacff0 Jun 10 19:10:50.940523 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:50.940481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" event={"ID":"24ccb837-98df-4e98-8979-8b7d336bb6fb","Type":"ContainerStarted","Data":"90e5768a034eab0a3cb3efccff90b4a9e3a4f0287b2947a61ee93277fffacff0"} Jun 10 19:10:52.951452 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:52.951411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" event={"ID":"24ccb837-98df-4e98-8979-8b7d336bb6fb","Type":"ContainerStarted","Data":"d6fcb653ab9bc13c2ace7c1012c4471c38f51a08efcbd0dc510600f6de1d1b8c"} Jun 10 19:10:52.951857 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:52.951494 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" Jun 10 19:10:52.971201 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:52.971148 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" podStartSLOduration=1.589519076 podStartE2EDuration="3.971132608s" totalImagesPullingTime="2.381613532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:10:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:10:52.970332473 +0000 UTC m=+711.037780834" watchObservedRunningTime="2026-06-10 19:10:52.971132608 +0000 UTC m=+711.038581040" Jun 10 19:10:56.106387 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.106334 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7"] Jun 10 19:10:56.114008 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.113981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" Jun 10 19:10:56.117947 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.117923 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 19:10:56.118117 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.117986 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xb2qq\"" Jun 10 19:10:56.146791 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.146743 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7"] Jun 10 19:10:56.290680 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.290641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kswtt\" (UniqueName: \"kubernetes.io/projected/ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d-kube-api-access-kswtt\") pod \"dns-operator-controller-manager-864dd78c4c-m8lm7\" (UID: \"ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" Jun 10 19:10:56.392134 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.392049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kswtt\" (UniqueName: \"kubernetes.io/projected/ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d-kube-api-access-kswtt\") pod \"dns-operator-controller-manager-864dd78c4c-m8lm7\" (UID: \"ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" Jun 10 19:10:56.402791 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.402737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kswtt\" (UniqueName: \"kubernetes.io/projected/ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d-kube-api-access-kswtt\") pod \"dns-operator-controller-manager-864dd78c4c-m8lm7\" (UID: \"ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" Jun 10 19:10:56.424572 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.424529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" Jun 10 19:10:56.584944 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.584860 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7"] Jun 10 19:10:56.587228 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:10:56.587201 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef5ce2aa_f4a6_4b21_a0ab_da38fa69e74d.slice/crio-1b6f43716935c167789a654e5e8ac81343c5371ec3cf7481f233545647a3abb9 WatchSource:0}: Error finding container 1b6f43716935c167789a654e5e8ac81343c5371ec3cf7481f233545647a3abb9: Status 404 returned error can't find the container with id 1b6f43716935c167789a654e5e8ac81343c5371ec3cf7481f233545647a3abb9 Jun 10 19:10:56.968296 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:56.968260 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" event={"ID":"ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d","Type":"ContainerStarted","Data":"1b6f43716935c167789a654e5e8ac81343c5371ec3cf7481f233545647a3abb9"} Jun 10 19:10:58.534737 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.534696 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs"] Jun 10 19:10:58.538044 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.538025 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:10:58.545126 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.545074 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vwgqt\"" Jun 10 19:10:58.565748 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.565713 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs"] Jun 10 19:10:58.613030 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.612995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6mb\" (UniqueName: \"kubernetes.io/projected/d11c336f-d4ed-4a5e-a649-0d071a44b13b-kube-api-access-jf6mb\") pod \"limitador-operator-controller-manager-859d7b78bd-ptmzs\" (UID: \"d11c336f-d4ed-4a5e-a649-0d071a44b13b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:10:58.713853 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.713815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6mb\" (UniqueName: \"kubernetes.io/projected/d11c336f-d4ed-4a5e-a649-0d071a44b13b-kube-api-access-jf6mb\") pod \"limitador-operator-controller-manager-859d7b78bd-ptmzs\" (UID: \"d11c336f-d4ed-4a5e-a649-0d071a44b13b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:10:58.728569 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.728542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6mb\" (UniqueName: \"kubernetes.io/projected/d11c336f-d4ed-4a5e-a649-0d071a44b13b-kube-api-access-jf6mb\") pod \"limitador-operator-controller-manager-859d7b78bd-ptmzs\" (UID: \"d11c336f-d4ed-4a5e-a649-0d071a44b13b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:10:58.850198 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.850146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:10:58.997561 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:58.997527 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs"] Jun 10 19:10:59.000682 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:10:59.000654 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11c336f_d4ed_4a5e_a649_0d071a44b13b.slice/crio-59c8c3ed1a3363489909b7ec2236c69ad870d99fd4df8c024a9995b140a39d2b WatchSource:0}: Error finding container 59c8c3ed1a3363489909b7ec2236c69ad870d99fd4df8c024a9995b140a39d2b: Status 404 returned error can't find the container with id 59c8c3ed1a3363489909b7ec2236c69ad870d99fd4df8c024a9995b140a39d2b Jun 10 19:10:59.987181 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:59.987135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" event={"ID":"d11c336f-d4ed-4a5e-a649-0d071a44b13b","Type":"ContainerStarted","Data":"59c8c3ed1a3363489909b7ec2236c69ad870d99fd4df8c024a9995b140a39d2b"} Jun 10 19:10:59.989164 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:59.989132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" event={"ID":"ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d","Type":"ContainerStarted","Data":"d7014b34f278c2543ff76018470f8174562eeac3384507b08eef9d35944e49ab"} Jun 10 19:10:59.989322 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:10:59.989252 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" Jun 10 19:11:00.014416 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:00.014357 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" podStartSLOduration=1.193064149 podStartE2EDuration="4.014341977s" totalImagesPullingTime="2.821277828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:11:00.01311195 +0000 UTC m=+718.080560306" watchObservedRunningTime="2026-06-10 19:11:00.014341977 +0000 UTC m=+718.081790339" Jun 10 19:11:01.999677 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:01.999594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" event={"ID":"d11c336f-d4ed-4a5e-a649-0d071a44b13b","Type":"ContainerStarted","Data":"5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996"} Jun 10 19:11:02.000049 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:01.999701 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:02.038185 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:02.038127 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" podStartSLOduration=1.40315017 podStartE2EDuration="4.038112464s" totalImagesPullingTime="2.634962294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:11:02.036830842 +0000 UTC m=+720.104279203" watchObservedRunningTime="2026-06-10 19:11:02.038112464 +0000 UTC m=+720.105560824" Jun 10 19:11:03.957670 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:03.957635 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-grrws" Jun 10 19:11:10.995724 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:10.995694 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-m8lm7" Jun 10 19:11:13.005923 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:13.005893 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:15.481095 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.481062 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs"] Jun 10 19:11:15.481533 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.481251 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" containerName="manager" containerID="cri-o://5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996" gracePeriod=2 Jun 10 19:11:15.496447 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.496415 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs"] Jun 10 19:11:15.513392 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.513360 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25"] Jun 10 19:11:15.513693 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.513681 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" containerName="manager" Jun 10 19:11:15.513734 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.513695 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" containerName="manager" Jun 10 19:11:15.513784 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.513745 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" containerName="manager" Jun 10 19:11:15.517824 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.517771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" Jun 10 19:11:15.523379 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:11:15.523346 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptmzs\" is forbidden: User \"system:node:ip-10-0-143-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-108.ec2.internal' and this object" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:15.536241 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.536205 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25"] Jun 10 19:11:15.558602 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.558574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqggs\" (UniqueName: \"kubernetes.io/projected/0e8bd515-889c-48d7-afd0-395607c8d337-kube-api-access-rqggs\") pod \"limitador-operator-controller-manager-859d7b78bd-9fw25\" (UID: \"0e8bd515-889c-48d7-afd0-395607c8d337\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" Jun 10 19:11:15.659466 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.659430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqggs\" (UniqueName: \"kubernetes.io/projected/0e8bd515-889c-48d7-afd0-395607c8d337-kube-api-access-rqggs\") pod \"limitador-operator-controller-manager-859d7b78bd-9fw25\" (UID: \"0e8bd515-889c-48d7-afd0-395607c8d337\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" Jun 10 19:11:15.668298 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.668266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqggs\" (UniqueName: \"kubernetes.io/projected/0e8bd515-889c-48d7-afd0-395607c8d337-kube-api-access-rqggs\") pod \"limitador-operator-controller-manager-859d7b78bd-9fw25\" (UID: \"0e8bd515-889c-48d7-afd0-395607c8d337\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" Jun 10 19:11:15.724133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.724104 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:15.726719 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:11:15.726687 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptmzs\" is forbidden: User \"system:node:ip-10-0-143-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-108.ec2.internal' and this object" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:15.760353 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.760271 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf6mb\" (UniqueName: \"kubernetes.io/projected/d11c336f-d4ed-4a5e-a649-0d071a44b13b-kube-api-access-jf6mb\") pod \"d11c336f-d4ed-4a5e-a649-0d071a44b13b\" (UID: \"d11c336f-d4ed-4a5e-a649-0d071a44b13b\") " Jun 10 19:11:15.762640 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.762611 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11c336f-d4ed-4a5e-a649-0d071a44b13b-kube-api-access-jf6mb" (OuterVolumeSpecName: "kube-api-access-jf6mb") pod "d11c336f-d4ed-4a5e-a649-0d071a44b13b" (UID: "d11c336f-d4ed-4a5e-a649-0d071a44b13b"). InnerVolumeSpecName "kube-api-access-jf6mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:11:15.861416 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.861370 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf6mb\" (UniqueName: \"kubernetes.io/projected/d11c336f-d4ed-4a5e-a649-0d071a44b13b-kube-api-access-jf6mb\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:11:15.862204 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:15.862177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" Jun 10 19:11:16.012643 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.012615 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25"] Jun 10 19:11:16.014225 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:11:16.014201 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8bd515_889c_48d7_afd0_395607c8d337.slice/crio-98e573e62341476299a5506461bf9371fd13cc8e36cf86c09d07741ea0c095f7 WatchSource:0}: Error finding container 98e573e62341476299a5506461bf9371fd13cc8e36cf86c09d07741ea0c095f7: Status 404 returned error can't find the container with id 98e573e62341476299a5506461bf9371fd13cc8e36cf86c09d07741ea0c095f7 Jun 10 19:11:16.059553 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.059507 2562 generic.go:356] "Generic (PLEG): container finished" podID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" containerID="5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996" exitCode=0 Jun 10 19:11:16.059709 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.059611 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:16.059709 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.059665 2562 scope.go:117] "RemoveContainer" containerID="5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996" Jun 10 19:11:16.061479 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.061448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" event={"ID":"0e8bd515-889c-48d7-afd0-395607c8d337","Type":"ContainerStarted","Data":"98e573e62341476299a5506461bf9371fd13cc8e36cf86c09d07741ea0c095f7"} Jun 10 19:11:16.062464 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:11:16.062430 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptmzs\" is forbidden: User \"system:node:ip-10-0-143-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-108.ec2.internal' and this object" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:16.069663 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.069643 2562 scope.go:117] "RemoveContainer" containerID="5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996" Jun 10 19:11:16.069992 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:11:16.069974 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996\": container with ID starting with 5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996 not found: ID does not exist" containerID="5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996" Jun 10 19:11:16.070061 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.070003 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996"} err="failed to get container status \"5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996\": rpc error: code = NotFound desc = could not find container \"5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996\": container with ID starting with 5ec81d0fbda74b0f59df0756cd616116b8392523bdff2c9f6f60102c4601c996 not found: ID does not exist" Jun 10 19:11:16.071591 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:11:16.071566 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-ptmzs\" is forbidden: User \"system:node:ip-10-0-143-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-108.ec2.internal' and this object" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-ptmzs" Jun 10 19:11:16.389410 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:16.389375 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d11c336f-d4ed-4a5e-a649-0d071a44b13b" path="/var/lib/kubelet/pods/d11c336f-d4ed-4a5e-a649-0d071a44b13b/volumes" Jun 10 19:11:17.066751 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:17.066707 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" event={"ID":"0e8bd515-889c-48d7-afd0-395607c8d337","Type":"ContainerStarted","Data":"91a39ef2b8d3e9abafb7f7e57860ec4ca367af7918a8148be508baffb99cff28"} Jun 10 19:11:17.067220 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:17.066806 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" Jun 10 19:11:17.130288 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:17.130233 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" podStartSLOduration=2.130216678 podStartE2EDuration="2.130216678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:11:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:11:17.130105968 +0000 UTC m=+735.197554340" watchObservedRunningTime="2026-06-10 19:11:17.130216678 +0000 UTC m=+735.197665097" Jun 10 19:11:28.074353 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:28.074318 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9fw25" Jun 10 19:11:59.640093 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.640058 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm"] Jun 10 19:11:59.642818 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.642794 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.645993 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.645965 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-9n8zm\"" Jun 10 19:11:59.657416 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.657387 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm"] Jun 10 19:11:59.736399 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736360 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736399 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dcd\" (UniqueName: \"kubernetes.io/projected/234bf02c-83cd-401c-848c-ed1461b4d5b0-kube-api-access-w7dcd\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234bf02c-83cd-401c-848c-ed1461b4d5b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.736875 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.736637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837383 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837383 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234bf02c-83cd-401c-848c-ed1461b4d5b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837484 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837522 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837626 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.837970 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.838033 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.837970 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.838033 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.838009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dcd\" (UniqueName: \"kubernetes.io/projected/234bf02c-83cd-401c-848c-ed1461b4d5b0-kube-api-access-w7dcd\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.838135 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.838046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.838188 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.838134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.838262 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.838245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/234bf02c-83cd-401c-848c-ed1461b4d5b0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.840051 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.840021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.840277 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.840258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.846446 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.846416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234bf02c-83cd-401c-848c-ed1461b4d5b0-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.846564 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.846464 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dcd\" (UniqueName: \"kubernetes.io/projected/234bf02c-83cd-401c-848c-ed1461b4d5b0-kube-api-access-w7dcd\") pod \"maas-default-gateway-openshift-default-687ff6996-csnqm\" (UID: \"234bf02c-83cd-401c-848c-ed1461b4d5b0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:11:59.953507 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:11:59.953414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:12:00.097197 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.097164 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm"] Jun 10 19:12:00.099232 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:12:00.099197 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234bf02c_83cd_401c_848c_ed1461b4d5b0.slice/crio-aa2c9b49c29cbd1f6ebf3b75094ed88c1234986d26e824c9d8005c75c2d4881c WatchSource:0}: Error finding container aa2c9b49c29cbd1f6ebf3b75094ed88c1234986d26e824c9d8005c75c2d4881c: Status 404 returned error can't find the container with id aa2c9b49c29cbd1f6ebf3b75094ed88c1234986d26e824c9d8005c75c2d4881c Jun 10 19:12:00.101556 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.101520 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:12:00.101632 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.101606 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:12:00.101668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.101651 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:12:00.263541 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.263451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" event={"ID":"234bf02c-83cd-401c-848c-ed1461b4d5b0","Type":"ContainerStarted","Data":"d61e57c40cab3ef9249b4b4a81da5f395aac8ed18f25b5121a3f2f29688c411b"} Jun 10 19:12:00.263541 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.263517 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" event={"ID":"234bf02c-83cd-401c-848c-ed1461b4d5b0","Type":"ContainerStarted","Data":"aa2c9b49c29cbd1f6ebf3b75094ed88c1234986d26e824c9d8005c75c2d4881c"} Jun 10 19:12:00.284653 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.284599 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" podStartSLOduration=1.284581365 podStartE2EDuration="1.284581365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:11:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:12:00.283855761 +0000 UTC m=+778.351304123" watchObservedRunningTime="2026-06-10 19:12:00.284581365 +0000 UTC m=+778.352029791" Jun 10 19:12:00.954373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:00.954334 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:12:01.958992 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:01.958960 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:12:02.272544 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:02.272445 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:12:02.273484 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:02.273465 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:12:05.782094 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:05.782054 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6l8z8"] Jun 10 19:12:05.786203 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:05.786173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6l8z8" Jun 10 19:12:05.789340 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:05.789321 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-tnf68\"" Jun 10 19:12:05.805506 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:05.805479 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6l8z8"] Jun 10 19:12:05.893160 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:05.893129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp8gc\" (UniqueName: \"kubernetes.io/projected/75b61622-e115-44f2-9ff9-b78bcd865100-kube-api-access-bp8gc\") pod \"authorino-75d556bd77-6l8z8\" (UID: \"75b61622-e115-44f2-9ff9-b78bcd865100\") " pod="kuadrant-system/authorino-75d556bd77-6l8z8" Jun 10 19:12:05.993852 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:05.993819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp8gc\" (UniqueName: \"kubernetes.io/projected/75b61622-e115-44f2-9ff9-b78bcd865100-kube-api-access-bp8gc\") pod \"authorino-75d556bd77-6l8z8\" (UID: \"75b61622-e115-44f2-9ff9-b78bcd865100\") " pod="kuadrant-system/authorino-75d556bd77-6l8z8" Jun 10 19:12:06.003406 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:06.003381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp8gc\" (UniqueName: \"kubernetes.io/projected/75b61622-e115-44f2-9ff9-b78bcd865100-kube-api-access-bp8gc\") pod \"authorino-75d556bd77-6l8z8\" (UID: \"75b61622-e115-44f2-9ff9-b78bcd865100\") " pod="kuadrant-system/authorino-75d556bd77-6l8z8" Jun 10 19:12:06.095365 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:06.095326 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6l8z8" Jun 10 19:12:06.225207 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:06.225127 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6l8z8"] Jun 10 19:12:06.227385 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:12:06.227350 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75b61622_e115_44f2_9ff9_b78bcd865100.slice/crio-20c730f6b9bb8cbdd4fa01b9040d87da5beb32ad30689a6ee6ac819692f1c846 WatchSource:0}: Error finding container 20c730f6b9bb8cbdd4fa01b9040d87da5beb32ad30689a6ee6ac819692f1c846: Status 404 returned error can't find the container with id 20c730f6b9bb8cbdd4fa01b9040d87da5beb32ad30689a6ee6ac819692f1c846 Jun 10 19:12:06.290487 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:06.290452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6l8z8" event={"ID":"75b61622-e115-44f2-9ff9-b78bcd865100","Type":"ContainerStarted","Data":"20c730f6b9bb8cbdd4fa01b9040d87da5beb32ad30689a6ee6ac819692f1c846"} Jun 10 19:12:10.311362 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:10.311325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6l8z8" event={"ID":"75b61622-e115-44f2-9ff9-b78bcd865100","Type":"ContainerStarted","Data":"6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a"} Jun 10 19:12:10.329966 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:12:10.329916 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6l8z8" podStartSLOduration=2.1120670009999998 podStartE2EDuration="5.329899051s" totalImagesPullingTime="3.21783205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:12:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:12:10.328889361 +0000 UTC m=+788.396337722" watchObservedRunningTime="2026-06-10 19:12:10.329899051 +0000 UTC m=+788.397347412" Jun 10 19:13:04.038000 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.037968 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:13:04.040266 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.040245 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:04.043081 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.043056 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 19:13:04.043215 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.043083 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-phxkm\"" Jun 10 19:13:04.043215 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.043158 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 19:13:04.043215 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.043169 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 19:13:04.052733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.052711 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:13:04.108094 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.108057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67hgm\" (UniqueName: \"kubernetes.io/projected/c8252c91-c79b-4f2d-9551-5d1c0a8969b5-kube-api-access-67hgm\") pod \"maas-keycloak-0\" (UID: \"c8252c91-c79b-4f2d-9551-5d1c0a8969b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:04.209142 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.209101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67hgm\" (UniqueName: \"kubernetes.io/projected/c8252c91-c79b-4f2d-9551-5d1c0a8969b5-kube-api-access-67hgm\") pod \"maas-keycloak-0\" (UID: \"c8252c91-c79b-4f2d-9551-5d1c0a8969b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:04.218530 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.218492 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67hgm\" (UniqueName: \"kubernetes.io/projected/c8252c91-c79b-4f2d-9551-5d1c0a8969b5-kube-api-access-67hgm\") pod \"maas-keycloak-0\" (UID: \"c8252c91-c79b-4f2d-9551-5d1c0a8969b5\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:04.349501 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.349456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:04.491238 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.491214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:13:04.493832 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:13:04.493804 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8252c91_c79b_4f2d_9551_5d1c0a8969b5.slice/crio-cdca872292b2578e203de9c84fc3daf6f560c18c5eab48afdbc1d30b4377c9cf WatchSource:0}: Error finding container cdca872292b2578e203de9c84fc3daf6f560c18c5eab48afdbc1d30b4377c9cf: Status 404 returned error can't find the container with id cdca872292b2578e203de9c84fc3daf6f560c18c5eab48afdbc1d30b4377c9cf Jun 10 19:13:04.543801 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:04.543736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c8252c91-c79b-4f2d-9551-5d1c0a8969b5","Type":"ContainerStarted","Data":"cdca872292b2578e203de9c84fc3daf6f560c18c5eab48afdbc1d30b4377c9cf"} Jun 10 19:13:12.584310 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:12.584263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c8252c91-c79b-4f2d-9551-5d1c0a8969b5","Type":"ContainerStarted","Data":"406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d"} Jun 10 19:13:12.614133 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:12.614062 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.901332083 podStartE2EDuration="8.614039414s" totalImagesPullingTime="7.712707331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:13:12.61071806 +0000 UTC m=+850.678166421" watchObservedRunningTime="2026-06-10 19:13:12.614039414 +0000 UTC m=+850.681487776" Jun 10 19:13:13.350131 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:13.350090 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:13.351936 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:13.351907 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:14.349957 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:14.349908 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:14.350470 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:14.350320 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:15.350545 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:15.350489 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:16.350630 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:16.350562 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:17.350370 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:17.350320 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:18.350830 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:18.350736 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:19.350279 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:19.350219 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:20.350557 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:20.350514 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:21.350662 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:21.350608 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:22.351006 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:22.350951 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:23.350272 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:23.350214 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:24.350220 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:24.350170 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jun 10 19:13:25.472899 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:25.472857 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:25.492288 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:25.492228 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:13:35.478467 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:35.478429 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 19:13:37.880927 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:37.880892 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6l8z8"] Jun 10 19:13:37.881338 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:37.881075 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6l8z8" podUID="75b61622-e115-44f2-9ff9-b78bcd865100" containerName="authorino" containerID="cri-o://6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a" gracePeriod=30 Jun 10 19:13:38.131207 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.131144 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6l8z8" Jun 10 19:13:38.250305 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.250256 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp8gc\" (UniqueName: \"kubernetes.io/projected/75b61622-e115-44f2-9ff9-b78bcd865100-kube-api-access-bp8gc\") pod \"75b61622-e115-44f2-9ff9-b78bcd865100\" (UID: \"75b61622-e115-44f2-9ff9-b78bcd865100\") " Jun 10 19:13:38.252530 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.252497 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b61622-e115-44f2-9ff9-b78bcd865100-kube-api-access-bp8gc" (OuterVolumeSpecName: "kube-api-access-bp8gc") pod "75b61622-e115-44f2-9ff9-b78bcd865100" (UID: "75b61622-e115-44f2-9ff9-b78bcd865100"). InnerVolumeSpecName "kube-api-access-bp8gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:13:38.351555 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.351517 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp8gc\" (UniqueName: \"kubernetes.io/projected/75b61622-e115-44f2-9ff9-b78bcd865100-kube-api-access-bp8gc\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:13:38.737912 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.737832 2562 generic.go:356] "Generic (PLEG): container finished" podID="75b61622-e115-44f2-9ff9-b78bcd865100" containerID="6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a" exitCode=0 Jun 10 19:13:38.737912 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.737874 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6l8z8" Jun 10 19:13:38.738103 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.737911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6l8z8" event={"ID":"75b61622-e115-44f2-9ff9-b78bcd865100","Type":"ContainerDied","Data":"6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a"} Jun 10 19:13:38.738103 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.737961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6l8z8" event={"ID":"75b61622-e115-44f2-9ff9-b78bcd865100","Type":"ContainerDied","Data":"20c730f6b9bb8cbdd4fa01b9040d87da5beb32ad30689a6ee6ac819692f1c846"} Jun 10 19:13:38.738103 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.737981 2562 scope.go:117] "RemoveContainer" containerID="6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a" Jun 10 19:13:38.746032 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.746015 2562 scope.go:117] "RemoveContainer" containerID="6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a" Jun 10 19:13:38.746287 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:13:38.746270 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a\": container with ID starting with 6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a not found: ID does not exist" containerID="6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a" Jun 10 19:13:38.746351 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.746297 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a"} err="failed to get container status \"6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a\": rpc error: code = NotFound desc = could not find container \"6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a\": container with ID starting with 6e531ef591ae2eae8b8a2bb8c4ecf7b9c0b49ea7cddd939986dcc7f914b44b1a not found: ID does not exist" Jun 10 19:13:38.756263 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.756240 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6l8z8"] Jun 10 19:13:38.759459 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:38.759440 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6l8z8"] Jun 10 19:13:40.389289 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:40.389256 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b61622-e115-44f2-9ff9-b78bcd865100" path="/var/lib/kubelet/pods/75b61622-e115-44f2-9ff9-b78bcd865100/volumes" Jun 10 19:13:41.562050 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.562013 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86d6d9b59f-nb92v"] Jun 10 19:13:41.562575 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.562557 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75b61622-e115-44f2-9ff9-b78bcd865100" containerName="authorino" Jun 10 19:13:41.562622 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.562580 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="75b61622-e115-44f2-9ff9-b78bcd865100" containerName="authorino" Jun 10 19:13:41.562665 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.562655 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="75b61622-e115-44f2-9ff9-b78bcd865100" containerName="authorino" Jun 10 19:13:41.565931 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.565911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:41.569082 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.569061 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-59xnt\"" Jun 10 19:13:41.570131 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.570104 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 19:13:41.570520 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.570499 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 19:13:41.577726 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.577701 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86d6d9b59f-nb92v"] Jun 10 19:13:41.681663 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.681630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert\") pod \"maas-controller-86d6d9b59f-nb92v\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:41.681861 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.681691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt4wr\" (UniqueName: \"kubernetes.io/projected/cd0912f0-99e0-4f67-aee0-ec829990eb51-kube-api-access-zt4wr\") pod \"maas-controller-86d6d9b59f-nb92v\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:41.759242 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.759212 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f6888fc98-jpr26"] Jun 10 19:13:41.761496 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.761476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:41.779451 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.779425 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6888fc98-jpr26"] Jun 10 19:13:41.782910 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.782879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert\") pod \"maas-controller-86d6d9b59f-nb92v\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:41.783046 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.782933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt4wr\" (UniqueName: \"kubernetes.io/projected/cd0912f0-99e0-4f67-aee0-ec829990eb51-kube-api-access-zt4wr\") pod \"maas-controller-86d6d9b59f-nb92v\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:41.783111 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:13:41.783042 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 19:13:41.783111 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:13:41.783105 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert podName:cd0912f0-99e0-4f67-aee0-ec829990eb51 nodeName:}" failed. No retries permitted until 2026-06-10 19:13:42.283085332 +0000 UTC m=+880.350533675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert") pod "maas-controller-86d6d9b59f-nb92v" (UID: "cd0912f0-99e0-4f67-aee0-ec829990eb51") : secret "maas-controller-webhook-cert" not found Jun 10 19:13:41.794142 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.794115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt4wr\" (UniqueName: \"kubernetes.io/projected/cd0912f0-99e0-4f67-aee0-ec829990eb51-kube-api-access-zt4wr\") pod \"maas-controller-86d6d9b59f-nb92v\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:41.884301 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.884209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/d83941f1-4a21-4988-8365-b6cb78fc0444-kube-api-access-kcgh9\") pod \"maas-controller-7f6888fc98-jpr26\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:41.884434 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.884321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83941f1-4a21-4988-8365-b6cb78fc0444-webhook-cert\") pod \"maas-controller-7f6888fc98-jpr26\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:41.985201 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.985148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83941f1-4a21-4988-8365-b6cb78fc0444-webhook-cert\") pod \"maas-controller-7f6888fc98-jpr26\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:41.985408 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.985287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/d83941f1-4a21-4988-8365-b6cb78fc0444-kube-api-access-kcgh9\") pod \"maas-controller-7f6888fc98-jpr26\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:41.987822 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.987795 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83941f1-4a21-4988-8365-b6cb78fc0444-webhook-cert\") pod \"maas-controller-7f6888fc98-jpr26\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:41.996158 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:41.996132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/d83941f1-4a21-4988-8365-b6cb78fc0444-kube-api-access-kcgh9\") pod \"maas-controller-7f6888fc98-jpr26\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:42.073116 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.073078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:42.213727 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.213692 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6888fc98-jpr26"] Jun 10 19:13:42.215772 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:13:42.215718 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83941f1_4a21_4988_8365_b6cb78fc0444.slice/crio-414556ba3151842970b56987cce432a4b9b4c171691530ca050a473b262ff6a5 WatchSource:0}: Error finding container 414556ba3151842970b56987cce432a4b9b4c171691530ca050a473b262ff6a5: Status 404 returned error can't find the container with id 414556ba3151842970b56987cce432a4b9b4c171691530ca050a473b262ff6a5 Jun 10 19:13:42.217060 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.217041 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:13:42.288937 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.288901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert\") pod \"maas-controller-86d6d9b59f-nb92v\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:42.291389 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.291370 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert\") pod \"maas-controller-86d6d9b59f-nb92v\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:42.479564 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.479476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:42.614178 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.614146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86d6d9b59f-nb92v"] Jun 10 19:13:42.617661 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:13:42.617630 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd0912f0_99e0_4f67_aee0_ec829990eb51.slice/crio-bf69489ab3d4fe31272517eafd5fdd1145bc8456bd2b5c86b526f1e8ddb992c8 WatchSource:0}: Error finding container bf69489ab3d4fe31272517eafd5fdd1145bc8456bd2b5c86b526f1e8ddb992c8: Status 404 returned error can't find the container with id bf69489ab3d4fe31272517eafd5fdd1145bc8456bd2b5c86b526f1e8ddb992c8 Jun 10 19:13:42.759456 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.759365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6888fc98-jpr26" event={"ID":"d83941f1-4a21-4988-8365-b6cb78fc0444","Type":"ContainerStarted","Data":"414556ba3151842970b56987cce432a4b9b4c171691530ca050a473b262ff6a5"} Jun 10 19:13:42.760853 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:42.760823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" event={"ID":"cd0912f0-99e0-4f67-aee0-ec829990eb51","Type":"ContainerStarted","Data":"bf69489ab3d4fe31272517eafd5fdd1145bc8456bd2b5c86b526f1e8ddb992c8"} Jun 10 19:13:45.778845 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:45.778807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" event={"ID":"cd0912f0-99e0-4f67-aee0-ec829990eb51","Type":"ContainerStarted","Data":"6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94"} Jun 10 19:13:45.779339 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:45.778915 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:45.780230 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:45.780205 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6888fc98-jpr26" event={"ID":"d83941f1-4a21-4988-8365-b6cb78fc0444","Type":"ContainerStarted","Data":"5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a"} Jun 10 19:13:45.785710 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:45.780645 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:45.799712 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:45.799665 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" podStartSLOduration=2.560540211 podStartE2EDuration="4.799650612s" totalImagesPullingTime="2.239110401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:13:45.798312871 +0000 UTC m=+883.865761232" watchObservedRunningTime="2026-06-10 19:13:45.799650612 +0000 UTC m=+883.867098973" Jun 10 19:13:56.791342 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:56.791309 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:56.791712 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:56.791390 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:13:56.811446 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:56.811395 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f6888fc98-jpr26" podStartSLOduration=13.182957653 podStartE2EDuration="15.811380857s" totalImagesPullingTime="2.628423204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:13:45.818231266 +0000 UTC m=+883.885679628" watchObservedRunningTime="2026-06-10 19:13:56.811380857 +0000 UTC m=+894.878829241" Jun 10 19:13:56.859996 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:56.859958 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86d6d9b59f-nb92v"] Jun 10 19:13:56.860200 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:56.860176 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" podUID="cd0912f0-99e0-4f67-aee0-ec829990eb51" containerName="manager" containerID="cri-o://6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94" gracePeriod=30 Jun 10 19:13:57.103380 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.103348 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:57.124317 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.124289 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt4wr\" (UniqueName: \"kubernetes.io/projected/cd0912f0-99e0-4f67-aee0-ec829990eb51-kube-api-access-zt4wr\") pod \"cd0912f0-99e0-4f67-aee0-ec829990eb51\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " Jun 10 19:13:57.124452 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.124414 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert\") pod \"cd0912f0-99e0-4f67-aee0-ec829990eb51\" (UID: \"cd0912f0-99e0-4f67-aee0-ec829990eb51\") " Jun 10 19:13:57.126561 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.126525 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cd0912f0-99e0-4f67-aee0-ec829990eb51" (UID: "cd0912f0-99e0-4f67-aee0-ec829990eb51"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:13:57.126650 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.126626 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd0912f0-99e0-4f67-aee0-ec829990eb51-kube-api-access-zt4wr" (OuterVolumeSpecName: "kube-api-access-zt4wr") pod "cd0912f0-99e0-4f67-aee0-ec829990eb51" (UID: "cd0912f0-99e0-4f67-aee0-ec829990eb51"). InnerVolumeSpecName "kube-api-access-zt4wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:13:57.225350 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.225313 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cd0912f0-99e0-4f67-aee0-ec829990eb51-webhook-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:13:57.225350 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.225344 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt4wr\" (UniqueName: \"kubernetes.io/projected/cd0912f0-99e0-4f67-aee0-ec829990eb51-kube-api-access-zt4wr\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:13:57.836087 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.836054 2562 generic.go:356] "Generic (PLEG): container finished" podID="cd0912f0-99e0-4f67-aee0-ec829990eb51" containerID="6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94" exitCode=0 Jun 10 19:13:57.836445 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.836103 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" Jun 10 19:13:57.836445 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.836106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" event={"ID":"cd0912f0-99e0-4f67-aee0-ec829990eb51","Type":"ContainerDied","Data":"6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94"} Jun 10 19:13:57.836445 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.836240 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86d6d9b59f-nb92v" event={"ID":"cd0912f0-99e0-4f67-aee0-ec829990eb51","Type":"ContainerDied","Data":"bf69489ab3d4fe31272517eafd5fdd1145bc8456bd2b5c86b526f1e8ddb992c8"} Jun 10 19:13:57.836445 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.836274 2562 scope.go:117] "RemoveContainer" containerID="6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94" Jun 10 19:13:57.845646 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.845630 2562 scope.go:117] "RemoveContainer" containerID="6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94" Jun 10 19:13:57.845988 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:13:57.845970 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94\": container with ID starting with 6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94 not found: ID does not exist" containerID="6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94" Jun 10 19:13:57.846044 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.845998 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94"} err="failed to get container status \"6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94\": rpc error: code = NotFound desc = could not find container \"6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94\": container with ID starting with 6fcd2f98216a85300f197bb0ecc550b9c87d022779cced6955bcdbcca811df94 not found: ID does not exist" Jun 10 19:13:57.862681 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.862645 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86d6d9b59f-nb92v"] Jun 10 19:13:57.867670 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:57.867649 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86d6d9b59f-nb92v"] Jun 10 19:13:58.390089 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:13:58.390048 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd0912f0-99e0-4f67-aee0-ec829990eb51" path="/var/lib/kubelet/pods/cd0912f0-99e0-4f67-aee0-ec829990eb51/volumes" Jun 10 19:14:13.740842 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.740803 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8"] Jun 10 19:14:13.743741 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.741145 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd0912f0-99e0-4f67-aee0-ec829990eb51" containerName="manager" Jun 10 19:14:13.743741 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.741157 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd0912f0-99e0-4f67-aee0-ec829990eb51" containerName="manager" Jun 10 19:14:13.743741 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.741226 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd0912f0-99e0-4f67-aee0-ec829990eb51" containerName="manager" Jun 10 19:14:13.743741 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.743725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:13.747700 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.747672 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 10 19:14:13.747878 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.747712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 19:14:13.748151 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.748135 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-j2t27\"" Jun 10 19:14:13.748269 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.748143 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 19:14:13.761239 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.761214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8"] Jun 10 19:14:13.866163 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.866122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-maas-api-tls\") pod \"maas-api-56c86bc557-zc6l8\" (UID: \"71d878f1-6145-4dc0-8dec-cb82a2f2c43a\") " pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:13.866338 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.866172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q2v5\" (UniqueName: \"kubernetes.io/projected/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-kube-api-access-4q2v5\") pod \"maas-api-56c86bc557-zc6l8\" (UID: \"71d878f1-6145-4dc0-8dec-cb82a2f2c43a\") " pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:13.966870 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.966837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-maas-api-tls\") pod \"maas-api-56c86bc557-zc6l8\" (UID: \"71d878f1-6145-4dc0-8dec-cb82a2f2c43a\") " pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:13.967038 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.966895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2v5\" (UniqueName: \"kubernetes.io/projected/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-kube-api-access-4q2v5\") pod \"maas-api-56c86bc557-zc6l8\" (UID: \"71d878f1-6145-4dc0-8dec-cb82a2f2c43a\") " pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:13.967038 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:14:13.967000 2562 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 10 19:14:13.967110 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:14:13.967086 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-maas-api-tls podName:71d878f1-6145-4dc0-8dec-cb82a2f2c43a nodeName:}" failed. No retries permitted until 2026-06-10 19:14:14.467068551 +0000 UTC m=+912.534516899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-maas-api-tls") pod "maas-api-56c86bc557-zc6l8" (UID: "71d878f1-6145-4dc0-8dec-cb82a2f2c43a") : secret "maas-api-serving-cert" not found Jun 10 19:14:13.978644 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:13.978611 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2v5\" (UniqueName: \"kubernetes.io/projected/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-kube-api-access-4q2v5\") pod \"maas-api-56c86bc557-zc6l8\" (UID: \"71d878f1-6145-4dc0-8dec-cb82a2f2c43a\") " pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:14.430922 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.430881 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-t6fhs"] Jun 10 19:14:14.447065 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.447034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" Jun 10 19:14:14.448076 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.448051 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-t6fhs"] Jun 10 19:14:14.455600 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.455576 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 19:14:14.455719 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.455610 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xzjtz\"" Jun 10 19:14:14.473194 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.473163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-maas-api-tls\") pod \"maas-api-56c86bc557-zc6l8\" (UID: \"71d878f1-6145-4dc0-8dec-cb82a2f2c43a\") " pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:14.475711 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.475689 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71d878f1-6145-4dc0-8dec-cb82a2f2c43a-maas-api-tls\") pod \"maas-api-56c86bc557-zc6l8\" (UID: \"71d878f1-6145-4dc0-8dec-cb82a2f2c43a\") " pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:14.574541 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.574508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scv2b\" (UniqueName: \"kubernetes.io/projected/fecd7005-98e9-447c-9651-82b7c55f946e-kube-api-access-scv2b\") pod \"payload-pre-processing-579785bc64-t6fhs\" (UID: \"fecd7005-98e9-447c-9651-82b7c55f946e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" Jun 10 19:14:14.654283 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.654248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:14.675663 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.675627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scv2b\" (UniqueName: \"kubernetes.io/projected/fecd7005-98e9-447c-9651-82b7c55f946e-kube-api-access-scv2b\") pod \"payload-pre-processing-579785bc64-t6fhs\" (UID: \"fecd7005-98e9-447c-9651-82b7c55f946e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" Jun 10 19:14:14.689653 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.689584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scv2b\" (UniqueName: \"kubernetes.io/projected/fecd7005-98e9-447c-9651-82b7c55f946e-kube-api-access-scv2b\") pod \"payload-pre-processing-579785bc64-t6fhs\" (UID: \"fecd7005-98e9-447c-9651-82b7c55f946e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" Jun 10 19:14:14.759548 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.759251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" Jun 10 19:14:14.804520 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.804491 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8"] Jun 10 19:14:14.806783 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:14:14.806723 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d878f1_6145_4dc0_8dec_cb82a2f2c43a.slice/crio-7ddd1e2cc0ec0bc1b7c48b6b6a6990bc00e03ddd80bc2b7e27927f06a8826156 WatchSource:0}: Error finding container 7ddd1e2cc0ec0bc1b7c48b6b6a6990bc00e03ddd80bc2b7e27927f06a8826156: Status 404 returned error can't find the container with id 7ddd1e2cc0ec0bc1b7c48b6b6a6990bc00e03ddd80bc2b7e27927f06a8826156 Jun 10 19:14:14.915965 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.915927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" event={"ID":"71d878f1-6145-4dc0-8dec-cb82a2f2c43a","Type":"ContainerStarted","Data":"7ddd1e2cc0ec0bc1b7c48b6b6a6990bc00e03ddd80bc2b7e27927f06a8826156"} Jun 10 19:14:14.922310 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:14.922275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-t6fhs"] Jun 10 19:14:14.925157 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:14:14.925128 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecd7005_98e9_447c_9651_82b7c55f946e.slice/crio-0a119bc9459da18fa13a23a545625ba520c2b79f8be4bb89686854241663836d WatchSource:0}: Error finding container 0a119bc9459da18fa13a23a545625ba520c2b79f8be4bb89686854241663836d: Status 404 returned error can't find the container with id 0a119bc9459da18fa13a23a545625ba520c2b79f8be4bb89686854241663836d Jun 10 19:14:15.925381 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:15.925338 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" event={"ID":"fecd7005-98e9-447c-9651-82b7c55f946e","Type":"ContainerStarted","Data":"0a119bc9459da18fa13a23a545625ba520c2b79f8be4bb89686854241663836d"} Jun 10 19:14:18.943062 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:18.942059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" event={"ID":"fecd7005-98e9-447c-9651-82b7c55f946e","Type":"ContainerStarted","Data":"a6b4b912192559b32989093d64f5af01ff70aa0411ba154cdf046835559653b2"} Jun 10 19:14:18.943062 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:18.942985 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" Jun 10 19:14:18.945382 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:18.945341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" event={"ID":"71d878f1-6145-4dc0-8dec-cb82a2f2c43a","Type":"ContainerStarted","Data":"3d7b4c461d10dab25149a62f435e0316123805e36b0f56e79469bfbcfd41f159"} Jun 10 19:14:18.945945 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:18.945920 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:18.966789 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:18.964845 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" podStartSLOduration=1.808005131 podStartE2EDuration="4.964826278s" totalImagesPullingTime="3.156821147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:14:18.962244776 +0000 UTC m=+917.029693138" watchObservedRunningTime="2026-06-10 19:14:18.964826278 +0000 UTC m=+917.032274639" Jun 10 19:14:18.987499 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:18.987446 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" podStartSLOduration=2.76024274 podStartE2EDuration="5.987429359s" totalImagesPullingTime="3.227186619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:14:18.98518979 +0000 UTC m=+917.052638150" watchObservedRunningTime="2026-06-10 19:14:18.987429359 +0000 UTC m=+917.054877721" Jun 10 19:14:22.969719 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:22.969677 2562 generic.go:356] "Generic (PLEG): container finished" podID="234bf02c-83cd-401c-848c-ed1461b4d5b0" containerID="d61e57c40cab3ef9249b4b4a81da5f395aac8ed18f25b5121a3f2f29688c411b" exitCode=0 Jun 10 19:14:22.970206 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:22.969749 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" event={"ID":"234bf02c-83cd-401c-848c-ed1461b4d5b0","Type":"ContainerDied","Data":"d61e57c40cab3ef9249b4b4a81da5f395aac8ed18f25b5121a3f2f29688c411b"} Jun 10 19:14:22.970206 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:22.970184 2562 scope.go:117] "RemoveContainer" containerID="d61e57c40cab3ef9249b4b4a81da5f395aac8ed18f25b5121a3f2f29688c411b" Jun 10 19:14:22.971232 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:22.971199 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:14:22.971300 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:22.971283 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:14:22.971346 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:22.971333 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 10 19:14:23.976543 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:23.976499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" event={"ID":"234bf02c-83cd-401c-848c-ed1461b4d5b0","Type":"ContainerStarted","Data":"b09ff8af2a32a0f4eaa70b09a21de0895735edcb62ab34f30048a583fa73552d"} Jun 10 19:14:24.954261 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:24.954211 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:14:24.954475 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:24.954357 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-csnqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 10 19:14:24.954475 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:24.954403 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" podUID="234bf02c-83cd-401c-848c-ed1461b4d5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 10 19:14:25.955210 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:25.955171 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-csnqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 10 19:14:25.955809 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:25.955771 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" podUID="234bf02c-83cd-401c-848c-ed1461b4d5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 10 19:14:25.969497 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:25.969469 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-56c86bc557-zc6l8" Jun 10 19:14:26.954218 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:26.954179 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-csnqm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jun 10 19:14:26.954519 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:26.954484 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" podUID="234bf02c-83cd-401c-848c-ed1461b4d5b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jun 10 19:14:27.836733 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:27.836697 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:14:27.837179 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:27.836905 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" containerID="cri-o://406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d" gracePeriod=30 Jun 10 19:14:27.957456 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:27.957419 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:14:27.957715 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:27.957694 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:14:27.958445 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:27.958427 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-csnqm" Jun 10 19:14:29.387905 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:29.387880 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:29.514819 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:29.514726 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67hgm\" (UniqueName: \"kubernetes.io/projected/c8252c91-c79b-4f2d-9551-5d1c0a8969b5-kube-api-access-67hgm\") pod \"c8252c91-c79b-4f2d-9551-5d1c0a8969b5\" (UID: \"c8252c91-c79b-4f2d-9551-5d1c0a8969b5\") " Jun 10 19:14:29.517111 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:29.517078 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8252c91-c79b-4f2d-9551-5d1c0a8969b5-kube-api-access-67hgm" (OuterVolumeSpecName: "kube-api-access-67hgm") pod "c8252c91-c79b-4f2d-9551-5d1c0a8969b5" (UID: "c8252c91-c79b-4f2d-9551-5d1c0a8969b5"). InnerVolumeSpecName "kube-api-access-67hgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:14:29.616169 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:29.616136 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67hgm\" (UniqueName: \"kubernetes.io/projected/c8252c91-c79b-4f2d-9551-5d1c0a8969b5-kube-api-access-67hgm\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:14:30.003501 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.003468 2562 generic.go:356] "Generic (PLEG): container finished" podID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerID="406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d" exitCode=143 Jun 10 19:14:30.003685 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.003514 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.003685 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.003563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c8252c91-c79b-4f2d-9551-5d1c0a8969b5","Type":"ContainerDied","Data":"406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d"} Jun 10 19:14:30.003685 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.003640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c8252c91-c79b-4f2d-9551-5d1c0a8969b5","Type":"ContainerDied","Data":"cdca872292b2578e203de9c84fc3daf6f560c18c5eab48afdbc1d30b4377c9cf"} Jun 10 19:14:30.003685 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.003662 2562 scope.go:117] "RemoveContainer" containerID="406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d" Jun 10 19:14:30.012981 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.012957 2562 scope.go:117] "RemoveContainer" containerID="406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d" Jun 10 19:14:30.013242 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:14:30.013223 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d\": container with ID starting with 406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d not found: ID does not exist" containerID="406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d" Jun 10 19:14:30.013292 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.013251 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d"} err="failed to get container status \"406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d\": rpc error: code = NotFound desc = could not find container \"406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d\": container with ID starting with 406f5bc6a30eecd62cb94febc85094758e47e13465c2f138c0bc8be3b7dc666d not found: ID does not exist" Jun 10 19:14:30.027660 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.027637 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:14:30.032211 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.032186 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:14:30.058697 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.058670 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:14:30.059093 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.059077 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" Jun 10 19:14:30.059171 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.059095 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" Jun 10 19:14:30.059226 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.059173 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" containerName="keycloak" Jun 10 19:14:30.061968 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.061950 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.064824 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.064805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 19:14:30.064911 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.064836 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 19:14:30.064911 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.064852 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 19:14:30.065130 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.065115 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 19:14:30.065225 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.065204 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-phxkm\"" Jun 10 19:14:30.074147 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.074124 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:14:30.221618 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.221575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92dvn\" (UniqueName: \"kubernetes.io/projected/d677b994-9a96-42d7-aa99-2f924f9c0360-kube-api-access-92dvn\") pod \"maas-keycloak-0\" (UID: \"d677b994-9a96-42d7-aa99-2f924f9c0360\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.221835 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.221639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d677b994-9a96-42d7-aa99-2f924f9c0360-test-realms\") pod \"maas-keycloak-0\" (UID: \"d677b994-9a96-42d7-aa99-2f924f9c0360\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.322588 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.322553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92dvn\" (UniqueName: \"kubernetes.io/projected/d677b994-9a96-42d7-aa99-2f924f9c0360-kube-api-access-92dvn\") pod \"maas-keycloak-0\" (UID: \"d677b994-9a96-42d7-aa99-2f924f9c0360\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.322743 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.322611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d677b994-9a96-42d7-aa99-2f924f9c0360-test-realms\") pod \"maas-keycloak-0\" (UID: \"d677b994-9a96-42d7-aa99-2f924f9c0360\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.323353 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.323333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/d677b994-9a96-42d7-aa99-2f924f9c0360-test-realms\") pod \"maas-keycloak-0\" (UID: \"d677b994-9a96-42d7-aa99-2f924f9c0360\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.332809 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.332777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92dvn\" (UniqueName: \"kubernetes.io/projected/d677b994-9a96-42d7-aa99-2f924f9c0360-kube-api-access-92dvn\") pod \"maas-keycloak-0\" (UID: \"d677b994-9a96-42d7-aa99-2f924f9c0360\") " pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.371896 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.371863 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:30.390822 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.390785 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8252c91-c79b-4f2d-9551-5d1c0a8969b5" path="/var/lib/kubelet/pods/c8252c91-c79b-4f2d-9551-5d1c0a8969b5/volumes" Jun 10 19:14:30.511964 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.511940 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 19:14:30.513944 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:14:30.513919 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd677b994_9a96_42d7_aa99_2f924f9c0360.slice/crio-0a6dae977f3907ac383f9c89cf504fabd91e7abba6d38dca150d7a9c163b875e WatchSource:0}: Error finding container 0a6dae977f3907ac383f9c89cf504fabd91e7abba6d38dca150d7a9c163b875e: Status 404 returned error can't find the container with id 0a6dae977f3907ac383f9c89cf504fabd91e7abba6d38dca150d7a9c163b875e Jun 10 19:14:30.961727 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:30.961620 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-t6fhs" Jun 10 19:14:31.010982 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:31.010942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d677b994-9a96-42d7-aa99-2f924f9c0360","Type":"ContainerStarted","Data":"75546c30b28f2036ca10d09adeeea623b6e7fb19a51f264238b8c5a3bfc9d9e5"} Jun 10 19:14:31.011139 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:31.011009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"d677b994-9a96-42d7-aa99-2f924f9c0360","Type":"ContainerStarted","Data":"0a6dae977f3907ac383f9c89cf504fabd91e7abba6d38dca150d7a9c163b875e"} Jun 10 19:14:31.372268 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:31.372227 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:31.373577 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:31.373538 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:32.372564 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:32.372501 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:33.373217 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:33.373161 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:34.373136 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:34.373080 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:35.372665 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:35.372592 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:36.372911 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:36.372864 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:37.372624 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:37.372568 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:38.372690 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:38.372651 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:39.373149 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:39.373103 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:40.372904 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:40.372859 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:40.373206 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:40.373173 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:41.373258 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:41.373205 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:42.372816 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:42.372743 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:43.373199 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:43.373155 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.34:9000/health/started\": dial tcp 10.133.0.34:9000: connect: connection refused" Jun 10 19:14:44.486782 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:44.486727 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 19:14:44.503131 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:44.503084 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:14:44.511918 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:44.511819 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=14.11560004 podStartE2EDuration="14.511801206s" totalImagesPullingTime="396.201166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:14:31.034091054 +0000 UTC m=+929.101539421" watchObservedRunningTime="2026-06-10 19:14:44.511801206 +0000 UTC m=+942.579249566" Jun 10 19:14:54.492530 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:14:54.492462 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="d677b994-9a96-42d7-aa99-2f924f9c0360" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 19:15:00.159454 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.159417 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j"] Jun 10 19:15:00.163231 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.163210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" Jun 10 19:15:00.177575 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.177542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j"] Jun 10 19:15:00.326153 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.326107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kjb8\" (UniqueName: \"kubernetes.io/projected/226895de-07a8-44fa-925f-8fd482294317-kube-api-access-8kjb8\") pod \"maas-api-key-cleanup-29685315-h6f9j\" (UID: \"226895de-07a8-44fa-925f-8fd482294317\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" Jun 10 19:15:00.426801 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.426667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kjb8\" (UniqueName: \"kubernetes.io/projected/226895de-07a8-44fa-925f-8fd482294317-kube-api-access-8kjb8\") pod \"maas-api-key-cleanup-29685315-h6f9j\" (UID: \"226895de-07a8-44fa-925f-8fd482294317\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" Jun 10 19:15:00.446845 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.446810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kjb8\" (UniqueName: \"kubernetes.io/projected/226895de-07a8-44fa-925f-8fd482294317-kube-api-access-8kjb8\") pod \"maas-api-key-cleanup-29685315-h6f9j\" (UID: \"226895de-07a8-44fa-925f-8fd482294317\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" Jun 10 19:15:00.473627 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.473588 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" Jun 10 19:15:00.607886 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:00.607858 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j"] Jun 10 19:15:00.610149 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:15:00.610115 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226895de_07a8_44fa_925f_8fd482294317.slice/crio-1e7d10d0babb9291adc37473cc5e0994f712edacdd62d5b01f1d0c01e2be9d82 WatchSource:0}: Error finding container 1e7d10d0babb9291adc37473cc5e0994f712edacdd62d5b01f1d0c01e2be9d82: Status 404 returned error can't find the container with id 1e7d10d0babb9291adc37473cc5e0994f712edacdd62d5b01f1d0c01e2be9d82 Jun 10 19:15:01.188338 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:01.188291 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" event={"ID":"226895de-07a8-44fa-925f-8fd482294317","Type":"ContainerStarted","Data":"1e7d10d0babb9291adc37473cc5e0994f712edacdd62d5b01f1d0c01e2be9d82"} Jun 10 19:15:03.199965 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:03.199927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" event={"ID":"226895de-07a8-44fa-925f-8fd482294317","Type":"ContainerStarted","Data":"ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8"} Jun 10 19:15:03.227796 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:03.227642 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" podStartSLOduration=1.116267042 podStartE2EDuration="3.227623599s" totalImagesPullingTime="2.111356557s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:15:03.226348754 +0000 UTC m=+961.293797114" watchObservedRunningTime="2026-06-10 19:15:03.227623599 +0000 UTC m=+961.295071960" Jun 10 19:15:04.493630 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:04.493594 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 19:15:23.822286 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.822246 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn"] Jun 10 19:15:23.825638 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.825617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:23.828804 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.828779 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 19:15:23.829325 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.829303 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-g96pj\"" Jun 10 19:15:23.830182 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.830164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 19:15:23.830270 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.830204 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 19:15:23.842475 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.842449 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn"] Jun 10 19:15:23.936305 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.936263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a74f7d-7d85-4b02-a3e8-42e0aad58370-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:23.936488 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.936320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f6rs\" (UniqueName: \"kubernetes.io/projected/93a74f7d-7d85-4b02-a3e8-42e0aad58370-kube-api-access-7f6rs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:23.936488 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.936355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:23.936488 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.936406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:23.936488 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.936459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:23.936647 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:23.936530 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038037 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.037995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038248 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a74f7d-7d85-4b02-a3e8-42e0aad58370-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038248 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f6rs\" (UniqueName: \"kubernetes.io/projected/93a74f7d-7d85-4b02-a3e8-42e0aad58370-kube-api-access-7f6rs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038248 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038413 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038413 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038505 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038505 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.038652 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.038632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.040591 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.040563 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93a74f7d-7d85-4b02-a3e8-42e0aad58370-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.040919 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.040897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93a74f7d-7d85-4b02-a3e8-42e0aad58370-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.048394 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.048366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f6rs\" (UniqueName: \"kubernetes.io/projected/93a74f7d-7d85-4b02-a3e8-42e0aad58370-kube-api-access-7f6rs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn\" (UID: \"93a74f7d-7d85-4b02-a3e8-42e0aad58370\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.136094 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.135991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:24.284703 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.284673 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn"] Jun 10 19:15:24.287019 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:15:24.286992 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a74f7d_7d85_4b02_a3e8_42e0aad58370.slice/crio-fbf9a44042abb9e4268bf05824481cab214407a34a7a5f368a7aa4ece1c442c0 WatchSource:0}: Error finding container fbf9a44042abb9e4268bf05824481cab214407a34a7a5f368a7aa4ece1c442c0: Status 404 returned error can't find the container with id fbf9a44042abb9e4268bf05824481cab214407a34a7a5f368a7aa4ece1c442c0 Jun 10 19:15:24.296641 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:24.296596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" event={"ID":"93a74f7d-7d85-4b02-a3e8-42e0aad58370","Type":"ContainerStarted","Data":"fbf9a44042abb9e4268bf05824481cab214407a34a7a5f368a7aa4ece1c442c0"} Jun 10 19:15:29.324877 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:29.324834 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" event={"ID":"93a74f7d-7d85-4b02-a3e8-42e0aad58370","Type":"ContainerStarted","Data":"f8e6e4a0734d441d9fb1c327bb1ea928e17aa78a4d8a6063db7e7c86b375cb3b"} Jun 10 19:15:30.331085 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:30.331052 2562 generic.go:356] "Generic (PLEG): container finished" podID="93a74f7d-7d85-4b02-a3e8-42e0aad58370" containerID="f8e6e4a0734d441d9fb1c327bb1ea928e17aa78a4d8a6063db7e7c86b375cb3b" exitCode=0 Jun 10 19:15:30.331471 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:30.331144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" event={"ID":"93a74f7d-7d85-4b02-a3e8-42e0aad58370","Type":"ContainerDied","Data":"f8e6e4a0734d441d9fb1c327bb1ea928e17aa78a4d8a6063db7e7c86b375cb3b"} Jun 10 19:15:32.342942 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:32.342898 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" event={"ID":"93a74f7d-7d85-4b02-a3e8-42e0aad58370","Type":"ContainerStarted","Data":"1ee73193331ca65b03cb45e5df1eb37bf63fabbe5d44afeb7e40f6dc7270d0ee"} Jun 10 19:15:34.137055 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:34.137017 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:34.137479 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:34.137156 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:34.149866 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:34.149841 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:34.175647 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:34.175590 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" podStartSLOduration=4.535581601 podStartE2EDuration="11.175573204s" totalImagesPullingTime="5.363190359s" totalInitContainerRuntime="1.276801244s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:15:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:15:32.373741461 +0000 UTC m=+990.441189822" watchObservedRunningTime="2026-06-10 19:15:34.175573204 +0000 UTC m=+992.243021575" Jun 10 19:15:34.362836 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:34.362806 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn" Jun 10 19:15:43.906977 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:43.906938 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s"] Jun 10 19:15:43.914724 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:43.914696 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:43.919964 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:43.919923 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 19:15:43.926196 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:43.926169 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s"] Jun 10 19:15:44.022042 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.022010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.022225 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.022053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.022225 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.022078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161e5246-2505-4839-bed1-9ac0994fa026-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.022225 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.022167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.022225 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.022196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kq8f\" (UniqueName: \"kubernetes.io/projected/161e5246-2505-4839-bed1-9ac0994fa026-kube-api-access-4kq8f\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.022389 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.022243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.123519 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.123483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.123704 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.123548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.123704 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.123581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.123704 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.123608 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161e5246-2505-4839-bed1-9ac0994fa026-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.123704 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.123636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.123704 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.123660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kq8f\" (UniqueName: \"kubernetes.io/projected/161e5246-2505-4839-bed1-9ac0994fa026-kube-api-access-4kq8f\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.124004 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.123977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.124087 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.124061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.124205 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.124185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.125972 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.125952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/161e5246-2505-4839-bed1-9ac0994fa026-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.126231 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.126211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/161e5246-2505-4839-bed1-9ac0994fa026-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.136901 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.136873 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kq8f\" (UniqueName: \"kubernetes.io/projected/161e5246-2505-4839-bed1-9ac0994fa026-kube-api-access-4kq8f\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s\" (UID: \"161e5246-2505-4839-bed1-9ac0994fa026\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.227903 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.227814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:44.367287 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.367262 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s"] Jun 10 19:15:44.368625 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:15:44.368588 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161e5246_2505_4839_bed1_9ac0994fa026.slice/crio-e648f4c65122e2278aee646c568ec2a786b4eb6718b52fc532b842cd921715bb WatchSource:0}: Error finding container e648f4c65122e2278aee646c568ec2a786b4eb6718b52fc532b842cd921715bb: Status 404 returned error can't find the container with id e648f4c65122e2278aee646c568ec2a786b4eb6718b52fc532b842cd921715bb Jun 10 19:15:44.396166 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:44.396125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" event={"ID":"161e5246-2505-4839-bed1-9ac0994fa026","Type":"ContainerStarted","Data":"e648f4c65122e2278aee646c568ec2a786b4eb6718b52fc532b842cd921715bb"} Jun 10 19:15:45.403207 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:45.403166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" event={"ID":"161e5246-2505-4839-bed1-9ac0994fa026","Type":"ContainerStarted","Data":"c035633e6616216c83c404916f177d1b6b73323d542f0cac157fd3a8cb3ea8ab"} Jun 10 19:15:46.409033 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.408998 2562 generic.go:356] "Generic (PLEG): container finished" podID="161e5246-2505-4839-bed1-9ac0994fa026" containerID="c035633e6616216c83c404916f177d1b6b73323d542f0cac157fd3a8cb3ea8ab" exitCode=0 Jun 10 19:15:46.409437 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.409089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" event={"ID":"161e5246-2505-4839-bed1-9ac0994fa026","Type":"ContainerDied","Data":"c035633e6616216c83c404916f177d1b6b73323d542f0cac157fd3a8cb3ea8ab"} Jun 10 19:15:46.792374 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.792343 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc"] Jun 10 19:15:46.796169 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.796144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:46.798706 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.798677 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 19:15:46.806245 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.806215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc"] Jun 10 19:15:46.952938 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.952829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:46.953218 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.952978 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:46.953218 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.953033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9355691-4f9e-47e3-a99d-f24c115b667a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:46.953218 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.953068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:46.953218 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.953095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slgdx\" (UniqueName: \"kubernetes.io/projected/b9355691-4f9e-47e3-a99d-f24c115b667a-kube-api-access-slgdx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:46.953218 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:46.953160 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.054327 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.054280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.054534 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.054353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.054600 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.054552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.054655 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.054598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9355691-4f9e-47e3-a99d-f24c115b667a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.054655 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.054628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.054806 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.054651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slgdx\" (UniqueName: \"kubernetes.io/projected/b9355691-4f9e-47e3-a99d-f24c115b667a-kube-api-access-slgdx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.055401 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.055375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.055627 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.055600 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.055923 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.055900 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.057312 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.057287 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9355691-4f9e-47e3-a99d-f24c115b667a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.057573 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.057528 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9355691-4f9e-47e3-a99d-f24c115b667a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.066842 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.066737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slgdx\" (UniqueName: \"kubernetes.io/projected/b9355691-4f9e-47e3-a99d-f24c115b667a-kube-api-access-slgdx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc\" (UID: \"b9355691-4f9e-47e3-a99d-f24c115b667a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.109443 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.109399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:15:47.265809 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.265564 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc"] Jun 10 19:15:47.268544 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:15:47.268518 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9355691_4f9e_47e3_a99d_f24c115b667a.slice/crio-9478146a134382676f69b7d779acb28190105da42ab5e57b89c6bc4f3f2f845b WatchSource:0}: Error finding container 9478146a134382676f69b7d779acb28190105da42ab5e57b89c6bc4f3f2f845b: Status 404 returned error can't find the container with id 9478146a134382676f69b7d779acb28190105da42ab5e57b89c6bc4f3f2f845b Jun 10 19:15:47.417252 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.417208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" event={"ID":"161e5246-2505-4839-bed1-9ac0994fa026","Type":"ContainerStarted","Data":"b176865780812a2eb02599d8dc09c70c4bd2478e30429f5a33b2cab749237f6a"} Jun 10 19:15:47.418924 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.418888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" event={"ID":"b9355691-4f9e-47e3-a99d-f24c115b667a","Type":"ContainerStarted","Data":"67de8fd1c5f56b8a21adfea26e93f6661be559915a49a149aa5ba78779e8ef45"} Jun 10 19:15:47.419056 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.418940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" event={"ID":"b9355691-4f9e-47e3-a99d-f24c115b667a","Type":"ContainerStarted","Data":"9478146a134382676f69b7d779acb28190105da42ab5e57b89c6bc4f3f2f845b"} Jun 10 19:15:47.454612 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:47.454554 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" podStartSLOduration=2.9402700360000003 podStartE2EDuration="4.454538979s" totalImagesPullingTime="276.071478ms" totalInitContainerRuntime="1.238197465s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:15:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:15:47.452887266 +0000 UTC m=+1005.520335672" watchObservedRunningTime="2026-06-10 19:15:47.454538979 +0000 UTC m=+1005.521987339" Jun 10 19:15:54.228340 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:54.228303 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:54.228741 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:54.228401 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:54.241020 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:54.240988 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:15:54.463126 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:15:54.463090 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s" Jun 10 19:16:00.011226 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.011186 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j"] Jun 10 19:16:00.011712 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.011410 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" podUID="226895de-07a8-44fa-925f-8fd482294317" containerName="cleanup" containerID="cri-o://ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8" gracePeriod=30 Jun 10 19:16:00.778820 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.778787 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d"] Jun 10 19:16:00.799447 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.799408 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d"] Jun 10 19:16:00.799610 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.799565 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.803935 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.803908 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 19:16:00.879840 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.879802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.879995 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.879853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.879995 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.879877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.879995 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.879898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2srhx\" (UniqueName: \"kubernetes.io/projected/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-kube-api-access-2srhx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.879995 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.879930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.879995 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.879952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.980731 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.980695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.980909 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.980741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.980909 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.980891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.980990 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.980929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2srhx\" (UniqueName: \"kubernetes.io/projected/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-kube-api-access-2srhx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.980990 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.980969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.981091 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.981001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.981334 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.981301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.981483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.981389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.981483 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.981452 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.983426 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.983401 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.983568 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.983553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:00.991564 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:00.991539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2srhx\" (UniqueName: \"kubernetes.io/projected/cd9d55af-47e1-4385-86e4-2c4fe1702d5f-kube-api-access-2srhx\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d\" (UID: \"cd9d55af-47e1-4385-86e4-2c4fe1702d5f\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:01.110532 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:01.110495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:16:01.278905 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:01.278881 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d"] Jun 10 19:16:01.280461 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:16:01.280429 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd9d55af_47e1_4385_86e4_2c4fe1702d5f.slice/crio-e20be5eee31fc546a5439983f17b478296269e7d5717279f89fffc21abc7dfd2 WatchSource:0}: Error finding container e20be5eee31fc546a5439983f17b478296269e7d5717279f89fffc21abc7dfd2: Status 404 returned error can't find the container with id e20be5eee31fc546a5439983f17b478296269e7d5717279f89fffc21abc7dfd2 Jun 10 19:16:01.486300 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:01.486215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" event={"ID":"cd9d55af-47e1-4385-86e4-2c4fe1702d5f","Type":"ContainerStarted","Data":"191648d4feb9069deffe763cc6d83f2869e90dc47ee6fc0504a304a54a1b279f"} Jun 10 19:16:01.486300 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:01.486267 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" event={"ID":"cd9d55af-47e1-4385-86e4-2c4fe1702d5f","Type":"ContainerStarted","Data":"e20be5eee31fc546a5439983f17b478296269e7d5717279f89fffc21abc7dfd2"} Jun 10 19:16:30.191346 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.191318 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" Jun 10 19:16:30.367786 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.367718 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kjb8\" (UniqueName: \"kubernetes.io/projected/226895de-07a8-44fa-925f-8fd482294317-kube-api-access-8kjb8\") pod \"226895de-07a8-44fa-925f-8fd482294317\" (UID: \"226895de-07a8-44fa-925f-8fd482294317\") " Jun 10 19:16:30.370163 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.370138 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226895de-07a8-44fa-925f-8fd482294317-kube-api-access-8kjb8" (OuterVolumeSpecName: "kube-api-access-8kjb8") pod "226895de-07a8-44fa-925f-8fd482294317" (UID: "226895de-07a8-44fa-925f-8fd482294317"). InnerVolumeSpecName "kube-api-access-8kjb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:16:30.469431 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.469401 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kjb8\" (UniqueName: \"kubernetes.io/projected/226895de-07a8-44fa-925f-8fd482294317-kube-api-access-8kjb8\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:16:30.628467 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.628385 2562 generic.go:356] "Generic (PLEG): container finished" podID="226895de-07a8-44fa-925f-8fd482294317" containerID="ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8" exitCode=137 Jun 10 19:16:30.628467 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.628429 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" Jun 10 19:16:30.628467 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.628459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" event={"ID":"226895de-07a8-44fa-925f-8fd482294317","Type":"ContainerDied","Data":"ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8"} Jun 10 19:16:30.628678 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.628501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j" event={"ID":"226895de-07a8-44fa-925f-8fd482294317","Type":"ContainerDied","Data":"1e7d10d0babb9291adc37473cc5e0994f712edacdd62d5b01f1d0c01e2be9d82"} Jun 10 19:16:30.628678 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.628522 2562 scope.go:117] "RemoveContainer" containerID="ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8" Jun 10 19:16:30.637006 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.636987 2562 scope.go:117] "RemoveContainer" containerID="ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8" Jun 10 19:16:30.637270 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:16:30.637246 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8\": container with ID starting with ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8 not found: ID does not exist" containerID="ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8" Jun 10 19:16:30.637341 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.637281 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8"} err="failed to get container status \"ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8\": rpc error: code = NotFound desc = could not find container \"ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8\": container with ID starting with ac156b82fe779d86ca0cf1d723bf301a2542cccf5a8223ac00c69af3131e5fc8 not found: ID does not exist" Jun 10 19:16:30.661675 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.661646 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j"] Jun 10 19:16:30.663632 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:30.663612 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29685315-h6f9j"] Jun 10 19:16:32.391405 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:32.391371 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="226895de-07a8-44fa-925f-8fd482294317" path="/var/lib/kubelet/pods/226895de-07a8-44fa-925f-8fd482294317/volumes" Jun 10 19:16:59.776893 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:59.776807 2562 generic.go:356] "Generic (PLEG): container finished" podID="cd9d55af-47e1-4385-86e4-2c4fe1702d5f" containerID="191648d4feb9069deffe763cc6d83f2869e90dc47ee6fc0504a304a54a1b279f" exitCode=0 Jun 10 19:16:59.776893 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:16:59.776856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" event={"ID":"cd9d55af-47e1-4385-86e4-2c4fe1702d5f","Type":"ContainerDied","Data":"191648d4feb9069deffe763cc6d83f2869e90dc47ee6fc0504a304a54a1b279f"} Jun 10 19:17:00.783014 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:00.782977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" event={"ID":"cd9d55af-47e1-4385-86e4-2c4fe1702d5f","Type":"ContainerStarted","Data":"cae6bb2e38bc8770997391d91690f625439dd8d7e7ee16ddd6663c11b7f154cf"} Jun 10 19:17:00.804119 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:00.804058 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" podStartSLOduration=2.436871559 podStartE2EDuration="1m0.804040458s" totalImagesPullingTime="192.159351ms" totalInitContainerRuntime="58.175009548s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:16:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:17:00.802802668 +0000 UTC m=+1078.870251032" watchObservedRunningTime="2026-06-10 19:17:00.804040458 +0000 UTC m=+1078.871488818" Jun 10 19:17:01.110931 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:01.110891 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:17:01.111128 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:01.110971 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:17:01.123717 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:01.123685 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:17:01.799495 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:01.799454 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d" Jun 10 19:17:31.937393 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:31.937357 2562 generic.go:356] "Generic (PLEG): container finished" podID="b9355691-4f9e-47e3-a99d-f24c115b667a" containerID="67de8fd1c5f56b8a21adfea26e93f6661be559915a49a149aa5ba78779e8ef45" exitCode=0 Jun 10 19:17:31.937900 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:31.937436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" event={"ID":"b9355691-4f9e-47e3-a99d-f24c115b667a","Type":"ContainerDied","Data":"67de8fd1c5f56b8a21adfea26e93f6661be559915a49a149aa5ba78779e8ef45"} Jun 10 19:17:32.944120 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:32.944081 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" event={"ID":"b9355691-4f9e-47e3-a99d-f24c115b667a","Type":"ContainerStarted","Data":"6bb44d50623c0267e636d419a773ccc3f16445c7f27836c8d64a378b9d867231"} Jun 10 19:17:32.966523 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:32.966475 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" podStartSLOduration=2.288940679 podStartE2EDuration="1m46.96645981s" totalImagesPullingTime="256.188846ms" totalInitContainerRuntime="1m44.421330285s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:15:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:17:32.96589703 +0000 UTC m=+1111.033345390" watchObservedRunningTime="2026-06-10 19:17:32.96645981 +0000 UTC m=+1111.033908171" Jun 10 19:17:37.109694 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:37.109653 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:17:37.110201 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:37.109737 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:17:37.122682 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:37.122656 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:17:37.978942 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:17:37.978907 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc" Jun 10 19:19:31.164241 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.164209 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f6888fc98-jpr26"] Jun 10 19:19:31.167165 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.164398 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7f6888fc98-jpr26" podUID="d83941f1-4a21-4988-8365-b6cb78fc0444" containerName="manager" containerID="cri-o://5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a" gracePeriod=30 Jun 10 19:19:31.413275 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.413250 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:19:31.437783 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.437677 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83941f1-4a21-4988-8365-b6cb78fc0444-webhook-cert\") pod \"d83941f1-4a21-4988-8365-b6cb78fc0444\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " Jun 10 19:19:31.437783 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.437740 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/d83941f1-4a21-4988-8365-b6cb78fc0444-kube-api-access-kcgh9\") pod \"d83941f1-4a21-4988-8365-b6cb78fc0444\" (UID: \"d83941f1-4a21-4988-8365-b6cb78fc0444\") " Jun 10 19:19:31.440218 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.440177 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d83941f1-4a21-4988-8365-b6cb78fc0444-kube-api-access-kcgh9" (OuterVolumeSpecName: "kube-api-access-kcgh9") pod "d83941f1-4a21-4988-8365-b6cb78fc0444" (UID: "d83941f1-4a21-4988-8365-b6cb78fc0444"). InnerVolumeSpecName "kube-api-access-kcgh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 19:19:31.440442 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.440408 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d83941f1-4a21-4988-8365-b6cb78fc0444-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d83941f1-4a21-4988-8365-b6cb78fc0444" (UID: "d83941f1-4a21-4988-8365-b6cb78fc0444"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 19:19:31.519413 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.519374 2562 generic.go:356] "Generic (PLEG): container finished" podID="d83941f1-4a21-4988-8365-b6cb78fc0444" containerID="5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a" exitCode=0 Jun 10 19:19:31.519579 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.519414 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6888fc98-jpr26" Jun 10 19:19:31.519579 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.519460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6888fc98-jpr26" event={"ID":"d83941f1-4a21-4988-8365-b6cb78fc0444","Type":"ContainerDied","Data":"5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a"} Jun 10 19:19:31.519579 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.519512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6888fc98-jpr26" event={"ID":"d83941f1-4a21-4988-8365-b6cb78fc0444","Type":"ContainerDied","Data":"414556ba3151842970b56987cce432a4b9b4c171691530ca050a473b262ff6a5"} Jun 10 19:19:31.519579 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.519538 2562 scope.go:117] "RemoveContainer" containerID="5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a" Jun 10 19:19:31.535010 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.534989 2562 scope.go:117] "RemoveContainer" containerID="5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a" Jun 10 19:19:31.535301 ip-10-0-143-108 kubenswrapper[2562]: E0610 19:19:31.535279 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a\": container with ID starting with 5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a not found: ID does not exist" containerID="5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a" Jun 10 19:19:31.535362 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.535309 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a"} err="failed to get container status \"5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a\": rpc error: code = NotFound desc = could not find container \"5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a\": container with ID starting with 5a4731304192b5381e2a8ab0ebe47afc374d3d8cfa295cbcbeb891b6ade5938a not found: ID does not exist" Jun 10 19:19:31.538674 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.538642 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcgh9\" (UniqueName: \"kubernetes.io/projected/d83941f1-4a21-4988-8365-b6cb78fc0444-kube-api-access-kcgh9\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:19:31.538809 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.538677 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d83941f1-4a21-4988-8365-b6cb78fc0444-webhook-cert\") on node \"ip-10-0-143-108.ec2.internal\" DevicePath \"\"" Jun 10 19:19:31.547115 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.547089 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f6888fc98-jpr26"] Jun 10 19:19:31.550581 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:31.550553 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f6888fc98-jpr26"] Jun 10 19:19:32.310811 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.310776 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f6888fc98-6g7fd"] Jun 10 19:19:32.311205 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.311159 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d83941f1-4a21-4988-8365-b6cb78fc0444" containerName="manager" Jun 10 19:19:32.311205 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.311170 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d83941f1-4a21-4988-8365-b6cb78fc0444" containerName="manager" Jun 10 19:19:32.311205 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.311189 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="226895de-07a8-44fa-925f-8fd482294317" containerName="cleanup" Jun 10 19:19:32.311205 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.311196 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="226895de-07a8-44fa-925f-8fd482294317" containerName="cleanup" Jun 10 19:19:32.311347 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.311267 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d83941f1-4a21-4988-8365-b6cb78fc0444" containerName="manager" Jun 10 19:19:32.311347 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.311281 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="226895de-07a8-44fa-925f-8fd482294317" containerName="cleanup" Jun 10 19:19:32.315724 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.315707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.319641 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.319618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-59xnt\"" Jun 10 19:19:32.319641 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.319636 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 19:19:32.319864 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.319666 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 19:19:32.323087 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.322982 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6888fc98-6g7fd"] Jun 10 19:19:32.345041 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.345012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53-webhook-cert\") pod \"maas-controller-7f6888fc98-6g7fd\" (UID: \"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53\") " pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.345195 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.345053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnmp2\" (UniqueName: \"kubernetes.io/projected/8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53-kube-api-access-bnmp2\") pod \"maas-controller-7f6888fc98-6g7fd\" (UID: \"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53\") " pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.391749 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.391712 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d83941f1-4a21-4988-8365-b6cb78fc0444" path="/var/lib/kubelet/pods/d83941f1-4a21-4988-8365-b6cb78fc0444/volumes" Jun 10 19:19:32.445668 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.445637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53-webhook-cert\") pod \"maas-controller-7f6888fc98-6g7fd\" (UID: \"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53\") " pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.445886 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.445683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnmp2\" (UniqueName: \"kubernetes.io/projected/8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53-kube-api-access-bnmp2\") pod \"maas-controller-7f6888fc98-6g7fd\" (UID: \"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53\") " pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.448255 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.448228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53-webhook-cert\") pod \"maas-controller-7f6888fc98-6g7fd\" (UID: \"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53\") " pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.457531 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.457501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnmp2\" (UniqueName: \"kubernetes.io/projected/8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53-kube-api-access-bnmp2\") pod \"maas-controller-7f6888fc98-6g7fd\" (UID: \"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53\") " pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.627391 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.627293 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:32.766660 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.766628 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f6888fc98-6g7fd"] Jun 10 19:19:32.771565 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:19:32.770016 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf8dd95_0e45_4eab_97a0_a4b2bdf1cc53.slice/crio-279c211cf33d34a222ac2f2b83074261b028be1f6e266b0e86435d633f729ed2 WatchSource:0}: Error finding container 279c211cf33d34a222ac2f2b83074261b028be1f6e266b0e86435d633f729ed2: Status 404 returned error can't find the container with id 279c211cf33d34a222ac2f2b83074261b028be1f6e266b0e86435d633f729ed2 Jun 10 19:19:32.772579 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:32.772559 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 19:19:33.532151 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:33.532060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6888fc98-6g7fd" event={"ID":"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53","Type":"ContainerStarted","Data":"c17eac3706cf0ed600138051b3b0123e0faf51f6c81ceac2318ef06658c9c91a"} Jun 10 19:19:33.532151 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:33.532116 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f6888fc98-6g7fd" event={"ID":"8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53","Type":"ContainerStarted","Data":"279c211cf33d34a222ac2f2b83074261b028be1f6e266b0e86435d633f729ed2"} Jun 10 19:19:33.532151 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:33.532147 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:19:33.550929 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:33.550882 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f6888fc98-6g7fd" podStartSLOduration=1.072171875 podStartE2EDuration="1.550867075s" totalImagesPullingTime="478.6952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:19:33.549357453 +0000 UTC m=+1231.616805814" watchObservedRunningTime="2026-06-10 19:19:33.550867075 +0000 UTC m=+1231.618315435" Jun 10 19:19:44.541690 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:19:44.541614 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f6888fc98-6g7fd" Jun 10 19:41:13.841653 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:13.841622 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66f6b98bc9-w7lbt_54a93f46-f6f3-45a9-89d4-6362ae2ff671/nginx/0.log" Jun 10 19:41:14.224437 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:14.224356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f6888fc98-6g7fd_8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53/manager/0.log" Jun 10 19:41:14.823274 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:14.823242 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-rjtgc_50dae548-1ce0-4865-92a6-7051a0cac042/copy-manifests/0.log" Jun 10 19:41:14.861705 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:14.861654 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-rjtgc_50dae548-1ce0-4865-92a6-7051a0cac042/manager/0.log" Jun 10 19:41:16.262164 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:16.262119 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-grrws_24ccb837-98df-4e98-8979-8b7d336bb6fb/manager/0.log" Jun 10 19:41:16.390299 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:16.390264 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m8lm7_ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d/manager/0.log" Jun 10 19:41:16.620903 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:16.620871 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vgvzj_595cf1ea-6f4f-4227-b79c-293b4d5cffcd/registry-server/0.log" Jun 10 19:41:16.968501 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:16.968406 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9fw25_0e8bd515-889c-48d7-afd0-395607c8d337/manager/0.log" Jun 10 19:41:17.339909 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:17.339877 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795h4bg6_af9499c3-c6f0-4c9f-bba2-38be8f677ef5/istio-proxy/0.log" Jun 10 19:41:17.851838 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:17.851810 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/1.log" Jun 10 19:41:17.975831 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:17.975748 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-t6fhs_fecd7005-98e9-447c-9651-82b7c55f946e/payload-pre-processing/0.log" Jun 10 19:41:18.556909 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:18.556879 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn_93a74f7d-7d85-4b02-a3e8-42e0aad58370/storage-initializer/0.log" Jun 10 19:41:18.565392 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:18.565361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ds5sn_93a74f7d-7d85-4b02-a3e8-42e0aad58370/main/0.log" Jun 10 19:41:18.816459 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:18.816378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s_161e5246-2505-4839-bed1-9ac0994fa026/main/0.log" Jun 10 19:41:18.823335 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:18.823310 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-l5x4s_161e5246-2505-4839-bed1-9ac0994fa026/storage-initializer/0.log" Jun 10 19:41:18.953330 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:18.953296 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc_b9355691-4f9e-47e3-a99d-f24c115b667a/storage-initializer/0.log" Jun 10 19:41:18.961343 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:18.961320 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cswmcc_b9355691-4f9e-47e3-a99d-f24c115b667a/main/0.log" Jun 10 19:41:19.080608 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:19.080503 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d_cd9d55af-47e1-4385-86e4-2c4fe1702d5f/storage-initializer/0.log" Jun 10 19:41:19.088284 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:19.088264 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-d4p2d_cd9d55af-47e1-4385-86e4-2c4fe1702d5f/main/0.log" Jun 10 19:41:26.898982 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:26.898937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5cl58_3180912b-789f-492d-8c91-28a8c3e3a18a/global-pull-secret-syncer/0.log" Jun 10 19:41:27.145902 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:27.145868 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pl8fh_2b4e812d-62e7-4e34-a568-46b0138fd224/konnectivity-agent/0.log" Jun 10 19:41:27.207373 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:27.207267 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-108.ec2.internal_95c1e9bf236acb5d2d1045ded4a3bd9b/haproxy/0.log" Jun 10 19:41:32.159394 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:32.159354 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-grrws_24ccb837-98df-4e98-8979-8b7d336bb6fb/manager/0.log" Jun 10 19:41:32.226211 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:32.226181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-m8lm7_ef5ce2aa-f4a6-4b21-a0ab-da38fa69e74d/manager/0.log" Jun 10 19:41:32.338119 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:32.338082 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vgvzj_595cf1ea-6f4f-4227-b79c-293b4d5cffcd/registry-server/0.log" Jun 10 19:41:32.514447 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:32.514326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9fw25_0e8bd515-889c-48d7-afd0-395607c8d337/manager/0.log" Jun 10 19:41:34.399117 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:34.399079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-khw75_8dcc4915-c7d6-42e6-b931-39345c372fe9/kube-state-metrics/0.log" Jun 10 19:41:34.422921 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:34.422893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-khw75_8dcc4915-c7d6-42e6-b931-39345c372fe9/kube-rbac-proxy-main/0.log" Jun 10 19:41:34.456713 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:34.456636 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-khw75_8dcc4915-c7d6-42e6-b931-39345c372fe9/kube-rbac-proxy-self/0.log" Jun 10 19:41:34.492879 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:34.492849 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6c8fcdbb6-z8blh_04730161-1e2f-4c64-9833-014dfa881167/metrics-server/0.log" Jun 10 19:41:34.771595 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:34.771560 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg5s6_c46ab8ff-6acf-44ef-8046-f44c15b855e5/node-exporter/0.log" Jun 10 19:41:34.800417 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:34.800389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg5s6_c46ab8ff-6acf-44ef-8046-f44c15b855e5/kube-rbac-proxy/0.log" Jun 10 19:41:34.831707 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:34.831676 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cg5s6_c46ab8ff-6acf-44ef-8046-f44c15b855e5/init-textfile/0.log" Jun 10 19:41:35.096361 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:35.096338 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1942bc76-099a-49b4-972b-0805b2c18943/prometheus/0.log" Jun 10 19:41:35.133398 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:35.133371 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1942bc76-099a-49b4-972b-0805b2c18943/config-reloader/0.log" Jun 10 19:41:35.163602 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:35.163577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1942bc76-099a-49b4-972b-0805b2c18943/thanos-sidecar/0.log" Jun 10 19:41:35.190749 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:35.190720 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1942bc76-099a-49b4-972b-0805b2c18943/kube-rbac-proxy-web/0.log" Jun 10 19:41:35.234945 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:35.234918 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1942bc76-099a-49b4-972b-0805b2c18943/kube-rbac-proxy/0.log" Jun 10 19:41:35.315328 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:35.315297 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1942bc76-099a-49b4-972b-0805b2c18943/kube-rbac-proxy-thanos/0.log" Jun 10 19:41:35.363511 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:35.363482 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1942bc76-099a-49b4-972b-0805b2c18943/init-config-reloader/0.log" Jun 10 19:41:38.683398 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.683360 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9"] Jun 10 19:41:38.686791 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.686740 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.689960 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.689940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wshmj\"/\"openshift-service-ca.crt\"" Jun 10 19:41:38.690066 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.689988 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wshmj\"/\"kube-root-ca.crt\"" Jun 10 19:41:38.691437 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.691416 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wshmj\"/\"default-dockercfg-c7vhw\"" Jun 10 19:41:38.697400 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.697377 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9"] Jun 10 19:41:38.734195 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.734163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-sys\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.734387 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.734225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-proc\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.734387 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.734280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-podres\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.734387 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.734324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxbh7\" (UniqueName: \"kubernetes.io/projected/3dbf1877-eb66-49c5-93c7-636d99a3381a-kube-api-access-rxbh7\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.734387 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.734354 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-lib-modules\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.835809 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.835736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-lib-modules\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.835994 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.835885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-sys\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.835994 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.835925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-proc\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.835994 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.835925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-lib-modules\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.835994 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.835946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-podres\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.836168 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.835999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxbh7\" (UniqueName: \"kubernetes.io/projected/3dbf1877-eb66-49c5-93c7-636d99a3381a-kube-api-access-rxbh7\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.836168 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.836022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-proc\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.836168 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.836021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-sys\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.836168 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.836047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3dbf1877-eb66-49c5-93c7-636d99a3381a-podres\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.852288 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.852250 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxbh7\" (UniqueName: \"kubernetes.io/projected/3dbf1877-eb66-49c5-93c7-636d99a3381a-kube-api-access-rxbh7\") pod \"perf-node-gather-daemonset-x7lc9\" (UID: \"3dbf1877-eb66-49c5-93c7-636d99a3381a\") " pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:38.998619 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:38.998530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:39.144203 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:39.144172 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9"] Jun 10 19:41:39.146329 ip-10-0-143-108 kubenswrapper[2562]: W0610 19:41:39.146300 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3dbf1877_eb66_49c5_93c7_636d99a3381a.slice/crio-6ef9fbd214682e3bc64b5760d050b7bc8e3b7b9ff1e8fd68f81ade50a6527ea4 WatchSource:0}: Error finding container 6ef9fbd214682e3bc64b5760d050b7bc8e3b7b9ff1e8fd68f81ade50a6527ea4: Status 404 returned error can't find the container with id 6ef9fbd214682e3bc64b5760d050b7bc8e3b7b9ff1e8fd68f81ade50a6527ea4 Jun 10 19:41:39.967787 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:39.967723 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" event={"ID":"3dbf1877-eb66-49c5-93c7-636d99a3381a","Type":"ContainerStarted","Data":"bd4ea9f33c5c49c49166b2afbface9750e2b876b4631870838ffcb68c22c0793"} Jun 10 19:41:39.968173 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:39.967795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" event={"ID":"3dbf1877-eb66-49c5-93c7-636d99a3381a","Type":"ContainerStarted","Data":"6ef9fbd214682e3bc64b5760d050b7bc8e3b7b9ff1e8fd68f81ade50a6527ea4"} Jun 10 19:41:39.968173 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:39.967825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:39.987241 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:39.987190 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" podStartSLOduration=1.987172378 podStartE2EDuration="1.987172378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:41:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:41:39.985883791 +0000 UTC m=+2558.053332153" watchObservedRunningTime="2026-06-10 19:41:39.987172378 +0000 UTC m=+2558.054620741" Jun 10 19:41:40.503074 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:40.503045 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zcfvt_31ad8ce2-1537-4248-a192-eb9e3809f811/dns/0.log" Jun 10 19:41:40.529170 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:40.529140 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zcfvt_31ad8ce2-1537-4248-a192-eb9e3809f811/kube-rbac-proxy/0.log" Jun 10 19:41:40.620773 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:40.620733 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpqdb_d6fb0ba9-c516-4d36-a553-8f69a952afb5/dns-node-resolver/0.log" Jun 10 19:41:41.240132 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:41.240094 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k94jc_26a8bf5d-2508-46d1-a298-a4218c71f472/node-ca/0.log" Jun 10 19:41:42.276185 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:42.276152 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795h4bg6_af9499c3-c6f0-4c9f-bba2-38be8f677ef5/istio-proxy/0.log" Jun 10 19:41:42.457462 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:42.457425 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/0.log" Jun 10 19:41:42.486399 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:42.486370 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/1.log" Jun 10 19:41:42.529772 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:42.529683 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-t6fhs_fecd7005-98e9-447c-9651-82b7c55f946e/payload-pre-processing/0.log" Jun 10 19:41:43.355630 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:43.355600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kjjjz_50978806-1026-408a-a68e-a7e3515cf0bf/serve-healthcheck-canary/0.log" Jun 10 19:41:44.017849 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:44.017822 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb8gd_df899bc2-0e43-460c-806e-3b6f114420f7/kube-rbac-proxy/0.log" Jun 10 19:41:44.043364 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:44.043337 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb8gd_df899bc2-0e43-460c-806e-3b6f114420f7/exporter/0.log" Jun 10 19:41:44.068112 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:44.068084 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kb8gd_df899bc2-0e43-460c-806e-3b6f114420f7/extractor/0.log" Jun 10 19:41:45.981311 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:45.981284 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wshmj/perf-node-gather-daemonset-x7lc9" Jun 10 19:41:46.415060 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:46.415026 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-66f6b98bc9-w7lbt_54a93f46-f6f3-45a9-89d4-6362ae2ff671/nginx/0.log" Jun 10 19:41:46.597015 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:46.596982 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f6888fc98-6g7fd_8cf8dd95-0e45-4eab-97a0-a4b2bdf1cc53/manager/0.log" Jun 10 19:41:46.886376 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:46.886334 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-rjtgc_50dae548-1ce0-4865-92a6-7051a0cac042/manager/0.log" Jun 10 19:41:46.905710 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:46.905682 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d769b9458-rjtgc_50dae548-1ce0-4865-92a6-7051a0cac042/copy-manifests/0.log" Jun 10 19:41:48.727232 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:48.727145 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fb85c7977-n4ww8_3980eccc-ca36-4b0e-aaef-c6d548475cfd/manager/0.log" Jun 10 19:41:48.755038 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:48.755007 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-86kc9_5f429cfa-205a-40ba-9e31-f090165b2249/openshift-lws-operator/0.log" Jun 10 19:41:51.626385 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:51.626312 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795h4bg6_af9499c3-c6f0-4c9f-bba2-38be8f677ef5/istio-proxy/0.log" Jun 10 19:41:51.744291 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:51.744253 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/0.log" Jun 10 19:41:51.786870 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:51.786794 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/1.log" Jun 10 19:41:51.809506 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:51.809475 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-t6fhs_fecd7005-98e9-447c-9651-82b7c55f946e/payload-pre-processing/0.log" Jun 10 19:41:52.966155 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:52.966127 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795h4bg6_af9499c3-c6f0-4c9f-bba2-38be8f677ef5/istio-proxy/0.log" Jun 10 19:41:53.087078 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:53.087046 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/0.log" Jun 10 19:41:53.117616 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:53.117585 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/1.log" Jun 10 19:41:53.139150 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:53.139121 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-t6fhs_fecd7005-98e9-447c-9651-82b7c55f946e/payload-pre-processing/0.log" Jun 10 19:41:54.902633 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:54.902601 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795h4bg6_af9499c3-c6f0-4c9f-bba2-38be8f677ef5/istio-proxy/0.log" Jun 10 19:41:55.042394 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:55.042360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/0.log" Jun 10 19:41:55.073204 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:55.073175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-csnqm_234bf02c-83cd-401c-848c-ed1461b4d5b0/istio-proxy/1.log" Jun 10 19:41:55.104743 ip-10-0-143-108 kubenswrapper[2562]: I0610 19:41:55.104715 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-t6fhs_fecd7005-98e9-447c-9651-82b7c55f946e/payload-pre-processing/0.log"