Jun 05 03:15:42.501080 ip-10-0-141-163 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 03:15:42.501095 ip-10-0-141-163 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 03:15:42.501105 ip-10-0-141-163 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 03:15:42.501323 ip-10-0-141-163 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 03:15:52.615443 ip-10-0-141-163 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 03:15:52.615464 ip-10-0-141-163 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1b13e529bc484d159e0b3fe9dd98dc50 -- Jun 05 03:18:30.711573 ip-10-0-141-163 systemd[1]: Starting Kubernetes Kubelet... Jun 05 03:18:31.127964 ip-10-0-141-163 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:18:31.127964 ip-10-0-141-163 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 03:18:31.127964 ip-10-0-141-163 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:18:31.127964 ip-10-0-141-163 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 03:18:31.127964 ip-10-0-141-163 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 03:18:31.129093 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.128014 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 03:18:31.133128 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133113 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:18:31.133128 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133127 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:18:31.133128 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133131 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133134 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133138 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133141 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133143 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133146 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133150 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133153 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133155 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133158 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133161 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133165 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133169 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133172 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133175 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133178 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133184 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133188 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133191 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:18:31.133219 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133193 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133196 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133198 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133201 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133204 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133207 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133210 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133212 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133215 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133217 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133220 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133223 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133226 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133229 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133232 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133235 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133237 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133240 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133242 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133245 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:18:31.133726 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133247 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133249 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133252 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133254 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133257 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133259 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133262 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133264 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133268 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133271 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133273 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133276 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133278 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133281 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133285 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133288 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133290 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133294 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133298 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133301 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:18:31.134203 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133304 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133307 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133309 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133325 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133328 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133331 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133333 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133336 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133339 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133341 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133344 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133346 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133349 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133352 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133354 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133357 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133359 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133362 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133365 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:18:31.134713 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133369 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133372 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133374 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133377 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133380 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133382 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133384 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133388 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133391 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133394 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133396 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133399 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133401 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133404 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133408 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133412 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133415 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133418 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.133421 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134091 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:18:31.135168 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134098 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134101 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134105 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134108 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134110 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134113 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134116 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134118 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134121 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134123 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134128 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134131 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134135 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134138 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134141 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134143 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134146 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134149 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134151 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134155 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:18:31.135668 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134158 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134161 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134164 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134166 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134169 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134172 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134174 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134177 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134179 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134182 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134185 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134187 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134190 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134192 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134195 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134198 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134200 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134202 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134205 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134208 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:18:31.136205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134211 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134214 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134217 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134219 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134222 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134225 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134228 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134230 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134233 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134235 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134238 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134242 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134244 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134247 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134250 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134252 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134255 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134257 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134260 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134263 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:18:31.136722 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134265 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134268 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134270 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134273 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134276 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134278 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134281 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134283 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134286 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134288 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134291 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134294 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134297 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134301 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134303 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134306 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134308 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134311 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134329 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:18:31.137227 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134332 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134334 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134338 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134341 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134345 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134348 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134351 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134353 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134356 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134359 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134361 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134364 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134366 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134369 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134371 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134375 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134379 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134382 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134385 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:18:31.137733 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134732 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134737 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134740 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134742 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134745 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134748 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134752 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134755 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134758 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134764 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134767 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134769 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134773 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134776 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134779 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134782 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134785 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134789 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134792 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:18:31.138207 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134795 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134798 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134801 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134803 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134806 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134809 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134811 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134814 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134816 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134820 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134824 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134827 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134830 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134833 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134836 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134839 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134841 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134844 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:18:31.138683 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134847 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134849 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134852 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134855 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134859 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134861 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134865 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134868 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134870 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134873 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134876 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134879 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134882 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134884 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134887 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134890 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134892 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134895 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134897 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134900 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:18:31.139118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134902 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134905 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134907 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134910 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134912 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134915 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134917 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134920 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134922 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134925 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134928 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134931 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134933 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134936 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134938 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134941 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134948 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134950 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134953 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:18:31.139648 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134956 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134958 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134961 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134964 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134966 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134969 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134971 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134974 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134976 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134979 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134981 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134984 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134986 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134988 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134991 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134993 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134996 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.134998 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.135001 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.135003 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:18:31.140118 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.135006 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.135009 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.135014 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135082 2552 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135089 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135094 2552 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135098 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135102 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135105 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135110 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135115 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135118 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135121 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135125 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135128 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135132 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135135 2552 flags.go:64] FLAG: --cgroup-root="" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135138 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135142 2552 flags.go:64] FLAG: --client-ca-file="" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135144 2552 flags.go:64] FLAG: --cloud-provider="external" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135147 2552 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135151 2552 flags.go:64] FLAG: --cluster-domain="" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135154 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135157 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 03:18:31.140647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135160 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135164 2552 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135171 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135174 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135177 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135181 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135184 2552 flags.go:64] FLAG: --contention-profiling="false" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135187 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135189 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135192 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135196 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135200 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135203 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135206 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135209 2552 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135212 2552 flags.go:64] FLAG: --enable-server="true" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135215 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135611 2552 flags.go:64] FLAG: --event-burst="100" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135614 2552 flags.go:64] FLAG: --event-qps="50" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135617 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135621 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135624 2552 flags.go:64] FLAG: --eviction-hard="" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135627 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135630 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135634 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 03:18:31.141230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135637 2552 flags.go:64] FLAG: --eviction-soft="" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135640 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135643 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135646 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135649 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135652 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135654 2552 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135657 2552 flags.go:64] FLAG: --feature-gates="" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135661 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135664 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135667 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135670 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135673 2552 flags.go:64] FLAG: --healthz-port="10248" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135676 2552 flags.go:64] FLAG: --help="false" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135679 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135682 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135685 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135689 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135693 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135696 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135699 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135702 2552 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135704 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 03:18:31.141927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135707 2552 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135710 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135714 2552 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135716 2552 flags.go:64] FLAG: --kube-reserved="" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135720 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135723 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135726 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135728 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135731 2552 flags.go:64] FLAG: --lock-file="" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135735 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135738 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135741 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135746 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135749 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135751 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135754 2552 flags.go:64] FLAG: --logging-format="text" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135756 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135760 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135762 2552 flags.go:64] FLAG: --manifest-url="" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135765 2552 flags.go:64] FLAG: --manifest-url-header="" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135769 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135772 2552 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135776 2552 flags.go:64] FLAG: --max-pods="110" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135779 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135782 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 03:18:31.142552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135784 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135789 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135792 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135795 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135798 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135804 2552 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135807 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135810 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135814 2552 flags.go:64] FLAG: --pod-cidr="" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135816 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135822 2552 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135825 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135828 2552 flags.go:64] FLAG: --pods-per-core="0" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135831 2552 flags.go:64] FLAG: --port="10250" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135834 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135837 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b8af6f057db43b8f" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135840 2552 flags.go:64] FLAG: --qos-reserved="" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135845 2552 flags.go:64] FLAG: --read-only-port="10255" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135848 2552 flags.go:64] FLAG: --register-node="true" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135851 2552 flags.go:64] FLAG: --register-with-taints="" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135855 2552 flags.go:64] FLAG: --registry-burst="10" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135858 2552 flags.go:64] FLAG: --registry-qps="5" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135860 2552 flags.go:64] FLAG: --reserved-cpus="" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135863 2552 flags.go:64] FLAG: --reserved-memory="" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135866 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 03:18:31.143167 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135869 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135872 2552 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135875 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135878 2552 flags.go:64] FLAG: --runonce="false" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135880 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135884 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135886 2552 flags.go:64] FLAG: --seccomp-default="false" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135889 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135892 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135896 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135899 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135902 2552 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135905 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135908 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135911 2552 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135914 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135917 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135920 2552 flags.go:64] FLAG: --system-cgroups="" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135922 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135927 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135930 2552 flags.go:64] FLAG: --tls-cert-file="" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135933 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135938 2552 flags.go:64] FLAG: --tls-min-version="" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135940 2552 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135943 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 03:18:31.143835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135946 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135949 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135952 2552 flags.go:64] FLAG: --v="2" Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135956 2552 flags.go:64] FLAG: --version="false" Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135960 2552 flags.go:64] FLAG: --vmodule="" Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135963 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.135966 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136082 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136086 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136089 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136092 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136097 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136100 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136104 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136106 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136109 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136114 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136117 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136119 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136122 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136125 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:18:31.144533 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136127 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136131 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136134 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136137 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136139 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136142 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136145 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136147 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136150 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136152 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136155 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136158 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136161 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136164 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136166 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136169 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136171 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136174 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136176 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:18:31.145065 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136179 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136181 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136184 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136186 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136189 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136191 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136194 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136197 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136200 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136203 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136205 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136208 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136211 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136214 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136218 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136221 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136223 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136226 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136228 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:18:31.145552 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136231 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136233 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136236 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136238 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136241 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136244 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136247 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136250 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136252 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136255 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136258 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136261 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136265 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136267 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136270 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136272 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136275 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136277 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136280 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136282 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:18:31.146017 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136285 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136288 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136291 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136294 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136296 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136299 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136301 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136305 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136308 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136310 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136327 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136331 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136335 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136339 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136343 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136346 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136348 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136351 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136353 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136356 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:18:31.146596 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136359 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136362 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136365 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136367 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136370 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136372 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.136376 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.136882 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.142888 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.142902 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.142915 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.142921 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142974 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142978 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:18:31.147096 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142982 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142985 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142988 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142991 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142994 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.142997 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143000 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143003 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143006 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143009 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143012 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143015 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143018 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143021 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143023 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143027 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143030 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143033 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143036 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143039 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:18:31.147474 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143041 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143044 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143046 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143049 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143052 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143054 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143057 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143061 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143064 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143067 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143069 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143072 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143074 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143077 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143080 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143082 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143085 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143087 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143090 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143092 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:18:31.147972 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143095 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143097 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143100 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143103 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143105 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143108 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143110 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143113 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143115 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143118 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143122 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143125 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143128 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143131 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143134 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143138 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143141 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143144 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143146 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:18:31.148492 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143150 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143153 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143155 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143158 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143160 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143163 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143166 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143168 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143171 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143174 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143177 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143179 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143182 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143184 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143187 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143190 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143192 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143195 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143197 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:18:31.148971 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143200 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143202 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143205 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143208 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143210 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143213 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143215 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143218 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143220 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143223 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143226 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143228 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143231 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143234 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143236 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143239 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143242 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143245 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:18:31.149479 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143247 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.143252 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143372 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143377 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143380 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143383 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143387 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143389 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143392 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143395 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143398 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143401 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143404 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143406 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 03:18:31.149917 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143409 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143412 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143416 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143419 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143422 2552 feature_gate.go:328] unrecognized feature gate: Example Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143425 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143428 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143431 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143434 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143437 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143440 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143443 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143445 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143449 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143452 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143454 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143457 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143460 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143463 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143465 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 03:18:31.150262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143468 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143470 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143473 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143475 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143478 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143480 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143482 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143485 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143487 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143490 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143493 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143495 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143497 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143500 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143502 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143505 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143507 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143510 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143513 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 03:18:31.150906 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143517 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143520 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143522 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143525 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143527 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143529 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143532 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143535 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143537 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143540 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143543 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143546 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143548 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143551 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143553 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143557 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143560 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143563 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143566 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 03:18:31.151628 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143569 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143572 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143575 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143577 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143579 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143582 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143585 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143587 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143590 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143592 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143595 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143597 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143600 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143602 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143605 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143607 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143610 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143612 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143615 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143617 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 03:18:31.152088 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143620 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143623 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143625 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143628 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143631 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143633 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143636 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143638 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:31.143641 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.143645 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.143742 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.145812 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.147192 2552 server.go:1019] "Starting client certificate rotation" Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.147292 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 03:18:31.152736 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.147346 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 03:18:31.154120 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.154104 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 03:18:31.155218 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.155203 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 03:18:31.172477 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.172458 2552 log.go:25] "Validated CRI v1 runtime API" Jun 05 03:18:31.174693 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.174679 2552 log.go:25] "Validated CRI v1 image API" Jun 05 03:18:31.175563 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.175544 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 03:18:31.178773 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.178750 2552 fs.go:135] Filesystem UUIDs: map[1dfa1be3-69fd-4fa8-8fce-cbb414097cb8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b5c25e8f-fc34-4b90-80e2-4261a1a22bdd:/dev/nvme0n1p4] Jun 05 03:18:31.178836 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.178776 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 03:18:31.180657 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.180641 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 03:18:31.183981 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.183874 2552 manager.go:216] Machine: {Timestamp:2026-06-05 03:18:31.182625304 +0000 UTC m=+0.353135398 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095847 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c979531e416ce9a08658798a6a807 SystemUUID:ec2c9795-31e4-16ce-9a08-658798a6a807 BootID:1b13e529-bc48-4d15-9e0b-3fe9dd98dc50 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4d:51:cb:eb:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4d:51:cb:eb:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:4e:af:b1:4c:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 03:18:31.183981 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.183979 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 03:18:31.184093 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.184073 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 03:18:31.186750 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.186723 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 03:18:31.186871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.186754 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 03:18:31.187600 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.187590 2552 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 03:18:31.187636 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.187604 2552 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 03:18:31.187636 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.187611 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 03:18:31.188463 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.188453 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 03:18:31.189229 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.189219 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 03:18:31.192071 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192060 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 05 03:18:31.192178 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192169 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 03:18:31.192210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192198 2552 kubelet.go:486] "Attempting to sync node with API server" Jun 05 03:18:31.192240 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192212 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 03:18:31.192240 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192236 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 03:18:31.192290 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192251 2552 kubelet.go:398] "Adding apiserver pod source" Jun 05 03:18:31.192290 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192264 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 03:18:31.192594 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192583 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 03:18:31.192644 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.192601 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 03:18:31.195448 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.195427 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 03:18:31.197042 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.197027 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 03:18:31.197102 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.197057 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 03:18:31.198144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198131 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198148 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198155 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198160 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198168 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198174 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198181 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198186 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198193 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198198 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198206 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 03:18:31.198211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.198211 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 03:18:31.199034 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.199025 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 03:18:31.199034 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.199034 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 03:18:31.202118 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.202105 2552 server.go:1268] "Started kubelet" Jun 05 03:18:31.202266 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.202212 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 03:18:31.202666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.202370 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 03:18:31.202666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.202446 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 03:18:31.202993 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.202962 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-163.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 03:18:31.203078 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.203055 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 03:18:31.203046 ip-10-0-141-163 systemd[1]: Started Kubernetes Kubelet. Jun 05 03:18:31.203537 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.203087 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 03:18:31.203537 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.203506 2552 server.go:310] "Adding debug handlers to kubelet server" Jun 05 03:18:31.204204 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.204187 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 03:18:31.205310 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.205293 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jb9cn" Jun 05 03:18:31.207434 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.207408 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 03:18:31.207636 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.206630 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-163.ec2.internal.18b6111b33c708ef default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-163.ec2.internal,UID:ip-10-0-141-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-163.ec2.internal,},FirstTimestamp:2026-06-05 03:18:31.202081007 +0000 UTC m=+0.372591099,LastTimestamp:2026-06-05 03:18:31.202081007 +0000 UTC m=+0.372591099,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-163.ec2.internal,}" Jun 05 03:18:31.209942 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.209925 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 03:18:31.209942 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.209938 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 03:18:31.210066 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.210047 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.210469 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.210449 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 03:18:31.210469 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.210452 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 03:18:31.210591 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.210486 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 03:18:31.210591 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.210589 2552 reconstruct.go:97] "Volume reconstruction finished" Jun 05 03:18:31.210722 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.210617 2552 reconciler.go:29] "Reconciler: start to sync state" Jun 05 03:18:31.210874 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.210858 2552 factory.go:55] Registering systemd factory Jun 05 03:18:31.210874 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.210876 2552 factory.go:223] Registration of the systemd container factory successfully Jun 05 03:18:31.211140 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.211126 2552 factory.go:153] Registering CRI-O factory Jun 05 03:18:31.211205 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.211142 2552 factory.go:223] Registration of the crio container factory successfully Jun 05 03:18:31.211205 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.211188 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 03:18:31.211302 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.211217 2552 factory.go:103] Registering Raw factory Jun 05 03:18:31.211302 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.211229 2552 manager.go:1196] Started watching for new ooms in manager Jun 05 03:18:31.211899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.211791 2552 manager.go:349] Starting recovery of all containers Jun 05 03:18:31.212788 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.212767 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jb9cn" Jun 05 03:18:31.221675 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.221637 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 03:18:31.221675 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.221631 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 03:18:31.225134 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.225116 2552 manager.go:354] Recovery completed Jun 05 03:18:31.229044 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.229032 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:18:31.230981 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.230955 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:18:31.231036 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.230990 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:18:31.231036 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.231004 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:18:31.231471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.231459 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 03:18:31.231533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.231468 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:18:31.231533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.231470 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 03:18:31.231533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.231506 2552 state_mem.go:36] "Initialized new in-memory state store" Jun 05 03:18:31.232172 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.232156 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:18:31.232229 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.232182 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:18:31.232229 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.232195 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:18:31.232516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.232506 2552 policy_none.go:49] "None policy: Start" Jun 05 03:18:31.232548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.232521 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 03:18:31.232548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.232538 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 03:18:31.233515 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.233505 2552 policy_none.go:47] "Start" Jun 05 03:18:31.271838 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.271826 2552 manager.go:337] "Starting Device Plugin manager" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.271856 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.271868 2552 server.go:87] "Starting device plugin registration server" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.272058 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.272071 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.272154 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.272223 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.272233 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.272708 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.272755 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.284051 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.285156 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.285198 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.285219 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.285281 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 03:18:31.288725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.287049 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:18:31.372811 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.372789 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:18:31.373577 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.373563 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:18:31.373647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.373588 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:18:31.373647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.373600 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:18:31.373647 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.373624 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.381020 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.380982 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.381020 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.381002 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-163.ec2.internal\": node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.385827 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.385807 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal"] Jun 05 03:18:31.385898 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.385858 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:18:31.386483 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.386469 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:18:31.386555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.386492 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:18:31.386555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.386514 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:18:31.387709 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.387697 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:18:31.387845 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.387828 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.387896 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.387856 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:18:31.388415 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.388399 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:18:31.388481 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.388423 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:18:31.388481 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.388439 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:18:31.388831 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.388818 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:18:31.388870 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.388843 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:18:31.388908 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.388869 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:18:31.389488 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.389475 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.389549 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.389496 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 03:18:31.390171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.390156 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientMemory" Jun 05 03:18:31.390259 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.390184 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 03:18:31.390259 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.390197 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeHasSufficientPID" Jun 05 03:18:31.396715 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.396702 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.411925 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.411911 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77c0e0ff4c2137e13db318bee13380ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal\" (UID: \"77c0e0ff4c2137e13db318bee13380ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.412003 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.411932 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77c0e0ff4c2137e13db318bee13380ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal\" (UID: \"77c0e0ff4c2137e13db318bee13380ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.412003 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.411949 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c44bd4a09b4e406135cc261d566b38-config\") pod \"kube-apiserver-proxy-ip-10-0-141-163.ec2.internal\" (UID: \"49c44bd4a09b4e406135cc261d566b38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.413825 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.413809 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-163.ec2.internal\" not found" node="ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.417963 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.417949 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-163.ec2.internal\" not found" node="ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.497504 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.497480 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.512204 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.512183 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77c0e0ff4c2137e13db318bee13380ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal\" (UID: \"77c0e0ff4c2137e13db318bee13380ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.512276 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.512209 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77c0e0ff4c2137e13db318bee13380ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal\" (UID: \"77c0e0ff4c2137e13db318bee13380ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.512276 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.512224 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c44bd4a09b4e406135cc261d566b38-config\") pod \"kube-apiserver-proxy-ip-10-0-141-163.ec2.internal\" (UID: \"49c44bd4a09b4e406135cc261d566b38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.512276 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.512263 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49c44bd4a09b4e406135cc261d566b38-config\") pod \"kube-apiserver-proxy-ip-10-0-141-163.ec2.internal\" (UID: \"49c44bd4a09b4e406135cc261d566b38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.512392 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.512272 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/77c0e0ff4c2137e13db318bee13380ab-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal\" (UID: \"77c0e0ff4c2137e13db318bee13380ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.512392 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.512300 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/77c0e0ff4c2137e13db318bee13380ab-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal\" (UID: \"77c0e0ff4c2137e13db318bee13380ab\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.598373 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.598352 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.699075 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.699026 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.717594 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.717576 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.722837 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:31.722821 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" Jun 05 03:18:31.799341 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.799306 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:31.899844 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:31.899822 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:32.000349 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:32.000288 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:32.041969 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.041947 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:18:32.100567 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:32.100542 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:32.146994 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.146974 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 03:18:32.147552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.147124 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 03:18:32.147552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.147142 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 03:18:32.201439 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:32.201415 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:32.220329 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.220286 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 03:13:31 +0000 UTC" deadline="2028-03-22 00:41:18.190619478 +0000 UTC" Jun 05 03:18:32.220329 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.220326 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15741h22m45.97030928s" Jun 05 03:18:32.223328 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:32.223293 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c44bd4a09b4e406135cc261d566b38.slice/crio-d557d4ff019ce4f52a4e7747fd13c07d7e43f9a99c8546025eb13f4009963d3e WatchSource:0}: Error finding container d557d4ff019ce4f52a4e7747fd13c07d7e43f9a99c8546025eb13f4009963d3e: Status 404 returned error can't find the container with id d557d4ff019ce4f52a4e7747fd13c07d7e43f9a99c8546025eb13f4009963d3e Jun 05 03:18:32.223861 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:32.223842 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c0e0ff4c2137e13db318bee13380ab.slice/crio-0be0a4fef457de031e2d8d47b407f6e2c418f2e76a6948a26c2c118a12610d4f WatchSource:0}: Error finding container 0be0a4fef457de031e2d8d47b407f6e2c418f2e76a6948a26c2c118a12610d4f: Status 404 returned error can't find the container with id 0be0a4fef457de031e2d8d47b407f6e2c418f2e76a6948a26c2c118a12610d4f Jun 05 03:18:32.228077 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.228061 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:18:32.288728 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.288621 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" event={"ID":"77c0e0ff4c2137e13db318bee13380ab","Type":"ContainerStarted","Data":"0be0a4fef457de031e2d8d47b407f6e2c418f2e76a6948a26c2c118a12610d4f"} Jun 05 03:18:32.289610 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.289590 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" event={"ID":"49c44bd4a09b4e406135cc261d566b38","Type":"ContainerStarted","Data":"d557d4ff019ce4f52a4e7747fd13c07d7e43f9a99c8546025eb13f4009963d3e"} Jun 05 03:18:32.301760 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:32.301748 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:32.402221 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:32.402195 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:32.502737 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:32.502716 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-163.ec2.internal\" not found" Jun 05 03:18:32.555071 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.555054 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:18:32.591996 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.591975 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:18:32.610523 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.610504 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" Jun 05 03:18:32.619162 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.619142 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 03:18:32.620221 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.620207 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" Jun 05 03:18:32.629392 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:32.629377 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 03:18:33.139638 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.139606 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:18:33.193459 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.193427 2552 apiserver.go:52] "Watching apiserver" Jun 05 03:18:33.198570 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.198547 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 03:18:33.198941 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.198919 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal","openshift-multus/multus-additional-cni-plugins-mhhpl","openshift-multus/network-metrics-daemon-vxwwt","openshift-network-diagnostics/network-check-target-9qmp9","openshift-network-operator/iptables-alerter-78qpf","openshift-ovn-kubernetes/ovnkube-node-lqh2n","kube-system/global-pull-secret-syncer-n4pkr","kube-system/konnectivity-agent-8bdvk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng","openshift-cluster-node-tuning-operator/tuned-4n54t","openshift-dns/node-resolver-x285n","openshift-image-registry/node-ca-q4x7f","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal","openshift-multus/multus-j99r4"] Jun 05 03:18:33.200246 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.200229 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.200339 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.200298 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:33.201096 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.201079 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.202200 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.202178 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:33.202328 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.202265 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:33.203271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.203250 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:33.203396 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.203311 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:33.203723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.203679 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6pxmz\"" Jun 05 03:18:33.203723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.203697 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 03:18:33.203723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.203699 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 03:18:33.205486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.205468 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.206817 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.206797 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.207540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.207423 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:18:33.207540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.207494 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 03:18:33.207540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.207518 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jkk94\"" Jun 05 03:18:33.207764 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.207604 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 03:18:33.208036 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.208018 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.209116 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.209097 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 03:18:33.209233 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.209212 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c8xwx\"" Jun 05 03:18:33.209398 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.209380 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 03:18:33.209547 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.209514 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.209623 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.209578 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 03:18:33.209623 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.209589 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 03:18:33.209829 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.209812 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 03:18:33.210199 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.210182 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 03:18:33.210285 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.210203 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 03:18:33.210376 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.210304 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rcgrj\"" Jun 05 03:18:33.210376 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.210348 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 03:18:33.210492 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.210376 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 03:18:33.210492 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.210426 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 03:18:33.210815 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.210797 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.212121 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.211879 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 03:18:33.212121 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.211943 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 03:18:33.212492 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.212462 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-94rqg\"" Jun 05 03:18:33.212580 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.212505 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 03:18:33.213113 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.213005 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 03:18:33.213113 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.213047 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 03:18:33.213236 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.213222 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.213457 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.213438 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 03:18:33.213948 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.213846 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tfhtr\"" Jun 05 03:18:33.215428 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.214676 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.215696 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.215601 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jqz75\"" Jun 05 03:18:33.215783 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.215702 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:18:33.215840 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.215807 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 03:18:33.216876 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.216700 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.217825 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.217093 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9rqfs\"" Jun 05 03:18:33.217825 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.217484 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 03:18:33.217825 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.217500 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 03:18:33.219058 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.219027 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-brh57\"" Jun 05 03:18:33.219177 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.219032 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 03:18:33.219283 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.219266 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 03:18:33.219426 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.219409 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 03:18:33.220535 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220514 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-netns\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.220667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-ovnkube-script-lib\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.220667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-os-release\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.220750 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbbe0096-2d99-46fc-9b90-d702bee8c185-tmp-dir\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.220750 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220689 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-cnibin\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.220750 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220705 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.220750 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220720 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-etc-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.220957 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220757 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.220957 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220791 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-dbus\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.220957 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220826 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-cni-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.220957 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220856 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-socket-dir-parent\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.220957 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220882 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cnibin\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.220957 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220919 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbbe0096-2d99-46fc-9b90-d702bee8c185-hosts-file\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.220957 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220942 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-hostroot\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.220980 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221004 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ppt\" (UniqueName: \"kubernetes.io/projected/080e95bc-53d2-476e-bd90-1f99cb0e5d09-kube-api-access-l4ppt\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221042 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-slash\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221132 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-run-ovn-kubernetes\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221155 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221209 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-systemd-units\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221228 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-ovnkube-config\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221243 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-run-netns\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221261 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-ovn\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221283 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5v4t\" (UniqueName: \"kubernetes.io/projected/fbbe0096-2d99-46fc-9b90-d702bee8c185-kube-api-access-g5v4t\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221297 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-etc-kubernetes\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221326 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-var-lib-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221376 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-socket-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221403 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-device-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221433 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-multus-certs\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-kubelet-config\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-log-socket\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/834d365e-26ff-4455-b7b6-7200e03cb122-ovn-node-metrics-cert\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221521 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221544 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221567 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221583 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbd2r\" (UniqueName: \"kubernetes.io/projected/834d365e-26ff-4455-b7b6-7200e03cb122-kube-api-access-wbd2r\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221601 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-system-cni-dir\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.221729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221622 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-cni-bin\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221635 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-conf-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221648 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eacca558-5359-4b40-8c90-a2f87bf381db-host-slash\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221703 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-cni-bin\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221736 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26z98\" (UniqueName: \"kubernetes.io/projected/7de15610-11db-48dc-8114-81f80c724160-kube-api-access-26z98\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221756 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-system-cni-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221801 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221838 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-sys-fs\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221863 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvdhk\" (UniqueName: \"kubernetes.io/projected/dca91cdc-0ecd-49e0-925d-b3df21b832f6-kube-api-access-qvdhk\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221899 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-cni-binary-copy\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221920 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-cni-netd\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221960 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-env-overrides\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.221988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-kubelet\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-kubelet\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222044 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-registration-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.222486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222070 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222095 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-k8s-cni-cncf-io\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222118 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpch8\" (UniqueName: \"kubernetes.io/projected/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-kube-api-access-dpch8\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222141 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-systemd\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222162 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-node-log\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222182 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222200 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-os-release\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222218 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-cni-multus\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222252 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-daemon-config\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222268 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eacca558-5359-4b40-8c90-a2f87bf381db-iptables-alerter-script\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.223296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.222286 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmhhd\" (UniqueName: \"kubernetes.io/projected/eacca558-5359-4b40-8c90-a2f87bf381db-kube-api-access-jmhhd\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.242532 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.242512 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mhnq6" Jun 05 03:18:33.254611 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.254594 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mhnq6" Jun 05 03:18:33.311412 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.311388 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 03:18:33.322846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cnibin\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.322959 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322861 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-serviceca\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.322959 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322888 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbbe0096-2d99-46fc-9b90-d702bee8c185-hosts-file\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.322959 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-hostroot\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.322959 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:33.322959 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322946 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cnibin\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.323210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322977 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-hostroot\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.323210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322993 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fbbe0096-2d99-46fc-9b90-d702bee8c185-hosts-file\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.323210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.322991 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ppt\" (UniqueName: \"kubernetes.io/projected/080e95bc-53d2-476e-bd90-1f99cb0e5d09-kube-api-access-l4ppt\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:33.323210 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.323052 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:33.323210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323054 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-slash\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323497 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323249 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-slash\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323557 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323526 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-run-ovn-kubernetes\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323611 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.323562 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs podName:080e95bc-53d2-476e-bd90-1f99cb0e5d09 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:33.823544108 +0000 UTC m=+2.994054190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs") pod "network-metrics-daemon-vxwwt" (UID: "080e95bc-53d2-476e-bd90-1f99cb0e5d09") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:33.323611 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323578 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-run-ovn-kubernetes\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323715 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323617 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.323715 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysconfig\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.323715 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323671 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-systemd-units\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323715 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323695 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-ovnkube-config\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysctl-conf\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.323899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323745 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-run-netns\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323747 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-systemd-units\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-ovn\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323827 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.323899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323876 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-ovn\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.323899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-run-netns\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323909 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-run\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323939 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5v4t\" (UniqueName: \"kubernetes.io/projected/fbbe0096-2d99-46fc-9b90-d702bee8c185-kube-api-access-g5v4t\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.323963 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-etc-kubernetes\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324007 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-etc-kubernetes\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324009 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-var-lib-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324041 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-socket-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324059 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-device-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-kubernetes\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324107 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-multus-certs\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-kubelet-config\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324171 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-var-lib-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324159 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-device-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324216 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-multus-certs\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324248 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-log-socket\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324257 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-ovnkube-config\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/834d365e-26ff-4455-b7b6-7200e03cb122-ovn-node-metrics-cert\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324299 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324311 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-log-socket\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-systemd\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324328 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-kubelet-config\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324331 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-socket-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324462 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbd2r\" (UniqueName: \"kubernetes.io/projected/834d365e-26ff-4455-b7b6-7200e03cb122-kube-api-access-wbd2r\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324483 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324485 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-system-cni-dir\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324543 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-lib-modules\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324569 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-cni-bin\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.324660 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324595 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-conf-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324620 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eacca558-5359-4b40-8c90-a2f87bf381db-host-slash\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324627 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324653 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324691 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-cni-bin\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324707 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-conf-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26z98\" (UniqueName: \"kubernetes.io/projected/7de15610-11db-48dc-8114-81f80c724160-kube-api-access-26z98\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324738 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324749 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-system-cni-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324781 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/eacca558-5359-4b40-8c90-a2f87bf381db-host-slash\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-sys-fs\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324837 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-system-cni-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324842 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvdhk\" (UniqueName: \"kubernetes.io/projected/dca91cdc-0ecd-49e0-925d-b3df21b832f6-kube-api-access-qvdhk\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324846 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324868 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-cni-binary-copy\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324873 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-cni-bin\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324890 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-cni-netd\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.325357 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324913 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-env-overrides\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324917 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-cni-bin\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324916 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324905 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-sys-fs\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324942 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b036654-91b4-402c-ab0f-0c27ef5e6c70-agent-certs\") pod \"konnectivity-agent-8bdvk\" (UID: \"3b036654-91b4-402c-ab0f-0c27ef5e6c70\") " pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324666 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-system-cni-dir\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324962 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.324976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-kubelet\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325008 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-cni-netd\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325008 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-kubelet\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325056 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-kubelet\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325118 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-registration-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325099 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-host-kubelet\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325159 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-host\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-registration-dir\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325199 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325216 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-k8s-cni-cncf-io\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325238 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpch8\" (UniqueName: \"kubernetes.io/projected/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-kube-api-access-dpch8\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-systemd\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325282 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-node-log\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325735 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-node-log\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325804 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-env-overrides\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325877 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-k8s-cni-cncf-io\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325332 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-sys\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.325979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326029 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-run-systemd\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326045 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-os-release\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326105 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-cni-binary-copy\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.326136 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326154 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-os-release\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.326191 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret podName:0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:33.826176232 +0000 UTC m=+2.996686314 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret") pod "global-pull-secret-syncer-n4pkr" (UID: "0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326210 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-cni-multus\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326246 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-daemon-config\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326258 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-var-lib-cni-multus\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.326986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326279 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eacca558-5359-4b40-8c90-a2f87bf381db-iptables-alerter-script\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326310 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmhhd\" (UniqueName: \"kubernetes.io/projected/eacca558-5359-4b40-8c90-a2f87bf381db-kube-api-access-jmhhd\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326359 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-var-lib-kubelet\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326389 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-host\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326419 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-netns\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326448 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-ovnkube-script-lib\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326482 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-os-release\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326508 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysctl-d\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326536 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b036654-91b4-402c-ab0f-0c27ef5e6c70-konnectivity-ca\") pod \"konnectivity-agent-8bdvk\" (UID: \"3b036654-91b4-402c-ab0f-0c27ef5e6c70\") " pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326567 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbbe0096-2d99-46fc-9b90-d702bee8c185-tmp-dir\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326597 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-cnibin\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326657 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-modprobe-d\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326687 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-etc-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326718 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326738 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-daemon-config\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.326750 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-tuned\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.327789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.327306 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/834d365e-26ff-4455-b7b6-7200e03cb122-ovnkube-script-lib\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.327334 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/eacca558-5359-4b40-8c90-a2f87bf381db-iptables-alerter-script\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.327437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-cnibin\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.327497 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61a752ad-8431-45f2-8fd2-7d5a340f15df-tmp\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.327661 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbbe0096-2d99-46fc-9b90-d702bee8c185-tmp-dir\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328065 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/834d365e-26ff-4455-b7b6-7200e03cb122-etc-openvswitch\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328094 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7de15610-11db-48dc-8114-81f80c724160-etc-selinux\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328093 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dca91cdc-0ecd-49e0-925d-b3df21b832f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328119 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-host-run-netns\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328141 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dca91cdc-0ecd-49e0-925d-b3df21b832f6-os-release\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328218 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpblz\" (UniqueName: \"kubernetes.io/projected/61a752ad-8431-45f2-8fd2-7d5a340f15df-kube-api-access-hpblz\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328274 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdtb\" (UniqueName: \"kubernetes.io/projected/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-kube-api-access-xsdtb\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-dbus\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328395 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-cni-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328449 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-socket-dir-parent\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328563 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-socket-dir-parent\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328563 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/834d365e-26ff-4455-b7b6-7200e03cb122-ovn-node-metrics-cert\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328625 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-multus-cni-dir\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.328850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.328691 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-dbus\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.332115 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.331729 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:18:33.332115 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.331752 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:18:33.332115 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.331766 2552 projected.go:196] Error preparing data for projected volume kube-api-access-gbf4k for pod openshift-network-diagnostics/network-check-target-9qmp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:33.332115 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.331820 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k podName:dcdea0ea-f7d5-463b-9101-20a483f5948d nodeName:}" failed. No retries permitted until 2026-06-05 03:18:33.831806116 +0000 UTC m=+3.002316199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gbf4k" (UniqueName: "kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k") pod "network-check-target-9qmp9" (UID: "dcdea0ea-f7d5-463b-9101-20a483f5948d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:33.333223 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.333199 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5v4t\" (UniqueName: \"kubernetes.io/projected/fbbe0096-2d99-46fc-9b90-d702bee8c185-kube-api-access-g5v4t\") pod \"node-resolver-x285n\" (UID: \"fbbe0096-2d99-46fc-9b90-d702bee8c185\") " pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.333331 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.333203 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26z98\" (UniqueName: \"kubernetes.io/projected/7de15610-11db-48dc-8114-81f80c724160-kube-api-access-26z98\") pod \"aws-ebs-csi-driver-node-s4nng\" (UID: \"7de15610-11db-48dc-8114-81f80c724160\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.333911 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.333890 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvdhk\" (UniqueName: \"kubernetes.io/projected/dca91cdc-0ecd-49e0-925d-b3df21b832f6-kube-api-access-qvdhk\") pod \"multus-additional-cni-plugins-mhhpl\" (UID: \"dca91cdc-0ecd-49e0-925d-b3df21b832f6\") " pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.334386 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.334362 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpch8\" (UniqueName: \"kubernetes.io/projected/4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc-kube-api-access-dpch8\") pod \"multus-j99r4\" (UID: \"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc\") " pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.334526 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.334507 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbd2r\" (UniqueName: \"kubernetes.io/projected/834d365e-26ff-4455-b7b6-7200e03cb122-kube-api-access-wbd2r\") pod \"ovnkube-node-lqh2n\" (UID: \"834d365e-26ff-4455-b7b6-7200e03cb122\") " pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.335254 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.335230 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmhhd\" (UniqueName: \"kubernetes.io/projected/eacca558-5359-4b40-8c90-a2f87bf381db-kube-api-access-jmhhd\") pod \"iptables-alerter-78qpf\" (UID: \"eacca558-5359-4b40-8c90-a2f87bf381db\") " pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.335445 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.335429 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ppt\" (UniqueName: \"kubernetes.io/projected/080e95bc-53d2-476e-bd90-1f99cb0e5d09-kube-api-access-l4ppt\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:33.429489 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429435 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-sys\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429489 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429485 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-var-lib-kubelet\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429508 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-host\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429542 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysctl-d\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429564 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b036654-91b4-402c-ab0f-0c27ef5e6c70-konnectivity-ca\") pod \"konnectivity-agent-8bdvk\" (UID: \"3b036654-91b4-402c-ab0f-0c27ef5e6c70\") " pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429570 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-sys\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429575 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-var-lib-kubelet\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-modprobe-d\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429641 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-host\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.429673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429663 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-tuned\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429971 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429678 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysctl-d\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429971 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429678 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-modprobe-d\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429971 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429708 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61a752ad-8431-45f2-8fd2-7d5a340f15df-tmp\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429971 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429737 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpblz\" (UniqueName: \"kubernetes.io/projected/61a752ad-8431-45f2-8fd2-7d5a340f15df-kube-api-access-hpblz\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.429971 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429960 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdtb\" (UniqueName: \"kubernetes.io/projected/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-kube-api-access-xsdtb\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.430161 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.429995 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-serviceca\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.430161 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysconfig\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430161 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430063 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysctl-conf\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430161 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430084 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3b036654-91b4-402c-ab0f-0c27ef5e6c70-konnectivity-ca\") pod \"konnectivity-agent-8bdvk\" (UID: \"3b036654-91b4-402c-ab0f-0c27ef5e6c70\") " pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.430161 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430089 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-run\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430161 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430138 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-kubernetes\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430161 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysconfig\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430167 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-systemd\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430194 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-lib-modules\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430231 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b036654-91b4-402c-ab0f-0c27ef5e6c70-agent-certs\") pod \"konnectivity-agent-8bdvk\" (UID: \"3b036654-91b4-402c-ab0f-0c27ef5e6c70\") " pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430268 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-host\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430307 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-sysctl-conf\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430385 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-kubernetes\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430395 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-run\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430428 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-host\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430433 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-systemd\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430445 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/61a752ad-8431-45f2-8fd2-7d5a340f15df-lib-modules\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.430925 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.430545 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-serviceca\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.432189 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.432165 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61a752ad-8431-45f2-8fd2-7d5a340f15df-tmp\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.432590 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.432568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/61a752ad-8431-45f2-8fd2-7d5a340f15df-etc-tuned\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.432979 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.432960 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3b036654-91b4-402c-ab0f-0c27ef5e6c70-agent-certs\") pod \"konnectivity-agent-8bdvk\" (UID: \"3b036654-91b4-402c-ab0f-0c27ef5e6c70\") " pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.443424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.443402 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdtb\" (UniqueName: \"kubernetes.io/projected/25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1-kube-api-access-xsdtb\") pod \"node-ca-q4x7f\" (UID: \"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1\") " pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.443530 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.443467 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpblz\" (UniqueName: \"kubernetes.io/projected/61a752ad-8431-45f2-8fd2-7d5a340f15df-kube-api-access-hpblz\") pod \"tuned-4n54t\" (UID: \"61a752ad-8431-45f2-8fd2-7d5a340f15df\") " pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.512415 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.512380 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x285n" Jun 05 03:18:33.522000 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.521981 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-78qpf" Jun 05 03:18:33.529611 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.529595 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:33.535210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.535194 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" Jun 05 03:18:33.540784 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.540768 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j99r4" Jun 05 03:18:33.548300 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.548282 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" Jun 05 03:18:33.555410 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.555396 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4n54t" Jun 05 03:18:33.561824 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.561806 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:33.566505 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.566481 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q4x7f" Jun 05 03:18:33.831863 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.831833 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:33.832010 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.831870 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:33.832010 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:33.831907 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:33.832010 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.831998 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:18:33.832010 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.832003 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:33.832173 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.832023 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:18:33.832173 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.832035 2552 projected.go:196] Error preparing data for projected volume kube-api-access-gbf4k for pod openshift-network-diagnostics/network-check-target-9qmp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:33.832173 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.832061 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs podName:080e95bc-53d2-476e-bd90-1f99cb0e5d09 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:34.832041922 +0000 UTC m=+4.002552004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs") pod "network-metrics-daemon-vxwwt" (UID: "080e95bc-53d2-476e-bd90-1f99cb0e5d09") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:33.832173 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.832078 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k podName:dcdea0ea-f7d5-463b-9101-20a483f5948d nodeName:}" failed. No retries permitted until 2026-06-05 03:18:34.832068869 +0000 UTC m=+4.002578949 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbf4k" (UniqueName: "kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k") pod "network-check-target-9qmp9" (UID: "dcdea0ea-f7d5-463b-9101-20a483f5948d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:33.832173 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.831997 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:33.832173 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:33.832108 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret podName:0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:34.832101674 +0000 UTC m=+4.002611752 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret") pod "global-pull-secret-syncer-n4pkr" (UID: "0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:34.048830 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.048800 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca91cdc_0ecd_49e0_925d_b3df21b832f6.slice/crio-0ac7f79b3fce2b3180a013029a4e8d5f7140fd31533ff97a35ffc384bd3aaa03 WatchSource:0}: Error finding container 0ac7f79b3fce2b3180a013029a4e8d5f7140fd31533ff97a35ffc384bd3aaa03: Status 404 returned error can't find the container with id 0ac7f79b3fce2b3180a013029a4e8d5f7140fd31533ff97a35ffc384bd3aaa03 Jun 05 03:18:34.049405 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.049375 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b7fbf3_2c49_4b88_ab8d_6bdfd1b998b1.slice/crio-350f8236644d0bea3e3b628265ed728cd9b86423047eb6888081b25babbe6126 WatchSource:0}: Error finding container 350f8236644d0bea3e3b628265ed728cd9b86423047eb6888081b25babbe6126: Status 404 returned error can't find the container with id 350f8236644d0bea3e3b628265ed728cd9b86423047eb6888081b25babbe6126 Jun 05 03:18:34.050091 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.050067 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834d365e_26ff_4455_b7b6_7200e03cb122.slice/crio-8ef75baa6af2ed27507f6f1ef45c1580e243a916d8ebc86c51733362388fcc49 WatchSource:0}: Error finding container 8ef75baa6af2ed27507f6f1ef45c1580e243a916d8ebc86c51733362388fcc49: Status 404 returned error can't find the container with id 8ef75baa6af2ed27507f6f1ef45c1580e243a916d8ebc86c51733362388fcc49 Jun 05 03:18:34.053916 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.053837 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a752ad_8431_45f2_8fd2_7d5a340f15df.slice/crio-846b65905cd8ec2674be80a66debdf0ec257626b9c364908c29a08801e51b9de WatchSource:0}: Error finding container 846b65905cd8ec2674be80a66debdf0ec257626b9c364908c29a08801e51b9de: Status 404 returned error can't find the container with id 846b65905cd8ec2674be80a66debdf0ec257626b9c364908c29a08801e51b9de Jun 05 03:18:34.054521 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.054485 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de15610_11db_48dc_8114_81f80c724160.slice/crio-5df281e6e6c0c62fad2e7f5df2536085b9dfae433cfe083d63f30de5f685a5a8 WatchSource:0}: Error finding container 5df281e6e6c0c62fad2e7f5df2536085b9dfae433cfe083d63f30de5f685a5a8: Status 404 returned error can't find the container with id 5df281e6e6c0c62fad2e7f5df2536085b9dfae433cfe083d63f30de5f685a5a8 Jun 05 03:18:34.055104 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.055082 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1347c5_0af5_4ba9_b3f2_85751ab6b9fc.slice/crio-a67a40d7788df9554617f50a56cb469239e34970ddab2da8879712aa316e2fdf WatchSource:0}: Error finding container a67a40d7788df9554617f50a56cb469239e34970ddab2da8879712aa316e2fdf: Status 404 returned error can't find the container with id a67a40d7788df9554617f50a56cb469239e34970ddab2da8879712aa316e2fdf Jun 05 03:18:34.057703 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.057134 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbe0096_2d99_46fc_9b90_d702bee8c185.slice/crio-613bc6e57ff0179eca123d8c3fbe6e080885b7e9751fbade7b40c9a82ea9e743 WatchSource:0}: Error finding container 613bc6e57ff0179eca123d8c3fbe6e080885b7e9751fbade7b40c9a82ea9e743: Status 404 returned error can't find the container with id 613bc6e57ff0179eca123d8c3fbe6e080885b7e9751fbade7b40c9a82ea9e743 Jun 05 03:18:34.058033 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.058017 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b036654_91b4_402c_ab0f_0c27ef5e6c70.slice/crio-997ed82d3932990fded01478a63f6b3dd08c27587881f88f79a2b74c4f1c23e8 WatchSource:0}: Error finding container 997ed82d3932990fded01478a63f6b3dd08c27587881f88f79a2b74c4f1c23e8: Status 404 returned error can't find the container with id 997ed82d3932990fded01478a63f6b3dd08c27587881f88f79a2b74c4f1c23e8 Jun 05 03:18:34.059265 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:18:34.059229 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacca558_5359_4b40_8c90_a2f87bf381db.slice/crio-26f4fa22280dc84692be31ae1e924bbf7a537cdd460e7b1686741675c5587846 WatchSource:0}: Error finding container 26f4fa22280dc84692be31ae1e924bbf7a537cdd460e7b1686741675c5587846: Status 404 returned error can't find the container with id 26f4fa22280dc84692be31ae1e924bbf7a537cdd460e7b1686741675c5587846 Jun 05 03:18:34.257392 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.257346 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 03:13:33 +0000 UTC" deadline="2028-01-22 08:19:52.512513726 +0000 UTC" Jun 05 03:18:34.257392 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.257390 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14309h1m18.255126567s" Jun 05 03:18:34.293351 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.293196 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4x7f" event={"ID":"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1","Type":"ContainerStarted","Data":"350f8236644d0bea3e3b628265ed728cd9b86423047eb6888081b25babbe6126"} Jun 05 03:18:34.294170 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.294150 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78qpf" event={"ID":"eacca558-5359-4b40-8c90-a2f87bf381db","Type":"ContainerStarted","Data":"26f4fa22280dc84692be31ae1e924bbf7a537cdd460e7b1686741675c5587846"} Jun 05 03:18:34.295264 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.295243 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"8ef75baa6af2ed27507f6f1ef45c1580e243a916d8ebc86c51733362388fcc49"} Jun 05 03:18:34.296367 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.296340 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerStarted","Data":"0ac7f79b3fce2b3180a013029a4e8d5f7140fd31533ff97a35ffc384bd3aaa03"} Jun 05 03:18:34.298266 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.298230 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" event={"ID":"77c0e0ff4c2137e13db318bee13380ab","Type":"ContainerStarted","Data":"19db18c457ab765d63e57679647b7292756347bcfaeeaedc4512066581e430f6"} Jun 05 03:18:34.300293 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.300266 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" event={"ID":"49c44bd4a09b4e406135cc261d566b38","Type":"ContainerStarted","Data":"a3019b69e843de1c557058aa80f3fccf75afa42d9453161536c80b55765e4f43"} Jun 05 03:18:34.301214 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.301196 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8bdvk" event={"ID":"3b036654-91b4-402c-ab0f-0c27ef5e6c70","Type":"ContainerStarted","Data":"997ed82d3932990fded01478a63f6b3dd08c27587881f88f79a2b74c4f1c23e8"} Jun 05 03:18:34.302112 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.302095 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x285n" event={"ID":"fbbe0096-2d99-46fc-9b90-d702bee8c185","Type":"ContainerStarted","Data":"613bc6e57ff0179eca123d8c3fbe6e080885b7e9751fbade7b40c9a82ea9e743"} Jun 05 03:18:34.303058 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.303038 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j99r4" event={"ID":"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc","Type":"ContainerStarted","Data":"a67a40d7788df9554617f50a56cb469239e34970ddab2da8879712aa316e2fdf"} Jun 05 03:18:34.304028 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.304011 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" event={"ID":"7de15610-11db-48dc-8114-81f80c724160","Type":"ContainerStarted","Data":"5df281e6e6c0c62fad2e7f5df2536085b9dfae433cfe083d63f30de5f685a5a8"} Jun 05 03:18:34.304986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.304969 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n54t" event={"ID":"61a752ad-8431-45f2-8fd2-7d5a340f15df","Type":"ContainerStarted","Data":"846b65905cd8ec2674be80a66debdf0ec257626b9c364908c29a08801e51b9de"} Jun 05 03:18:34.330534 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.330499 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-163.ec2.internal" podStartSLOduration=2.330487187 podStartE2EDuration="2.330487187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:34.330159041 +0000 UTC m=+3.500669142" watchObservedRunningTime="2026-06-05 03:18:34.330487187 +0000 UTC m=+3.500997287" Jun 05 03:18:34.840913 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.840875 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:34.841084 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.840932 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:34.841084 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:34.840978 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:34.841217 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841125 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:34.841217 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841184 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs podName:080e95bc-53d2-476e-bd90-1f99cb0e5d09 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:36.841166545 +0000 UTC m=+6.011676630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs") pod "network-metrics-daemon-vxwwt" (UID: "080e95bc-53d2-476e-bd90-1f99cb0e5d09") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:34.841353 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841265 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:18:34.841353 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841281 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:18:34.841353 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841293 2552 projected.go:196] Error preparing data for projected volume kube-api-access-gbf4k for pod openshift-network-diagnostics/network-check-target-9qmp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:34.841353 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841346 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k podName:dcdea0ea-f7d5-463b-9101-20a483f5948d nodeName:}" failed. No retries permitted until 2026-06-05 03:18:36.841333059 +0000 UTC m=+6.011843141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbf4k" (UniqueName: "kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k") pod "network-check-target-9qmp9" (UID: "dcdea0ea-f7d5-463b-9101-20a483f5948d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:34.841548 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841396 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:34.841548 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:34.841428 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret podName:0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:36.841418103 +0000 UTC m=+6.011928183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret") pod "global-pull-secret-syncer-n4pkr" (UID: "0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:35.087620 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.087587 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 03:18:35.258178 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.258061 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 03:13:33 +0000 UTC" deadline="2028-01-17 03:12:58.020978743 +0000 UTC" Jun 05 03:18:35.258178 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.258099 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14183h54m22.762884946s" Jun 05 03:18:35.288142 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.287384 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:35.288142 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:35.287505 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:35.288142 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.287590 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:35.288142 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:35.287660 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:35.288142 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.287719 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:35.288142 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:35.287799 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:35.330159 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.329523 2552 generic.go:356] "Generic (PLEG): container finished" podID="77c0e0ff4c2137e13db318bee13380ab" containerID="19db18c457ab765d63e57679647b7292756347bcfaeeaedc4512066581e430f6" exitCode=0 Jun 05 03:18:35.330159 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:35.330094 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" event={"ID":"77c0e0ff4c2137e13db318bee13380ab","Type":"ContainerDied","Data":"19db18c457ab765d63e57679647b7292756347bcfaeeaedc4512066581e430f6"} Jun 05 03:18:36.345653 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:36.345614 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" event={"ID":"77c0e0ff4c2137e13db318bee13380ab","Type":"ContainerStarted","Data":"04f9462570a99574f9ee4881881a48ec8da99f3c44d37dbf5ed3b9bc33a280e7"} Jun 05 03:18:36.856950 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:36.856877 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:36.856950 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:36.856940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:36.857273 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:36.856992 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:36.857273 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857130 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:18:36.857273 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857147 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:18:36.857273 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857160 2552 projected.go:196] Error preparing data for projected volume kube-api-access-gbf4k for pod openshift-network-diagnostics/network-check-target-9qmp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:36.857273 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857216 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k podName:dcdea0ea-f7d5-463b-9101-20a483f5948d nodeName:}" failed. No retries permitted until 2026-06-05 03:18:40.857198763 +0000 UTC m=+10.027708860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbf4k" (UniqueName: "kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k") pod "network-check-target-9qmp9" (UID: "dcdea0ea-f7d5-463b-9101-20a483f5948d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:36.857641 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857625 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:36.857707 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857677 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret podName:0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:40.857661965 +0000 UTC m=+10.028172049 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret") pod "global-pull-secret-syncer-n4pkr" (UID: "0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:36.857762 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857731 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:36.857812 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:36.857762 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs podName:080e95bc-53d2-476e-bd90-1f99cb0e5d09 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:40.857750619 +0000 UTC m=+10.028260702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs") pod "network-metrics-daemon-vxwwt" (UID: "080e95bc-53d2-476e-bd90-1f99cb0e5d09") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:37.285558 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:37.285487 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:37.285712 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:37.285493 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:37.285712 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:37.285607 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:37.285712 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:37.285633 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:37.285860 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:37.285726 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:37.285860 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:37.285810 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:39.285761 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:39.285722 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:39.286199 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:39.285768 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:39.286199 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:39.285845 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:39.286199 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:39.285881 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:39.286199 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:39.285974 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:39.286199 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:39.286038 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:40.893201 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:40.893165 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:40.893673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:40.893218 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:40.893673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:40.893260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:40.893673 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.893383 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:40.893673 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.893439 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs podName:080e95bc-53d2-476e-bd90-1f99cb0e5d09 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:48.893421031 +0000 UTC m=+18.063931125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs") pod "network-metrics-daemon-vxwwt" (UID: "080e95bc-53d2-476e-bd90-1f99cb0e5d09") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:40.893882 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.893848 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:18:40.893882 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.893869 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:18:40.893882 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.893882 2552 projected.go:196] Error preparing data for projected volume kube-api-access-gbf4k for pod openshift-network-diagnostics/network-check-target-9qmp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:40.894026 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.893926 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k podName:dcdea0ea-f7d5-463b-9101-20a483f5948d nodeName:}" failed. No retries permitted until 2026-06-05 03:18:48.893909841 +0000 UTC m=+18.064419934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbf4k" (UniqueName: "kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k") pod "network-check-target-9qmp9" (UID: "dcdea0ea-f7d5-463b-9101-20a483f5948d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:40.894026 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.893984 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:40.894026 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:40.894014 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret podName:0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77 nodeName:}" failed. No retries permitted until 2026-06-05 03:18:48.894003829 +0000 UTC m=+18.064513914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret") pod "global-pull-secret-syncer-n4pkr" (UID: "0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:41.287144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:41.286397 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:41.287144 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:41.286494 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:41.287144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:41.286848 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:41.287144 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:41.286939 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:41.287144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:41.286999 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:41.287144 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:41.287074 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:43.289740 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:43.289712 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:43.290330 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:43.289839 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:43.290330 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:43.290121 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:43.290330 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:43.290153 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:43.290330 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:43.290236 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:43.290552 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:43.290307 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:45.285587 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:45.285556 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:45.286099 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:45.285556 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:45.286099 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:45.285711 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:45.286099 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:45.285554 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:45.286099 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:45.285801 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:45.286099 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:45.285840 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:47.288890 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:47.288855 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:47.289348 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:47.288980 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:47.289348 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:47.288988 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:47.289348 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:47.288987 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:47.289348 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:47.289084 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:47.289348 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:47.289162 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:48.961788 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:48.961751 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:48.961809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:48.961835 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.961917 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.961929 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.961947 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.961953 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.961961 2552 projected.go:196] Error preparing data for projected volume kube-api-access-gbf4k for pod openshift-network-diagnostics/network-check-target-9qmp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.961991 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs podName:080e95bc-53d2-476e-bd90-1f99cb0e5d09 nodeName:}" failed. No retries permitted until 2026-06-05 03:19:04.961971817 +0000 UTC m=+34.132481908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs") pod "network-metrics-daemon-vxwwt" (UID: "080e95bc-53d2-476e-bd90-1f99cb0e5d09") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.962008 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k podName:dcdea0ea-f7d5-463b-9101-20a483f5948d nodeName:}" failed. No retries permitted until 2026-06-05 03:19:04.961999069 +0000 UTC m=+34.132509148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbf4k" (UniqueName: "kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k") pod "network-check-target-9qmp9" (UID: "dcdea0ea-f7d5-463b-9101-20a483f5948d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:18:48.962405 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:48.962019 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret podName:0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77 nodeName:}" failed. No retries permitted until 2026-06-05 03:19:04.962014105 +0000 UTC m=+34.132524183 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret") pod "global-pull-secret-syncer-n4pkr" (UID: "0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:18:49.288464 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:49.288387 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:49.288464 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:49.288414 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:49.288677 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:49.288387 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:49.288677 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:49.288505 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:49.288677 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:49.288549 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:49.288677 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:49.288610 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:51.286465 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:51.286416 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:51.286930 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:51.286524 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:51.286930 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:51.286534 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:51.286930 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:51.286562 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:51.286930 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:51.286666 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:51.286930 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:51.286764 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:53.288966 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.288683 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:53.289415 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.288701 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:53.289415 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:53.289077 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:53.289415 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.288729 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:53.289415 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:53.289117 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:53.289415 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:53.289211 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:53.380130 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.380103 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"fef7d29cc33d75e77bcaab44e6e148411b037942b0c8feeffb0466d3426cd215"} Jun 05 03:18:53.380237 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.380186 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"f393aa10a396fcc25e859808e7026f9444f3b3f6924cf19d47043705bdba33e5"} Jun 05 03:18:53.380303 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.380237 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"4061424ce415cb372c6b0b168c852097d237ed73dc4b96f5d86cf34eab5e65b4"} Jun 05 03:18:53.380303 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.380284 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"4780d84941572f79d4e1623d92348e574dbbccf7cc8ba248682644a9e954335a"} Jun 05 03:18:53.381613 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.381583 2552 generic.go:356] "Generic (PLEG): container finished" podID="dca91cdc-0ecd-49e0-925d-b3df21b832f6" containerID="35a3e5e7493052e76c46c376ac0084c85db5d687d097ef2b68fd93fa3a4e0ea4" exitCode=0 Jun 05 03:18:53.381680 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.381659 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerDied","Data":"35a3e5e7493052e76c46c376ac0084c85db5d687d097ef2b68fd93fa3a4e0ea4"} Jun 05 03:18:53.383394 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.383371 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8bdvk" event={"ID":"3b036654-91b4-402c-ab0f-0c27ef5e6c70","Type":"ContainerStarted","Data":"6c9736be496116e0f205c77e0d09a6b9077db4eca5a21f3ec82e4701b34ed526"} Jun 05 03:18:53.385211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.385191 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x285n" event={"ID":"fbbe0096-2d99-46fc-9b90-d702bee8c185","Type":"ContainerStarted","Data":"29143e40c1a99d151f61cc8f68c30b4ed37211b666e1b15920fbef199cc9e8c0"} Jun 05 03:18:53.386706 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.386684 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j99r4" event={"ID":"4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc","Type":"ContainerStarted","Data":"16d694540e84a53a93619a80e8e392a2cf602b312fa423984f42c4b6c2ba4a4a"} Jun 05 03:18:53.389294 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.389270 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" event={"ID":"7de15610-11db-48dc-8114-81f80c724160","Type":"ContainerStarted","Data":"76f58d7593338d5f890d35bbdba3d1b3a9c0a8de31ed4e05cf4f13919a7cf61e"} Jun 05 03:18:53.391542 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.391520 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4n54t" event={"ID":"61a752ad-8431-45f2-8fd2-7d5a340f15df","Type":"ContainerStarted","Data":"9b866fb266dd4e51abbcfd3e518d7e72a1338fd046a0e44c6dac961299812d9e"} Jun 05 03:18:53.392966 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.392940 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q4x7f" event={"ID":"25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1","Type":"ContainerStarted","Data":"5742a70db28c9350155f79400bc2a6154a55061c28696ae0b85d645aa6d98df7"} Jun 05 03:18:53.405213 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.403391 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-163.ec2.internal" podStartSLOduration=21.403369943 podStartE2EDuration="21.403369943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:36.360350463 +0000 UTC m=+5.530860565" watchObservedRunningTime="2026-06-05 03:18:53.403369943 +0000 UTC m=+22.573880044" Jun 05 03:18:53.416019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.415982 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8bdvk" podStartSLOduration=11.923154484 podStartE2EDuration="22.415969844s" totalImagesPullingTime="10.49281536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:53.415607551 +0000 UTC m=+22.586117654" watchObservedRunningTime="2026-06-05 03:18:53.415969844 +0000 UTC m=+22.586479944" Jun 05 03:18:53.428447 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.428403 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q4x7f" podStartSLOduration=3.613407033 podStartE2EDuration="22.428391693s" totalImagesPullingTime="18.81498466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:53.428357051 +0000 UTC m=+22.598867152" watchObservedRunningTime="2026-06-05 03:18:53.428391693 +0000 UTC m=+22.598901776" Jun 05 03:18:53.440901 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.440862 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x285n" podStartSLOduration=3.632860757 podStartE2EDuration="22.440850494s" totalImagesPullingTime="18.807989737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:53.440491345 +0000 UTC m=+22.611001446" watchObservedRunningTime="2026-06-05 03:18:53.440850494 +0000 UTC m=+22.611360594" Jun 05 03:18:53.456280 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.456250 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j99r4" podStartSLOduration=3.599058312 podStartE2EDuration="22.456239992s" totalImagesPullingTime="18.85718168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:53.455786518 +0000 UTC m=+22.626296619" watchObservedRunningTime="2026-06-05 03:18:53.456239992 +0000 UTC m=+22.626750092" Jun 05 03:18:53.474769 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:53.474738 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4n54t" podStartSLOduration=3.661660932 podStartE2EDuration="22.474727246s" totalImagesPullingTime="18.813066314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:53.474367324 +0000 UTC m=+22.644877425" watchObservedRunningTime="2026-06-05 03:18:53.474727246 +0000 UTC m=+22.645237347" Jun 05 03:18:54.377875 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:54.377853 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 03:18:54.397286 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:54.397260 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" event={"ID":"7de15610-11db-48dc-8114-81f80c724160","Type":"ContainerStarted","Data":"70d52872a7f8e528c25c57d0d2a7901dce8d80e88fca646e7759edbea5ebaff5"} Jun 05 03:18:54.399088 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:54.399056 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-78qpf" event={"ID":"eacca558-5359-4b40-8c90-a2f87bf381db","Type":"ContainerStarted","Data":"11ba31663190ceae3090278ba8eadfdcc18429c33d458f649dd81c50d68db504"} Jun 05 03:18:54.402570 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:54.402548 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"ecd65aca1708341f4b8aa8c7d03956e1e6f6f261316fb7e20ace13207a266a12"} Jun 05 03:18:54.402673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:54.402634 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"423f3ba4f379251706078d43089f36f56c53506b2c2f55e04117ec9ed3db16d7"} Jun 05 03:18:54.412604 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:54.412568 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-78qpf" podStartSLOduration=4.60694661 podStartE2EDuration="23.412553325s" totalImagesPullingTime="18.805606715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:54.411828704 +0000 UTC m=+23.582338817" watchObservedRunningTime="2026-06-05 03:18:54.412553325 +0000 UTC m=+23.583063432" Jun 05 03:18:55.282490 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.282403 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T03:18:54.377871389Z","UUID":"b9771e51-00e0-4c1f-a53e-831551f303cd","Handler":null,"Name":"","Endpoint":""} Jun 05 03:18:55.284067 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.284047 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 03:18:55.284172 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.284085 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 03:18:55.285540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.285520 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:55.285697 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.285520 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:55.285697 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:55.285638 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:55.285697 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.285650 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:55.285970 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:55.285732 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:55.285970 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:55.285825 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:55.695518 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.695489 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:55.696014 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.695990 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:55.696468 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.696430 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:55.696814 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:55.696798 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8bdvk" Jun 05 03:18:56.409396 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:56.409355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" event={"ID":"7de15610-11db-48dc-8114-81f80c724160","Type":"ContainerStarted","Data":"882855943bc9e05e35b44632dfd6579f1b5d2abcdf06231a86a61f47b41412c1"} Jun 05 03:18:56.413510 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:56.413469 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"9d8917d520b1b31e2058037377b529127814bfcf5b684cde047ad68bd48785b1"} Jun 05 03:18:56.426539 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:56.426501 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s4nng" podStartSLOduration=4.402697105 podStartE2EDuration="25.42648823s" totalImagesPullingTime="21.023791125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:56.426386582 +0000 UTC m=+25.596896686" watchObservedRunningTime="2026-06-05 03:18:56.42648823 +0000 UTC m=+25.596998335" Jun 05 03:18:57.285996 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:57.285920 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:57.285996 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:57.285965 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:57.286627 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:57.286074 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:57.286627 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:57.286136 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:57.286627 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:57.286195 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:57.286627 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:57.286289 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:59.285773 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.285609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:18:59.286115 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.285614 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:18:59.286115 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:59.285846 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:18:59.286115 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.285632 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:18:59.286115 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:59.285912 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:18:59.286115 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:18:59.286023 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:18:59.422394 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.422370 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" event={"ID":"834d365e-26ff-4455-b7b6-7200e03cb122","Type":"ContainerStarted","Data":"a4e071935898d28bb1db278007337d4de3ab3afa6a29fef67f6d72e628a7ac54"} Jun 05 03:18:59.422657 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.422593 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:59.422657 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.422656 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:59.424521 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.424497 2552 generic.go:356] "Generic (PLEG): container finished" podID="dca91cdc-0ecd-49e0-925d-b3df21b832f6" containerID="3d54c5b9c762bd9efe2d922165e5024a9745a02569f0445df1159c2e0ce13550" exitCode=0 Jun 05 03:18:59.424618 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.424553 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerDied","Data":"3d54c5b9c762bd9efe2d922165e5024a9745a02569f0445df1159c2e0ce13550"} Jun 05 03:18:59.437879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.437861 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:59.437963 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.437947 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:18:59.446082 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:18:59.446041 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" podStartSLOduration=9.569416357 podStartE2EDuration="28.446029687s" totalImagesPullingTime="18.87661333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:18:59.445261034 +0000 UTC m=+28.615771137" watchObservedRunningTime="2026-06-05 03:18:59.446029687 +0000 UTC m=+28.616539771" Jun 05 03:19:00.414749 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.414566 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4pkr"] Jun 05 03:19:00.415157 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.414843 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:00.415157 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:00.414954 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:19:00.417427 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.417409 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vxwwt"] Jun 05 03:19:00.417531 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.417477 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:00.417594 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:00.417561 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:19:00.425899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.425869 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9qmp9"] Jun 05 03:19:00.425988 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.425945 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:00.426049 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:00.426030 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:19:00.426933 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.426911 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 05 03:19:00.898579 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:00.898552 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:19:01.430974 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:01.430937 2552 generic.go:356] "Generic (PLEG): container finished" podID="dca91cdc-0ecd-49e0-925d-b3df21b832f6" containerID="9442d4f06ad2dd19f17aa08713cdf4a41b5abd12a746b72409e099d6252b78cf" exitCode=0 Jun 05 03:19:01.431498 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:01.431019 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerDied","Data":"9442d4f06ad2dd19f17aa08713cdf4a41b5abd12a746b72409e099d6252b78cf"} Jun 05 03:19:02.285757 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:02.285693 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:02.285915 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:02.285789 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:19:02.285915 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:02.285697 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:02.285915 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:02.285703 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:02.286046 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:02.285922 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:19:02.286046 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:02.285944 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:19:03.437899 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:03.437868 2552 generic.go:356] "Generic (PLEG): container finished" podID="dca91cdc-0ecd-49e0-925d-b3df21b832f6" containerID="01b14570bcee1844e1114806fba3687d1c47c90ee435fdadfcd7ed003de76ef4" exitCode=0 Jun 05 03:19:03.438367 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:03.437907 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerDied","Data":"01b14570bcee1844e1114806fba3687d1c47c90ee435fdadfcd7ed003de76ef4"} Jun 05 03:19:04.285824 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:04.285745 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:04.285824 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:04.285758 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:04.286027 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.285845 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qmp9" podUID="dcdea0ea-f7d5-463b-9101-20a483f5948d" Jun 05 03:19:04.286027 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.285950 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vxwwt" podUID="080e95bc-53d2-476e-bd90-1f99cb0e5d09" Jun 05 03:19:04.286027 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:04.286013 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:04.286171 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.286089 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n4pkr" podUID="0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77" Jun 05 03:19:04.982913 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:04.982877 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:04.982913 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:04.982924 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:04.982969 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983077 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983079 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983097 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983108 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983124 2552 projected.go:196] Error preparing data for projected volume kube-api-access-gbf4k for pod openshift-network-diagnostics/network-check-target-9qmp9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983154 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs podName:080e95bc-53d2-476e-bd90-1f99cb0e5d09 nodeName:}" failed. No retries permitted until 2026-06-05 03:19:36.983139489 +0000 UTC m=+66.153649568 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs") pod "network-metrics-daemon-vxwwt" (UID: "080e95bc-53d2-476e-bd90-1f99cb0e5d09") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983167 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret podName:0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77 nodeName:}" failed. No retries permitted until 2026-06-05 03:19:36.983161421 +0000 UTC m=+66.153671500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret") pod "global-pull-secret-syncer-n4pkr" (UID: "0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77") : object "kube-system"/"original-pull-secret" not registered Jun 05 03:19:04.983447 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:04.983177 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k podName:dcdea0ea-f7d5-463b-9101-20a483f5948d nodeName:}" failed. No retries permitted until 2026-06-05 03:19:36.983171505 +0000 UTC m=+66.153681584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gbf4k" (UniqueName: "kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k") pod "network-check-target-9qmp9" (UID: "dcdea0ea-f7d5-463b-9101-20a483f5948d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 03:19:05.717883 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.717818 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-163.ec2.internal" event="NodeReady" Jun 05 03:19:05.718012 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.717925 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 03:19:05.765585 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.765556 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sb46z"] Jun 05 03:19:05.769587 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.769447 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.770396 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.770372 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9tqh4"] Jun 05 03:19:05.771720 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.771697 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 03:19:05.771829 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.771735 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 03:19:05.772077 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.772058 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wz5vc\"" Jun 05 03:19:05.774210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.774191 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:05.776271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.776251 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 03:19:05.776535 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.776518 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 03:19:05.776614 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.776546 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g4fbg\"" Jun 05 03:19:05.776760 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.776694 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 03:19:05.780509 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.780486 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sb46z"] Jun 05 03:19:05.784873 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.784753 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9tqh4"] Jun 05 03:19:05.788166 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.788148 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pf895"] Jun 05 03:19:05.792819 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.792802 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.794846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.794828 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 03:19:05.794937 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.794886 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wcbhv\"" Jun 05 03:19:05.795193 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.795174 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 03:19:05.795277 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.795213 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 03:19:05.795346 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.795273 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 03:19:05.805271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.805253 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pf895"] Jun 05 03:19:05.891523 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891489 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8k5j\" (UniqueName: \"kubernetes.io/projected/b3cc98d1-3d2c-4323-8360-190a5bbe012d-kube-api-access-f8k5j\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.891671 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891552 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cc98d1-3d2c-4323-8360-190a5bbe012d-crio-socket\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.891671 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twdws\" (UniqueName: \"kubernetes.io/projected/0697d96e-0986-45af-89ba-0a3879c0dfa7-kube-api-access-twdws\") pod \"ingress-canary-9tqh4\" (UID: \"0697d96e-0986-45af-89ba-0a3879c0dfa7\") " pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:05.891671 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891625 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cc98d1-3d2c-4323-8360-190a5bbe012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.891671 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891654 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cc98d1-3d2c-4323-8360-190a5bbe012d-data-volume\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.891850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891682 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7r7l\" (UniqueName: \"kubernetes.io/projected/c571c7cb-5e74-4511-86e6-494207456f3c-kube-api-access-l7r7l\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.891850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0697d96e-0986-45af-89ba-0a3879c0dfa7-cert\") pod \"ingress-canary-9tqh4\" (UID: \"0697d96e-0986-45af-89ba-0a3879c0dfa7\") " pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:05.891850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891744 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c571c7cb-5e74-4511-86e6-494207456f3c-config-volume\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.891850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891768 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c571c7cb-5e74-4511-86e6-494207456f3c-metrics-tls\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.891850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891792 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cc98d1-3d2c-4323-8360-190a5bbe012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.891850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.891814 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c571c7cb-5e74-4511-86e6-494207456f3c-tmp-dir\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.992293 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992236 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8k5j\" (UniqueName: \"kubernetes.io/projected/b3cc98d1-3d2c-4323-8360-190a5bbe012d-kube-api-access-f8k5j\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.992293 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cc98d1-3d2c-4323-8360-190a5bbe012d-crio-socket\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.992293 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992290 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twdws\" (UniqueName: \"kubernetes.io/projected/0697d96e-0986-45af-89ba-0a3879c0dfa7-kube-api-access-twdws\") pod \"ingress-canary-9tqh4\" (UID: \"0697d96e-0986-45af-89ba-0a3879c0dfa7\") " pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992336 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cc98d1-3d2c-4323-8360-190a5bbe012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992355 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cc98d1-3d2c-4323-8360-190a5bbe012d-data-volume\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992372 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7r7l\" (UniqueName: \"kubernetes.io/projected/c571c7cb-5e74-4511-86e6-494207456f3c-kube-api-access-l7r7l\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992393 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0697d96e-0986-45af-89ba-0a3879c0dfa7-cert\") pod \"ingress-canary-9tqh4\" (UID: \"0697d96e-0986-45af-89ba-0a3879c0dfa7\") " pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992421 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c571c7cb-5e74-4511-86e6-494207456f3c-config-volume\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992443 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c571c7cb-5e74-4511-86e6-494207456f3c-metrics-tls\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992463 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3cc98d1-3d2c-4323-8360-190a5bbe012d-crio-socket\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992467 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cc98d1-3d2c-4323-8360-190a5bbe012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c571c7cb-5e74-4511-86e6-494207456f3c-tmp-dir\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.992807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992748 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3cc98d1-3d2c-4323-8360-190a5bbe012d-data-volume\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.993187 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.992903 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c571c7cb-5e74-4511-86e6-494207456f3c-tmp-dir\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.993187 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.993090 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3cc98d1-3d2c-4323-8360-190a5bbe012d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.993187 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.993108 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c571c7cb-5e74-4511-86e6-494207456f3c-config-volume\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.996805 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.996782 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3cc98d1-3d2c-4323-8360-190a5bbe012d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:05.996930 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.996802 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c571c7cb-5e74-4511-86e6-494207456f3c-metrics-tls\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:05.996930 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:05.996790 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0697d96e-0986-45af-89ba-0a3879c0dfa7-cert\") pod \"ingress-canary-9tqh4\" (UID: \"0697d96e-0986-45af-89ba-0a3879c0dfa7\") " pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:06.000121 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.000099 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8k5j\" (UniqueName: \"kubernetes.io/projected/b3cc98d1-3d2c-4323-8360-190a5bbe012d-kube-api-access-f8k5j\") pod \"insights-runtime-extractor-pf895\" (UID: \"b3cc98d1-3d2c-4323-8360-190a5bbe012d\") " pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:06.000458 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.000437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7r7l\" (UniqueName: \"kubernetes.io/projected/c571c7cb-5e74-4511-86e6-494207456f3c-kube-api-access-l7r7l\") pod \"dns-default-sb46z\" (UID: \"c571c7cb-5e74-4511-86e6-494207456f3c\") " pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:06.000661 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.000643 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twdws\" (UniqueName: \"kubernetes.io/projected/0697d96e-0986-45af-89ba-0a3879c0dfa7-kube-api-access-twdws\") pod \"ingress-canary-9tqh4\" (UID: \"0697d96e-0986-45af-89ba-0a3879c0dfa7\") " pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:06.083228 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.083199 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:06.091750 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.091730 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9tqh4" Jun 05 03:19:06.102936 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.102918 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pf895" Jun 05 03:19:06.286331 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.286196 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:06.286331 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.286224 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:06.286331 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.286231 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:06.288819 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.288795 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 03:19:06.288819 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.288816 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 03:19:06.288981 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.288846 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 03:19:06.289155 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.289139 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 03:19:06.289409 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.289381 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9rln\"" Jun 05 03:19:06.289520 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.289385 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cqspf\"" Jun 05 03:19:06.624421 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.624391 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7565d74d7c-nb4l8"] Jun 05 03:19:06.627596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.627573 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.629683 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.629658 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bbmcd\"" Jun 05 03:19:06.629932 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.629913 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 03:19:06.630012 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.629968 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 03:19:06.630221 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.630202 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 03:19:06.630298 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.630202 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 03:19:06.630455 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.630383 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 03:19:06.630593 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.630481 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 03:19:06.630915 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.630894 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 03:19:06.635498 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.635434 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 03:19:06.636183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.636122 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7565d74d7c-nb4l8"] Jun 05 03:19:06.797964 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.797933 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-service-ca\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.797964 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.797967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-trusted-ca-bundle\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.798177 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.798090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-serving-cert\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.798177 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.798124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-oauth-serving-cert\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.798243 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.798181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-config\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.798243 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.798206 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h86s2\" (UniqueName: \"kubernetes.io/projected/201b64d2-0be6-4f28-b6d4-ec700f82d5be-kube-api-access-h86s2\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.798358 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.798268 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-oauth-config\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.898849 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.898769 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-serving-cert\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.898849 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.898814 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-oauth-serving-cert\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899031 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.898860 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-config\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899031 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899007 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h86s2\" (UniqueName: \"kubernetes.io/projected/201b64d2-0be6-4f28-b6d4-ec700f82d5be-kube-api-access-h86s2\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899163 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899057 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-oauth-config\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899163 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899122 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-service-ca\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899163 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899147 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-trusted-ca-bundle\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899719 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899654 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-oauth-serving-cert\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899719 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899655 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-config\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.899921 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-service-ca\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.900020 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.899987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-trusted-ca-bundle\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.901864 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.901839 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-oauth-config\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.901967 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.901939 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-serving-cert\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.907202 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.907175 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h86s2\" (UniqueName: \"kubernetes.io/projected/201b64d2-0be6-4f28-b6d4-ec700f82d5be-kube-api-access-h86s2\") pod \"console-7565d74d7c-nb4l8\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:06.939058 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:06.939031 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:07.699525 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:07.699493 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pf895"] Jun 05 03:19:07.702201 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:07.702181 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9tqh4"] Jun 05 03:19:07.704460 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:07.704425 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cc98d1_3d2c_4323_8360_190a5bbe012d.slice/crio-83a1b4bd91f846cf54aea358d35d818801dfa9a9f00e8c4495d810b540a37537 WatchSource:0}: Error finding container 83a1b4bd91f846cf54aea358d35d818801dfa9a9f00e8c4495d810b540a37537: Status 404 returned error can't find the container with id 83a1b4bd91f846cf54aea358d35d818801dfa9a9f00e8c4495d810b540a37537 Jun 05 03:19:07.705678 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:07.705655 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0697d96e_0986_45af_89ba_0a3879c0dfa7.slice/crio-eb9221c20af0be7010e2ebfd07a15bb0fb8b3d7e40f4c4785bebce89255b7a24 WatchSource:0}: Error finding container eb9221c20af0be7010e2ebfd07a15bb0fb8b3d7e40f4c4785bebce89255b7a24: Status 404 returned error can't find the container with id eb9221c20af0be7010e2ebfd07a15bb0fb8b3d7e40f4c4785bebce89255b7a24 Jun 05 03:19:07.711269 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:07.711245 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7565d74d7c-nb4l8"] Jun 05 03:19:07.716652 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:07.714568 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sb46z"] Jun 05 03:19:07.716652 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:07.716412 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201b64d2_0be6_4f28_b6d4_ec700f82d5be.slice/crio-27e9a2ede539bd6296de41d8ec7919036236f856233331acbe54fd39e9dbcc44 WatchSource:0}: Error finding container 27e9a2ede539bd6296de41d8ec7919036236f856233331acbe54fd39e9dbcc44: Status 404 returned error can't find the container with id 27e9a2ede539bd6296de41d8ec7919036236f856233331acbe54fd39e9dbcc44 Jun 05 03:19:07.718930 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:07.718905 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc571c7cb_5e74_4511_86e6_494207456f3c.slice/crio-11974038318d2a8bedb5db276337599c12b40be6e384ee6e0c19447a9631f25d WatchSource:0}: Error finding container 11974038318d2a8bedb5db276337599c12b40be6e384ee6e0c19447a9631f25d: Status 404 returned error can't find the container with id 11974038318d2a8bedb5db276337599c12b40be6e384ee6e0c19447a9631f25d Jun 05 03:19:08.455120 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:08.455083 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sb46z" event={"ID":"c571c7cb-5e74-4511-86e6-494207456f3c","Type":"ContainerStarted","Data":"11974038318d2a8bedb5db276337599c12b40be6e384ee6e0c19447a9631f25d"} Jun 05 03:19:08.459798 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:08.458804 2552 generic.go:356] "Generic (PLEG): container finished" podID="dca91cdc-0ecd-49e0-925d-b3df21b832f6" containerID="66a5b632404ecc46c782fd733da92baea64533a10d87d916ac6905212f84c69d" exitCode=0 Jun 05 03:19:08.459798 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:08.458876 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerDied","Data":"66a5b632404ecc46c782fd733da92baea64533a10d87d916ac6905212f84c69d"} Jun 05 03:19:08.461503 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:08.461440 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7565d74d7c-nb4l8" event={"ID":"201b64d2-0be6-4f28-b6d4-ec700f82d5be","Type":"ContainerStarted","Data":"27e9a2ede539bd6296de41d8ec7919036236f856233331acbe54fd39e9dbcc44"} Jun 05 03:19:08.466727 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:08.466629 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf895" event={"ID":"b3cc98d1-3d2c-4323-8360-190a5bbe012d","Type":"ContainerStarted","Data":"59e02980d9de39c135cf33ce4005528509c72298dbe26c7733400218a57593c5"} Jun 05 03:19:08.466727 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:08.466684 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf895" event={"ID":"b3cc98d1-3d2c-4323-8360-190a5bbe012d","Type":"ContainerStarted","Data":"83a1b4bd91f846cf54aea358d35d818801dfa9a9f00e8c4495d810b540a37537"} Jun 05 03:19:08.468207 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:08.468179 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9tqh4" event={"ID":"0697d96e-0986-45af-89ba-0a3879c0dfa7","Type":"ContainerStarted","Data":"eb9221c20af0be7010e2ebfd07a15bb0fb8b3d7e40f4c4785bebce89255b7a24"} Jun 05 03:19:09.266183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.265174 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hpk95"] Jun 05 03:19:09.279166 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.279133 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hpk95"] Jun 05 03:19:09.279299 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.279148 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.281678 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.281433 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 03:19:09.283279 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.282595 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 03:19:09.283279 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.282731 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4mzhj\"" Jun 05 03:19:09.283279 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.282845 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 03:19:09.283279 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.282962 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 03:19:09.283279 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.283126 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 03:19:09.421836 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.421674 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.421836 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.421727 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7rwc\" (UniqueName: \"kubernetes.io/projected/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-kube-api-access-n7rwc\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.421836 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.421804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.422107 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.421891 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.476718 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.476680 2552 generic.go:356] "Generic (PLEG): container finished" podID="dca91cdc-0ecd-49e0-925d-b3df21b832f6" containerID="92202c960f9c5dbee85cc45b09b8d5b0ef14d0db898154499a9e70c7975d7534" exitCode=0 Jun 05 03:19:09.476879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.476784 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerDied","Data":"92202c960f9c5dbee85cc45b09b8d5b0ef14d0db898154499a9e70c7975d7534"} Jun 05 03:19:09.480248 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.480218 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf895" event={"ID":"b3cc98d1-3d2c-4323-8360-190a5bbe012d","Type":"ContainerStarted","Data":"ddcf1340a0b1f784d13e505c6f92a9950aa619aebf2329d0333f7595e3b2d390"} Jun 05 03:19:09.523007 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.522835 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.523007 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.522979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7rwc\" (UniqueName: \"kubernetes.io/projected/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-kube-api-access-n7rwc\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.523231 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.523067 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.523231 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.523119 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.528297 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.527999 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.529536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.528852 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.532020 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.531978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7rwc\" (UniqueName: \"kubernetes.io/projected/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-kube-api-access-n7rwc\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.537383 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.535660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90719c70-bf9a-4f3c-9cf0-b589bdb1266f-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-hpk95\" (UID: \"90719c70-bf9a-4f3c-9cf0-b589bdb1266f\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:09.592693 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:09.592656 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" Jun 05 03:19:12.918766 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:12.918739 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-hpk95"] Jun 05 03:19:12.924817 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:12.924771 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90719c70_bf9a_4f3c_9cf0_b589bdb1266f.slice/crio-6cc44ca9eeee64521601474603056e84f8132aeb380f79b0148375216cc0aac9 WatchSource:0}: Error finding container 6cc44ca9eeee64521601474603056e84f8132aeb380f79b0148375216cc0aac9: Status 404 returned error can't find the container with id 6cc44ca9eeee64521601474603056e84f8132aeb380f79b0148375216cc0aac9 Jun 05 03:19:13.492412 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.492376 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9tqh4" event={"ID":"0697d96e-0986-45af-89ba-0a3879c0dfa7","Type":"ContainerStarted","Data":"ee43ef8fed46c6a4f105961461c14872eaf66017e6e2f88196f0c042aa1cb8be"} Jun 05 03:19:13.493999 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.493967 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sb46z" event={"ID":"c571c7cb-5e74-4511-86e6-494207456f3c","Type":"ContainerStarted","Data":"060d66d518f61f7ef0d25fd538a0b9f7ab5886fa1a552be290f603e380344780"} Jun 05 03:19:13.494107 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.494007 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sb46z" event={"ID":"c571c7cb-5e74-4511-86e6-494207456f3c","Type":"ContainerStarted","Data":"a27adc0fd2912731a9a99dd23312a23b003fecee4cf21ea8c5cecf0247ecbdcd"} Jun 05 03:19:13.494107 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.494034 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:13.495148 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.495118 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" event={"ID":"90719c70-bf9a-4f3c-9cf0-b589bdb1266f","Type":"ContainerStarted","Data":"6cc44ca9eeee64521601474603056e84f8132aeb380f79b0148375216cc0aac9"} Jun 05 03:19:13.498003 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.497977 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" event={"ID":"dca91cdc-0ecd-49e0-925d-b3df21b832f6","Type":"ContainerStarted","Data":"dab67f5414a8c35be821b50fcb40c35c98595e611ad5e067bae30525990faf36"} Jun 05 03:19:13.499280 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.499254 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7565d74d7c-nb4l8" event={"ID":"201b64d2-0be6-4f28-b6d4-ec700f82d5be","Type":"ContainerStarted","Data":"ed554e7477b1e499b5efc5656c3abfc14c69a8d32cda1849837193850e69d8fb"} Jun 05 03:19:13.500993 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.500972 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pf895" event={"ID":"b3cc98d1-3d2c-4323-8360-190a5bbe012d","Type":"ContainerStarted","Data":"8591c38031d6da6f5c1d483bac6a53f4376c606a6e69cb2704127ebcca705081"} Jun 05 03:19:13.507663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.507627 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9tqh4" podStartSLOduration=3.429167825 podStartE2EDuration="8.50761468s" totalImagesPullingTime="5.078446855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:13.506632711 +0000 UTC m=+42.677142831" watchObservedRunningTime="2026-06-05 03:19:13.50761468 +0000 UTC m=+42.678124759" Jun 05 03:19:13.526037 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.525909 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mhhpl" podStartSLOduration=12.438098804 podStartE2EDuration="42.525893149s" totalImagesPullingTime="30.087794345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:13.52456698 +0000 UTC m=+42.695077078" watchObservedRunningTime="2026-06-05 03:19:13.525893149 +0000 UTC m=+42.696403259" Jun 05 03:19:13.539704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.539668 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7565d74d7c-nb4l8" podStartSLOduration=2.47190868 podStartE2EDuration="7.539656661s" totalImagesPullingTime="5.067747981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:13.539446704 +0000 UTC m=+42.709956805" watchObservedRunningTime="2026-06-05 03:19:13.539656661 +0000 UTC m=+42.710166762" Jun 05 03:19:13.554850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.554813 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sb46z" podStartSLOduration=3.483553901 podStartE2EDuration="8.554801705s" totalImagesPullingTime="5.071247804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:13.554220675 +0000 UTC m=+42.724730793" watchObservedRunningTime="2026-06-05 03:19:13.554801705 +0000 UTC m=+42.725311785" Jun 05 03:19:13.570808 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:13.570769 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pf895" podStartSLOduration=3.660385082 podStartE2EDuration="8.570758588s" totalImagesPullingTime="4.910373506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:19:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:13.569993308 +0000 UTC m=+42.740503408" watchObservedRunningTime="2026-06-05 03:19:13.570758588 +0000 UTC m=+42.741268690" Jun 05 03:19:15.509110 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:15.509071 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" event={"ID":"90719c70-bf9a-4f3c-9cf0-b589bdb1266f","Type":"ContainerStarted","Data":"dfdb0f126fbc52a030da7f3cf7d14096119e6ae15786a7cb24a2c0751213c4cb"} Jun 05 03:19:15.509639 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:15.509133 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" event={"ID":"90719c70-bf9a-4f3c-9cf0-b589bdb1266f","Type":"ContainerStarted","Data":"c3696fc9093b82e902b4086eddbf90fe6848f83a6a660c8c782dfa92e36cb29c"} Jun 05 03:19:15.525040 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:15.524992 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-hpk95" podStartSLOduration=4.725029762 podStartE2EDuration="6.524979233s" totalImagesPullingTime="1.799949471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:15.524036961 +0000 UTC m=+44.694547061" watchObservedRunningTime="2026-06-05 03:19:15.524979233 +0000 UTC m=+44.695489333" Jun 05 03:19:16.939336 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:16.939295 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:16.939793 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:16.939373 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:16.940277 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:16.940256 2552 patch_prober.go:28] interesting pod/console-7565d74d7c-nb4l8 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" start-of-body= Jun 05 03:19:16.940361 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:16.940299 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7565d74d7c-nb4l8" podUID="201b64d2-0be6-4f28-b6d4-ec700f82d5be" containerName="console" probeResult="failure" output="Get \"https://10.134.0.9:8443/health\": dial tcp 10.134.0.9:8443: connect: connection refused" Jun 05 03:19:17.603068 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.603036 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd"] Jun 05 03:19:17.635570 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.635550 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd"] Jun 05 03:19:17.635701 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.635650 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.638434 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.638410 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 03:19:17.638554 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.638414 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-qmvwt\"" Jun 05 03:19:17.638554 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.638484 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 03:19:17.649998 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.649978 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8mjw5"] Jun 05 03:19:17.671546 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.671527 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.673862 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.673843 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 03:19:17.673954 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.673880 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 03:19:17.674025 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.674009 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 03:19:17.674068 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.674028 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5f5jv\"" Jun 05 03:19:17.683706 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683687 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swf2v\" (UniqueName: \"kubernetes.io/projected/6a6cbe97-b455-4589-b424-e62d8bb044bd-kube-api-access-swf2v\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.683796 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683717 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.683796 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683741 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-root\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.683796 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.683796 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683787 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-tls\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.683936 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683808 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.683936 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683876 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-textfile\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.683936 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-accelerators-collector-config\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.683936 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683905 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t5v\" (UniqueName: \"kubernetes.io/projected/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-kube-api-access-57t5v\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.684094 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cbe97-b455-4589-b424-e62d8bb044bd-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.684094 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.683980 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-wtmp\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.684094 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.684002 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-metrics-client-ca\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.684094 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.684019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-sys\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.784502 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.784479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-textfile\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.784608 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.784506 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-accelerators-collector-config\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.784608 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.784521 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57t5v\" (UniqueName: \"kubernetes.io/projected/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-kube-api-access-57t5v\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.784746 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.784729 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cbe97-b455-4589-b424-e62d8bb044bd-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.784805 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.784757 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-wtmp\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.784805 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.784786 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-metrics-client-ca\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.784901 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.784815 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-sys\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.785240 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785162 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-wtmp\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.785240 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785172 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swf2v\" (UniqueName: \"kubernetes.io/projected/6a6cbe97-b455-4589-b424-e62d8bb044bd-kube-api-access-swf2v\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.785437 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785254 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.785437 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785284 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-textfile\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.785437 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785312 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-root\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.785437 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785366 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.785437 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785396 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-tls\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.785699 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785573 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-accelerators-collector-config\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.785699 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785610 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.785789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.785777 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a6cbe97-b455-4589-b424-e62d8bb044bd-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.786220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-sys\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:17.786305 2552 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:17.786384 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-tls podName:6a6cbe97-b455-4589-b424-e62d8bb044bd nodeName:}" failed. No retries permitted until 2026-06-05 03:19:18.286365167 +0000 UTC m=+47.456875258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-bpzkd" (UID: "6a6cbe97-b455-4589-b424-e62d8bb044bd") : secret "openshift-state-metrics-tls" not found Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.786815 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-metrics-client-ca\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:17.786903 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.786953 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-root\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:17.787180 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-tls podName:0d89656e-2a40-45f7-9cf8-c8cd35cd5a61 nodeName:}" failed. No retries permitted until 2026-06-05 03:19:18.287164483 +0000 UTC m=+47.457674575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-tls") pod "node-exporter-8mjw5" (UID: "0d89656e-2a40-45f7-9cf8-c8cd35cd5a61") : secret "node-exporter-tls" not found Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.788363 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:17.789263 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.788387 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.791720 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.791700 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t5v\" (UniqueName: \"kubernetes.io/projected/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-kube-api-access-57t5v\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:17.792121 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:17.792100 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swf2v\" (UniqueName: \"kubernetes.io/projected/6a6cbe97-b455-4589-b424-e62d8bb044bd-kube-api-access-swf2v\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:18.289531 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.289501 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-tls\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:18.289924 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.289539 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:18.291848 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.291824 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0d89656e-2a40-45f7-9cf8-c8cd35cd5a61-node-exporter-tls\") pod \"node-exporter-8mjw5\" (UID: \"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61\") " pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:18.292039 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.292021 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6a6cbe97-b455-4589-b424-e62d8bb044bd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-bpzkd\" (UID: \"6a6cbe97-b455-4589-b424-e62d8bb044bd\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:18.544120 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.544063 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" Jun 05 03:19:18.579730 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.579700 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8mjw5" Jun 05 03:19:18.606121 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:18.606092 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d89656e_2a40_45f7_9cf8_c8cd35cd5a61.slice/crio-1e6dc87993906018da7216d658da7007a5280d86cbe76769d6593d6d0eec08b6 WatchSource:0}: Error finding container 1e6dc87993906018da7216d658da7007a5280d86cbe76769d6593d6d0eec08b6: Status 404 returned error can't find the container with id 1e6dc87993906018da7216d658da7007a5280d86cbe76769d6593d6d0eec08b6 Jun 05 03:19:18.683773 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.683746 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd"] Jun 05 03:19:18.687165 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:18.687133 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a6cbe97_b455_4589_b424_e62d8bb044bd.slice/crio-fceb90c38d9233e154c77d083cc2314404df570666cd46b5fb0d7f680d7703e2 WatchSource:0}: Error finding container fceb90c38d9233e154c77d083cc2314404df570666cd46b5fb0d7f680d7703e2: Status 404 returned error can't find the container with id fceb90c38d9233e154c77d083cc2314404df570666cd46b5fb0d7f680d7703e2 Jun 05 03:19:18.738889 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.738631 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 03:19:18.770562 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.770536 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 03:19:18.770674 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.770658 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.773486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.773339 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 05 03:19:18.773656 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.773620 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 05 03:19:18.773656 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.773638 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4lswz\"" Jun 05 03:19:18.773762 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.773636 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 05 03:19:18.773762 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.773622 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 05 03:19:18.774029 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.774009 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 05 03:19:18.774135 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.774050 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 05 03:19:18.774135 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.774061 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 05 03:19:18.774242 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.774159 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 05 03:19:18.774242 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.774159 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 05 03:19:18.792902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.792633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a403f3-8b04-4256-a23a-f0130cdb9511-config-out\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.792902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.792669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.792902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.792704 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a403f3-8b04-4256-a23a-f0130cdb9511-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.792902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.792782 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.792902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.792807 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.792902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.792830 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a403f3-8b04-4256-a23a-f0130cdb9511-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.792902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.792863 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.793536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.793372 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.793536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.793418 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.793536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.793459 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a403f3-8b04-4256-a23a-f0130cdb9511-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.793536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.793490 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5qqs\" (UniqueName: \"kubernetes.io/projected/a0a403f3-8b04-4256-a23a-f0130cdb9511-kube-api-access-s5qqs\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.793765 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.793540 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a403f3-8b04-4256-a23a-f0130cdb9511-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.793765 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.793579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-web-config\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.894861 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.894835 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a403f3-8b04-4256-a23a-f0130cdb9511-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.894956 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.894873 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5qqs\" (UniqueName: \"kubernetes.io/projected/a0a403f3-8b04-4256-a23a-f0130cdb9511-kube-api-access-s5qqs\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.894956 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.894899 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a403f3-8b04-4256-a23a-f0130cdb9511-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.894956 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.894926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-web-config\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.894956 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.894954 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a403f3-8b04-4256-a23a-f0130cdb9511-config-out\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895132 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.894971 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895132 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.894999 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a403f3-8b04-4256-a23a-f0130cdb9511-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895132 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895083 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895132 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895110 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895348 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895135 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a403f3-8b04-4256-a23a-f0130cdb9511-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895348 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895296 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895527 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895509 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0a403f3-8b04-4256-a23a-f0130cdb9511-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895708 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895679 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0a403f3-8b04-4256-a23a-f0130cdb9511-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895803 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895775 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.895876 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.895817 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.896540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.896513 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0a403f3-8b04-4256-a23a-f0130cdb9511-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.898449 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.898114 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-web-config\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.898449 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.898411 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.899412 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.899078 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0a403f3-8b04-4256-a23a-f0130cdb9511-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.899412 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.899085 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0a403f3-8b04-4256-a23a-f0130cdb9511-config-out\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.899412 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.899147 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.899846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.899824 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.901181 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.900997 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.901775 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.901474 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.901775 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.901523 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0a403f3-8b04-4256-a23a-f0130cdb9511-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:18.903687 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:18.903648 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5qqs\" (UniqueName: \"kubernetes.io/projected/a0a403f3-8b04-4256-a23a-f0130cdb9511-kube-api-access-s5qqs\") pod \"alertmanager-main-0\" (UID: \"a0a403f3-8b04-4256-a23a-f0130cdb9511\") " pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:19.079907 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:19.079812 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 05 03:19:19.242077 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:19.242048 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 05 03:19:19.244753 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:19.244728 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a403f3_8b04_4256_a23a_f0130cdb9511.slice/crio-fead2b1f7d8f5722bebcca1c1367ce5c43fb4c461a90566ba54e08024edc56cf WatchSource:0}: Error finding container fead2b1f7d8f5722bebcca1c1367ce5c43fb4c461a90566ba54e08024edc56cf: Status 404 returned error can't find the container with id fead2b1f7d8f5722bebcca1c1367ce5c43fb4c461a90566ba54e08024edc56cf Jun 05 03:19:19.526480 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:19.526393 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mjw5" event={"ID":"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61","Type":"ContainerStarted","Data":"1e6dc87993906018da7216d658da7007a5280d86cbe76769d6593d6d0eec08b6"} Jun 05 03:19:19.528905 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:19.528869 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" event={"ID":"6a6cbe97-b455-4589-b424-e62d8bb044bd","Type":"ContainerStarted","Data":"8b511ae1fb59028cd923af9d634c43a5cdeac1d4c64487cbf352f5c1d2ee550c"} Jun 05 03:19:19.529019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:19.528943 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" event={"ID":"6a6cbe97-b455-4589-b424-e62d8bb044bd","Type":"ContainerStarted","Data":"5743c533da99c18d715fba66984d61650563614399d30f9569d27b9d699fc79b"} Jun 05 03:19:19.529019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:19.528977 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" event={"ID":"6a6cbe97-b455-4589-b424-e62d8bb044bd","Type":"ContainerStarted","Data":"fceb90c38d9233e154c77d083cc2314404df570666cd46b5fb0d7f680d7703e2"} Jun 05 03:19:19.530106 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:19.530078 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerStarted","Data":"fead2b1f7d8f5722bebcca1c1367ce5c43fb4c461a90566ba54e08024edc56cf"} Jun 05 03:19:20.539696 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.539662 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mjw5" event={"ID":"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61","Type":"ContainerStarted","Data":"f5bb777a9ff06fe86f5020e54ef5f1a1a69f03c611be5466f7bfde0321b1c167"} Jun 05 03:19:20.614246 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.614221 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj"] Jun 05 03:19:20.623827 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.623808 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.626054 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.626033 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 05 03:19:20.626165 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.626064 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4250964ntch6o\"" Jun 05 03:19:20.626165 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.626082 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 05 03:19:20.626165 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.626083 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 05 03:19:20.626348 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.626173 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 05 03:19:20.626589 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.626554 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-jbfpw\"" Jun 05 03:19:20.626675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.626569 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 05 03:19:20.628214 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.628190 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj"] Jun 05 03:19:20.709516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709440 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.709516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709485 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.709516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709515 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-tls\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.709704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709562 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-grpc-tls\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.709704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709596 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtmsw\" (UniqueName: \"kubernetes.io/projected/c01e6ead-3baf-4566-ac81-cc2f012488d2-kube-api-access-dtmsw\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.709704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709621 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.709704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709668 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.709704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.709687 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01e6ead-3baf-4566-ac81-cc2f012488d2-metrics-client-ca\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810392 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810356 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810400 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-tls\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810481 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-grpc-tls\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810511 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtmsw\" (UniqueName: \"kubernetes.io/projected/c01e6ead-3baf-4566-ac81-cc2f012488d2-kube-api-access-dtmsw\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810541 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810804 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810605 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.810804 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.810634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01e6ead-3baf-4566-ac81-cc2f012488d2-metrics-client-ca\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.811424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.811377 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c01e6ead-3baf-4566-ac81-cc2f012488d2-metrics-client-ca\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.813375 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.813352 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.813517 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.813496 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.813586 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.813540 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-grpc-tls\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.813756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.813735 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.814220 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.814187 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.814345 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.814301 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c01e6ead-3baf-4566-ac81-cc2f012488d2-secret-thanos-querier-tls\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.819758 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.819736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtmsw\" (UniqueName: \"kubernetes.io/projected/c01e6ead-3baf-4566-ac81-cc2f012488d2-kube-api-access-dtmsw\") pod \"thanos-querier-54b76c5dbb-tw7hj\" (UID: \"c01e6ead-3baf-4566-ac81-cc2f012488d2\") " pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:20.934405 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:20.934376 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:21.155541 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.155517 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj"] Jun 05 03:19:21.158301 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:21.158277 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01e6ead_3baf_4566_ac81_cc2f012488d2.slice/crio-e5f90589e2019ff6066b1d31fbd1aa7a3f96ffbedf958bc3d469e841bea2ab28 WatchSource:0}: Error finding container e5f90589e2019ff6066b1d31fbd1aa7a3f96ffbedf958bc3d469e841bea2ab28: Status 404 returned error can't find the container with id e5f90589e2019ff6066b1d31fbd1aa7a3f96ffbedf958bc3d469e841bea2ab28 Jun 05 03:19:21.544294 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.544264 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" event={"ID":"6a6cbe97-b455-4589-b424-e62d8bb044bd","Type":"ContainerStarted","Data":"72cf71cea4edd1e85515d844d94330e491263e64faab8d3ecd0a743904d0276e"} Jun 05 03:19:21.545606 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.545586 2552 generic.go:356] "Generic (PLEG): container finished" podID="a0a403f3-8b04-4256-a23a-f0130cdb9511" containerID="fe9b9d6630987a456e5809add7fa87cb39b3af1c2da6a95fb369c0b515634972" exitCode=0 Jun 05 03:19:21.545697 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.545659 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerDied","Data":"fe9b9d6630987a456e5809add7fa87cb39b3af1c2da6a95fb369c0b515634972"} Jun 05 03:19:21.546792 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.546765 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" event={"ID":"c01e6ead-3baf-4566-ac81-cc2f012488d2","Type":"ContainerStarted","Data":"e5f90589e2019ff6066b1d31fbd1aa7a3f96ffbedf958bc3d469e841bea2ab28"} Jun 05 03:19:21.548306 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.548279 2552 generic.go:356] "Generic (PLEG): container finished" podID="0d89656e-2a40-45f7-9cf8-c8cd35cd5a61" containerID="f5bb777a9ff06fe86f5020e54ef5f1a1a69f03c611be5466f7bfde0321b1c167" exitCode=0 Jun 05 03:19:21.548412 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.548302 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mjw5" event={"ID":"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61","Type":"ContainerDied","Data":"f5bb777a9ff06fe86f5020e54ef5f1a1a69f03c611be5466f7bfde0321b1c167"} Jun 05 03:19:21.559601 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:21.559564 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-bpzkd" podStartSLOduration=2.422173677 podStartE2EDuration="4.55955271s" totalImagesPullingTime="2.137379033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:21.558904137 +0000 UTC m=+50.729414247" watchObservedRunningTime="2026-06-05 03:19:21.55955271 +0000 UTC m=+50.730062810" Jun 05 03:19:22.429367 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.429338 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7565d74d7c-nb4l8"] Jun 05 03:19:22.455761 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.455737 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64d675dfc6-p2q5c"] Jun 05 03:19:22.466194 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.466168 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.467892 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.467867 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d675dfc6-p2q5c"] Jun 05 03:19:22.528148 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.528037 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhdzc\" (UniqueName: \"kubernetes.io/projected/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-kube-api-access-lhdzc\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.528148 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.528094 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-oauth-config\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.528148 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.528116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-service-ca\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.528462 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.528155 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-config\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.528462 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.528184 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-serving-cert\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.528462 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.528205 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-oauth-serving-cert\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.528462 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.528275 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-trusted-ca-bundle\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.555679 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.555635 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mjw5" event={"ID":"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61","Type":"ContainerStarted","Data":"da2c1666f75f4cc8c7c61213c8096b5a1b32806aa2c7c5bed12df65a177929d3"} Jun 05 03:19:22.556032 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.555705 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8mjw5" event={"ID":"0d89656e-2a40-45f7-9cf8-c8cd35cd5a61","Type":"ContainerStarted","Data":"75fbda779fceb043c865c9ac6c3407e8d53191c74efc13148e71c18dcbd4921b"} Jun 05 03:19:22.574751 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.574694 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8mjw5" podStartSLOduration=3.663015738 podStartE2EDuration="5.574680282s" totalImagesPullingTime="1.810038055s" totalInitContainerRuntime="101.626489ms" isStatefulPod=true podCreationTimestamp="2026-06-05 03:19:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:22.574104451 +0000 UTC m=+51.744614553" watchObservedRunningTime="2026-06-05 03:19:22.574680282 +0000 UTC m=+51.745190383" Jun 05 03:19:22.629271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.629236 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-oauth-config\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.629271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.629263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-service-ca\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.629452 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.629352 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-config\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.629452 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.629384 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-serving-cert\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.629452 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.629408 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-oauth-serving-cert\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.629452 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.629437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-trusted-ca-bundle\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.629703 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.629683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhdzc\" (UniqueName: \"kubernetes.io/projected/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-kube-api-access-lhdzc\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.630369 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.630017 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-service-ca\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.630369 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.630051 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-config\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.630852 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.630823 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-trusted-ca-bundle\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.630990 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.630964 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-oauth-serving-cert\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.638249 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.638203 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhdzc\" (UniqueName: \"kubernetes.io/projected/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-kube-api-access-lhdzc\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.639058 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.639031 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-serving-cert\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.639402 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.639373 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-oauth-config\") pod \"console-64d675dfc6-p2q5c\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:22.779505 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:22.779430 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:23.506605 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:23.506582 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sb46z" Jun 05 03:19:23.922407 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:23.922377 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64d675dfc6-p2q5c"] Jun 05 03:19:23.926196 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:23.926147 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f6f5b8_62bf_47a7_a0f0_38fcaae50b5a.slice/crio-7145a49920c6ca15928cc24554e9f3a8140cd7f841bb1b7d40dd62903558c228 WatchSource:0}: Error finding container 7145a49920c6ca15928cc24554e9f3a8140cd7f841bb1b7d40dd62903558c228: Status 404 returned error can't find the container with id 7145a49920c6ca15928cc24554e9f3a8140cd7f841bb1b7d40dd62903558c228 Jun 05 03:19:24.565847 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.565817 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerStarted","Data":"0256cb71cd6de57d14c41a140163caeb57425b9e08094904b8d8d19057c61775"} Jun 05 03:19:24.565972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.565878 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerStarted","Data":"d36efad470cc8e7d185780f1a9d1d7498884842ec8f87e4e50ea8e8648fdb4ff"} Jun 05 03:19:24.565972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.565902 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerStarted","Data":"f1bb56be57239f2428f2509e94e5abee7cc8a7f46f16e8f30ed19d649473b537"} Jun 05 03:19:24.565972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.565927 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerStarted","Data":"f5b631b234842154c46ae0a66b365efb4d731ae9be18fb3a939c53a7cd9901ec"} Jun 05 03:19:24.565972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.565949 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerStarted","Data":"3abee7039ba4b311685e102db4abe5e9db51a33b83f5964cb4bb77e96d35d22a"} Jun 05 03:19:24.567374 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.567346 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d675dfc6-p2q5c" event={"ID":"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a","Type":"ContainerStarted","Data":"0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15"} Jun 05 03:19:24.567482 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.567397 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d675dfc6-p2q5c" event={"ID":"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a","Type":"ContainerStarted","Data":"7145a49920c6ca15928cc24554e9f3a8140cd7f841bb1b7d40dd62903558c228"} Jun 05 03:19:24.569247 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.569227 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" event={"ID":"c01e6ead-3baf-4566-ac81-cc2f012488d2","Type":"ContainerStarted","Data":"5e90ce81dd0ebda0188bf5ecdf6939ad8ddcbeb8452d71b6507026b1ea9f0255"} Jun 05 03:19:24.569340 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.569277 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" event={"ID":"c01e6ead-3baf-4566-ac81-cc2f012488d2","Type":"ContainerStarted","Data":"7b42168d264f89a9e34e00f4f3a9b05210e0633300fa7c0462e1450f6ace25c0"} Jun 05 03:19:24.569340 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.569308 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" event={"ID":"c01e6ead-3baf-4566-ac81-cc2f012488d2","Type":"ContainerStarted","Data":"5989853694f4fe5ed22d90e21c1a13f1c84afa11a5ef513e31c84080d9f8b326"} Jun 05 03:19:24.585430 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:24.585389 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64d675dfc6-p2q5c" podStartSLOduration=2.585375549 podStartE2EDuration="2.585375549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:24.584866292 +0000 UTC m=+53.755376395" watchObservedRunningTime="2026-06-05 03:19:24.585375549 +0000 UTC m=+53.755885649" Jun 05 03:19:26.578640 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:26.578600 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" event={"ID":"c01e6ead-3baf-4566-ac81-cc2f012488d2","Type":"ContainerStarted","Data":"2d9de51bcc061dfe9f60dc6dfa2dd1b69d02b1596633272c42b86770d1dffcf0"} Jun 05 03:19:26.579097 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:26.578710 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" event={"ID":"c01e6ead-3baf-4566-ac81-cc2f012488d2","Type":"ContainerStarted","Data":"30ff12177e6639795ef52870c7545b098b9e4462be6b1ae60920eae81c9ab465"} Jun 05 03:19:26.579097 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:26.578750 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" event={"ID":"c01e6ead-3baf-4566-ac81-cc2f012488d2","Type":"ContainerStarted","Data":"98cb7f791e917c7f4175efcb03211329cfbdd6639b49b66bceca003718e16c79"} Jun 05 03:19:26.579097 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:26.578793 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:26.582159 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:26.582129 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0a403f3-8b04-4256-a23a-f0130cdb9511","Type":"ContainerStarted","Data":"b606953426bb0a1a7fd739f3936dce9d818e038485498b4d9fea72cee2fc0ba7"} Jun 05 03:19:26.599855 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:26.599810 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" podStartSLOduration=2.536786421 podStartE2EDuration="6.599795658s" totalImagesPullingTime="4.063009237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:26.598546599 +0000 UTC m=+55.769056701" watchObservedRunningTime="2026-06-05 03:19:26.599795658 +0000 UTC m=+55.770305759" Jun 05 03:19:26.620833 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:26.620783 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.012660069 podStartE2EDuration="8.620767694s" totalImagesPullingTime="5.595387979s" totalInitContainerRuntime="12.719646ms" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:26.620493427 +0000 UTC m=+55.791003544" watchObservedRunningTime="2026-06-05 03:19:26.620767694 +0000 UTC m=+55.791277790" Jun 05 03:19:27.040852 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.040758 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d675dfc6-p2q5c"] Jun 05 03:19:27.074600 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.074571 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b84cf445-xlqtc"] Jun 05 03:19:27.076603 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.076582 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.085113 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.085088 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b84cf445-xlqtc"] Jun 05 03:19:27.168565 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.168533 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-serving-cert\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.168565 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.168569 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-service-ca\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.168756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.168610 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-oauth-config\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.168756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.168639 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m74r7\" (UniqueName: \"kubernetes.io/projected/c2fdc105-6680-4ee2-b2db-3dc195181604-kube-api-access-m74r7\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.168756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.168681 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-oauth-serving-cert\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.168756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.168704 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-trusted-ca-bundle\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.168756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.168739 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-console-config\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.269384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.269347 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-console-config\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.269559 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.269439 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-serving-cert\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.269559 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.269472 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-service-ca\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.269559 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.269512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-oauth-config\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.269718 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.269572 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m74r7\" (UniqueName: \"kubernetes.io/projected/c2fdc105-6680-4ee2-b2db-3dc195181604-kube-api-access-m74r7\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.269769 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.269708 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-oauth-serving-cert\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.269769 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.269748 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-trusted-ca-bundle\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.270144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.270114 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-console-config\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.270418 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.270386 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-oauth-serving-cert\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.270666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.270644 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-service-ca\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.270732 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.270699 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-trusted-ca-bundle\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.271963 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.271934 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-oauth-config\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.272331 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.272302 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-serving-cert\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.277582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.277559 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m74r7\" (UniqueName: \"kubernetes.io/projected/c2fdc105-6680-4ee2-b2db-3dc195181604-kube-api-access-m74r7\") pod \"console-8b84cf445-xlqtc\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.386688 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.386659 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:27.509437 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.509406 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b84cf445-xlqtc"] Jun 05 03:19:27.512114 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:27.512086 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2fdc105_6680_4ee2_b2db_3dc195181604.slice/crio-562d5c550d4864ee72411caf9c96224bbadfcefed77b63dfeb774fcb8c7bfd46 WatchSource:0}: Error finding container 562d5c550d4864ee72411caf9c96224bbadfcefed77b63dfeb774fcb8c7bfd46: Status 404 returned error can't find the container with id 562d5c550d4864ee72411caf9c96224bbadfcefed77b63dfeb774fcb8c7bfd46 Jun 05 03:19:27.587409 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.587376 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b84cf445-xlqtc" event={"ID":"c2fdc105-6680-4ee2-b2db-3dc195181604","Type":"ContainerStarted","Data":"12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729"} Jun 05 03:19:27.587777 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.587442 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b84cf445-xlqtc" event={"ID":"c2fdc105-6680-4ee2-b2db-3dc195181604","Type":"ContainerStarted","Data":"562d5c550d4864ee72411caf9c96224bbadfcefed77b63dfeb774fcb8c7bfd46"} Jun 05 03:19:27.603823 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:27.603769 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b84cf445-xlqtc" podStartSLOduration=0.603749741 podStartE2EDuration="603.749741ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:27.602280251 +0000 UTC m=+56.772790353" watchObservedRunningTime="2026-06-05 03:19:27.603749741 +0000 UTC m=+56.774259842" Jun 05 03:19:32.447693 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:32.447665 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lqh2n" Jun 05 03:19:32.593606 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:32.593584 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54b76c5dbb-tw7hj" Jun 05 03:19:32.779598 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:32.779530 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:37.054873 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.054830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:37.054873 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.054875 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:37.055516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.054915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:37.057031 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.057012 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 03:19:37.057614 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.057599 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 03:19:37.057668 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.057603 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 03:19:37.066894 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.066876 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 03:19:37.067455 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.067435 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77-original-pull-secret\") pod \"global-pull-secret-syncer-n4pkr\" (UID: \"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77\") " pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:37.067537 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.067510 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/080e95bc-53d2-476e-bd90-1f99cb0e5d09-metrics-certs\") pod \"network-metrics-daemon-vxwwt\" (UID: \"080e95bc-53d2-476e-bd90-1f99cb0e5d09\") " pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:37.077920 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.077898 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbf4k\" (UniqueName: \"kubernetes.io/projected/dcdea0ea-f7d5-463b-9101-20a483f5948d-kube-api-access-gbf4k\") pod \"network-check-target-9qmp9\" (UID: \"dcdea0ea-f7d5-463b-9101-20a483f5948d\") " pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:37.200301 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.200281 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9rln\"" Jun 05 03:19:37.206900 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.206882 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cqspf\"" Jun 05 03:19:37.208521 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.208507 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vxwwt" Jun 05 03:19:37.210756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.210742 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n4pkr" Jun 05 03:19:37.215391 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.215376 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:37.351419 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.350911 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n4pkr"] Jun 05 03:19:37.353519 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:37.353490 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0daf59cc_ca3b_4fb3_9ed1_a9a5c00e7a77.slice/crio-71b1af7a366bc208c84b574583cfb334896eff3fdc69d3879c633fef94e26a08 WatchSource:0}: Error finding container 71b1af7a366bc208c84b574583cfb334896eff3fdc69d3879c633fef94e26a08: Status 404 returned error can't find the container with id 71b1af7a366bc208c84b574583cfb334896eff3fdc69d3879c633fef94e26a08 Jun 05 03:19:37.370846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.370823 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9qmp9"] Jun 05 03:19:37.373262 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:37.373229 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcdea0ea_f7d5_463b_9101_20a483f5948d.slice/crio-bdab7fc99cd23af3c7714707438c27fa5810abe78a1e80304ac2c62e15f4bcff WatchSource:0}: Error finding container bdab7fc99cd23af3c7714707438c27fa5810abe78a1e80304ac2c62e15f4bcff: Status 404 returned error can't find the container with id bdab7fc99cd23af3c7714707438c27fa5810abe78a1e80304ac2c62e15f4bcff Jun 05 03:19:37.387551 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.387526 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:37.387651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.387597 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:37.390242 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.390220 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vxwwt"] Jun 05 03:19:37.393251 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:19:37.393131 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080e95bc_53d2_476e_bd90_1f99cb0e5d09.slice/crio-8e191149944433ee83339b8cdb8011906ba766d1ac93e9e29989a1535d293836 WatchSource:0}: Error finding container 8e191149944433ee83339b8cdb8011906ba766d1ac93e9e29989a1535d293836: Status 404 returned error can't find the container with id 8e191149944433ee83339b8cdb8011906ba766d1ac93e9e29989a1535d293836 Jun 05 03:19:37.393404 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.393349 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:37.623847 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.623758 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9qmp9" event={"ID":"dcdea0ea-f7d5-463b-9101-20a483f5948d","Type":"ContainerStarted","Data":"bdab7fc99cd23af3c7714707438c27fa5810abe78a1e80304ac2c62e15f4bcff"} Jun 05 03:19:37.625002 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.624980 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4pkr" event={"ID":"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77","Type":"ContainerStarted","Data":"71b1af7a366bc208c84b574583cfb334896eff3fdc69d3879c633fef94e26a08"} Jun 05 03:19:37.627589 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.627274 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxwwt" event={"ID":"080e95bc-53d2-476e-bd90-1f99cb0e5d09","Type":"ContainerStarted","Data":"8e191149944433ee83339b8cdb8011906ba766d1ac93e9e29989a1535d293836"} Jun 05 03:19:37.630864 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:37.630845 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:19:39.639853 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:39.639815 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxwwt" event={"ID":"080e95bc-53d2-476e-bd90-1f99cb0e5d09","Type":"ContainerStarted","Data":"12b88d2ca263206cb282f73fe78103979e98e5bbce5cc18644165e9c3959cd2a"} Jun 05 03:19:39.640261 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:39.639881 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vxwwt" event={"ID":"080e95bc-53d2-476e-bd90-1f99cb0e5d09","Type":"ContainerStarted","Data":"229bf45aa18c8d9f689eeba1050c06a8863b49a1b553205a2df563c850e06b27"} Jun 05 03:19:39.656809 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:39.656759 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vxwwt" podStartSLOduration=67.163520727 podStartE2EDuration="1m8.656741193s" totalImagesPullingTime="1.493220466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:39.65476451 +0000 UTC m=+68.825274613" watchObservedRunningTime="2026-06-05 03:19:39.656741193 +0000 UTC m=+68.827251322" Jun 05 03:19:42.651117 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:42.651088 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9qmp9" event={"ID":"dcdea0ea-f7d5-463b-9101-20a483f5948d","Type":"ContainerStarted","Data":"b41febba7084bdeb90983e7bd286672e0fada5aab6d9ac73a4e05725e4edf500"} Jun 05 03:19:42.651420 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:42.651179 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:19:42.667409 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:42.667370 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9qmp9" podStartSLOduration=66.548034944 podStartE2EDuration="1m11.667357343s" totalImagesPullingTime="5.119322399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:42.665426445 +0000 UTC m=+71.835936548" watchObservedRunningTime="2026-06-05 03:19:42.667357343 +0000 UTC m=+71.837867444" Jun 05 03:19:43.656207 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:43.656168 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n4pkr" event={"ID":"0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77","Type":"ContainerStarted","Data":"e42dbc43e3a2b86a495a9fa0fa8e12eb7c95daf4042800c814128dcbdf7c3b12"} Jun 05 03:19:43.681989 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:43.681946 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n4pkr" podStartSLOduration=67.531800921 podStartE2EDuration="1m12.68193197s" totalImagesPullingTime="5.150131049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:19:43.681253454 +0000 UTC m=+72.851763565" watchObservedRunningTime="2026-06-05 03:19:43.68193197 +0000 UTC m=+72.852442071" Jun 05 03:19:47.449677 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.449609 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7565d74d7c-nb4l8" podUID="201b64d2-0be6-4f28-b6d4-ec700f82d5be" containerName="console" containerID="cri-o://ed554e7477b1e499b5efc5656c3abfc14c69a8d32cda1849837193850e69d8fb" gracePeriod=15 Jun 05 03:19:47.673858 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.673824 2552 generic.go:356] "Generic (PLEG): container finished" podID="201b64d2-0be6-4f28-b6d4-ec700f82d5be" containerID="ed554e7477b1e499b5efc5656c3abfc14c69a8d32cda1849837193850e69d8fb" exitCode=0 Jun 05 03:19:47.673985 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.673867 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7565d74d7c-nb4l8" event={"ID":"201b64d2-0be6-4f28-b6d4-ec700f82d5be","Type":"ContainerDied","Data":"ed554e7477b1e499b5efc5656c3abfc14c69a8d32cda1849837193850e69d8fb"} Jun 05 03:19:47.692222 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.692203 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:47.841762 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.841737 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-serving-cert\") pod \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " Jun 05 03:19:47.841902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.841784 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-oauth-config\") pod \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " Jun 05 03:19:47.841902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.841815 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h86s2\" (UniqueName: \"kubernetes.io/projected/201b64d2-0be6-4f28-b6d4-ec700f82d5be-kube-api-access-h86s2\") pod \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " Jun 05 03:19:47.841902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.841852 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-service-ca\") pod \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " Jun 05 03:19:47.841902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.841867 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-config\") pod \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " Jun 05 03:19:47.841902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.841892 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-oauth-serving-cert\") pod \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " Jun 05 03:19:47.842157 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.841938 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-trusted-ca-bundle\") pod \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\" (UID: \"201b64d2-0be6-4f28-b6d4-ec700f82d5be\") " Jun 05 03:19:47.842435 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842298 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-service-ca" (OuterVolumeSpecName: "service-ca") pod "201b64d2-0be6-4f28-b6d4-ec700f82d5be" (UID: "201b64d2-0be6-4f28-b6d4-ec700f82d5be"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:47.842540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842306 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-config" (OuterVolumeSpecName: "console-config") pod "201b64d2-0be6-4f28-b6d4-ec700f82d5be" (UID: "201b64d2-0be6-4f28-b6d4-ec700f82d5be"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:47.842540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842312 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "201b64d2-0be6-4f28-b6d4-ec700f82d5be" (UID: "201b64d2-0be6-4f28-b6d4-ec700f82d5be"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:47.842540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842346 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "201b64d2-0be6-4f28-b6d4-ec700f82d5be" (UID: "201b64d2-0be6-4f28-b6d4-ec700f82d5be"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:47.842653 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842616 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-service-ca\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:47.842653 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842636 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:47.842653 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842649 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-oauth-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:47.842752 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.842662 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/201b64d2-0be6-4f28-b6d4-ec700f82d5be-trusted-ca-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:47.844189 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.844171 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/201b64d2-0be6-4f28-b6d4-ec700f82d5be-kube-api-access-h86s2" (OuterVolumeSpecName: "kube-api-access-h86s2") pod "201b64d2-0be6-4f28-b6d4-ec700f82d5be" (UID: "201b64d2-0be6-4f28-b6d4-ec700f82d5be"). InnerVolumeSpecName "kube-api-access-h86s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:19:47.844364 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.844343 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "201b64d2-0be6-4f28-b6d4-ec700f82d5be" (UID: "201b64d2-0be6-4f28-b6d4-ec700f82d5be"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:19:47.844438 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.844400 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "201b64d2-0be6-4f28-b6d4-ec700f82d5be" (UID: "201b64d2-0be6-4f28-b6d4-ec700f82d5be"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:19:47.943279 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.943257 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:47.943279 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.943276 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/201b64d2-0be6-4f28-b6d4-ec700f82d5be-console-oauth-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:47.943420 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:47.943284 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h86s2\" (UniqueName: \"kubernetes.io/projected/201b64d2-0be6-4f28-b6d4-ec700f82d5be-kube-api-access-h86s2\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:48.678865 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:48.678829 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7565d74d7c-nb4l8" event={"ID":"201b64d2-0be6-4f28-b6d4-ec700f82d5be","Type":"ContainerDied","Data":"27e9a2ede539bd6296de41d8ec7919036236f856233331acbe54fd39e9dbcc44"} Jun 05 03:19:48.678865 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:48.678862 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7565d74d7c-nb4l8" Jun 05 03:19:48.679302 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:48.678897 2552 scope.go:117] "RemoveContainer" containerID="ed554e7477b1e499b5efc5656c3abfc14c69a8d32cda1849837193850e69d8fb" Jun 05 03:19:48.697393 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:48.697365 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7565d74d7c-nb4l8"] Jun 05 03:19:48.700819 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:48.700795 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7565d74d7c-nb4l8"] Jun 05 03:19:49.290982 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:49.290951 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="201b64d2-0be6-4f28-b6d4-ec700f82d5be" path="/var/lib/kubelet/pods/201b64d2-0be6-4f28-b6d4-ec700f82d5be/volumes" Jun 05 03:19:52.069219 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.069043 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64d675dfc6-p2q5c" podUID="f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" containerName="console" containerID="cri-o://0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15" gracePeriod=15 Jun 05 03:19:52.311234 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.311210 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:52.475387 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475256 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhdzc\" (UniqueName: \"kubernetes.io/projected/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-kube-api-access-lhdzc\") pod \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " Jun 05 03:19:52.475387 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475333 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-trusted-ca-bundle\") pod \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " Jun 05 03:19:52.475387 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475371 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-oauth-config\") pod \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " Jun 05 03:19:52.475667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475540 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-serving-cert\") pod \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " Jun 05 03:19:52.475667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475587 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-config\") pod \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " Jun 05 03:19:52.475667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475625 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-oauth-serving-cert\") pod \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " Jun 05 03:19:52.475831 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475687 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-service-ca\") pod \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\" (UID: \"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a\") " Jun 05 03:19:52.475949 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.475919 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" (UID: "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:52.476036 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.476010 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-config" (OuterVolumeSpecName: "console-config") pod "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" (UID: "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:52.476180 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.476147 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" (UID: "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:52.476239 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.476224 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" (UID: "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:19:52.477670 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.477651 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" (UID: "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:19:52.478000 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.477968 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-kube-api-access-lhdzc" (OuterVolumeSpecName: "kube-api-access-lhdzc") pod "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" (UID: "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a"). InnerVolumeSpecName "kube-api-access-lhdzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:19:52.478000 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.477968 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" (UID: "f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:19:52.576540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.576516 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-oauth-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:52.576540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.576537 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-service-ca\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:52.576675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.576546 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhdzc\" (UniqueName: \"kubernetes.io/projected/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-kube-api-access-lhdzc\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:52.576675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.576556 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-trusted-ca-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:52.576675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.576564 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-oauth-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:52.576675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.576572 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:52.576675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.576580 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a-console-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:19:52.694907 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.694875 2552 generic.go:356] "Generic (PLEG): container finished" podID="f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" containerID="0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15" exitCode=0 Jun 05 03:19:52.695026 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.694918 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64d675dfc6-p2q5c" Jun 05 03:19:52.695026 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.694961 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d675dfc6-p2q5c" event={"ID":"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a","Type":"ContainerDied","Data":"0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15"} Jun 05 03:19:52.695115 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.695029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64d675dfc6-p2q5c" event={"ID":"f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a","Type":"ContainerDied","Data":"7145a49920c6ca15928cc24554e9f3a8140cd7f841bb1b7d40dd62903558c228"} Jun 05 03:19:52.695115 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.695049 2552 scope.go:117] "RemoveContainer" containerID="0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15" Jun 05 03:19:52.704025 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.704009 2552 scope.go:117] "RemoveContainer" containerID="0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15" Jun 05 03:19:52.704258 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:19:52.704240 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15\": container with ID starting with 0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15 not found: ID does not exist" containerID="0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15" Jun 05 03:19:52.704303 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.704265 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15"} err="failed to get container status \"0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15\": rpc error: code = NotFound desc = could not find container \"0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15\": container with ID starting with 0c64b6b25edf70870e6aba96ab654cd0ba53847e2e6b473fd4081a0fa067fd15 not found: ID does not exist" Jun 05 03:19:52.713972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.713952 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64d675dfc6-p2q5c"] Jun 05 03:19:52.717667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:52.717648 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64d675dfc6-p2q5c"] Jun 05 03:19:53.289870 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:19:53.289841 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" path="/var/lib/kubelet/pods/f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a/volumes" Jun 05 03:20:13.659054 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:13.659024 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9qmp9" Jun 05 03:20:33.773972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.773937 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b6748fff7-j2tg8"] Jun 05 03:20:33.774424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.774240 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" containerName="console" Jun 05 03:20:33.774424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.774254 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" containerName="console" Jun 05 03:20:33.774424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.774276 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="201b64d2-0be6-4f28-b6d4-ec700f82d5be" containerName="console" Jun 05 03:20:33.774424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.774282 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="201b64d2-0be6-4f28-b6d4-ec700f82d5be" containerName="console" Jun 05 03:20:33.774424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.774362 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f6f5b8-62bf-47a7-a0f0-38fcaae50b5a" containerName="console" Jun 05 03:20:33.774424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.774374 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="201b64d2-0be6-4f28-b6d4-ec700f82d5be" containerName="console" Jun 05 03:20:33.777262 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.777241 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.787371 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.787341 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6748fff7-j2tg8"] Jun 05 03:20:33.863364 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.863340 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-config\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.863480 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.863366 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnzck\" (UniqueName: \"kubernetes.io/projected/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-kube-api-access-xnzck\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.863480 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.863387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-serving-cert\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.863480 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.863458 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-oauth-config\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.863480 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.863474 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-service-ca\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.863646 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.863500 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-oauth-serving-cert\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.863646 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.863575 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-trusted-ca-bundle\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.964696 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.964665 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-trusted-ca-bundle\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.964822 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.964702 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-config\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.964822 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.964736 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnzck\" (UniqueName: \"kubernetes.io/projected/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-kube-api-access-xnzck\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.964822 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.964759 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-serving-cert\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.964980 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.964901 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-oauth-config\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.964980 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.964943 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-service-ca\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.964980 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.964979 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-oauth-serving-cert\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.965590 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.965555 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-config\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.965813 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.965788 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-trusted-ca-bundle\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.965866 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.965846 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-oauth-serving-cert\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.965902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.965855 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-service-ca\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.967662 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.967636 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-serving-cert\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.967749 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.967671 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-oauth-config\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:33.972046 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:33.972023 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnzck\" (UniqueName: \"kubernetes.io/projected/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-kube-api-access-xnzck\") pod \"console-7b6748fff7-j2tg8\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:34.088235 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:34.088211 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:34.211252 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:34.211183 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b6748fff7-j2tg8"] Jun 05 03:20:34.213875 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:20:34.213847 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39e86a2_b8f3_47ab_acc8_93591e5fc95f.slice/crio-9356b32e7fd13ab8ab9a4feb1ba83a04e4ce78e34f39fe9a9834076f6375d7e9 WatchSource:0}: Error finding container 9356b32e7fd13ab8ab9a4feb1ba83a04e4ce78e34f39fe9a9834076f6375d7e9: Status 404 returned error can't find the container with id 9356b32e7fd13ab8ab9a4feb1ba83a04e4ce78e34f39fe9a9834076f6375d7e9 Jun 05 03:20:34.858994 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:34.858958 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6748fff7-j2tg8" event={"ID":"d39e86a2-b8f3-47ab-acc8-93591e5fc95f","Type":"ContainerStarted","Data":"00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af"} Jun 05 03:20:34.859417 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:34.859011 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6748fff7-j2tg8" event={"ID":"d39e86a2-b8f3-47ab-acc8-93591e5fc95f","Type":"ContainerStarted","Data":"9356b32e7fd13ab8ab9a4feb1ba83a04e4ce78e34f39fe9a9834076f6375d7e9"} Jun 05 03:20:34.880052 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:34.880003 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b6748fff7-j2tg8" podStartSLOduration=1.879987017 podStartE2EDuration="1.879987017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:20:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:20:34.878856758 +0000 UTC m=+124.049366875" watchObservedRunningTime="2026-06-05 03:20:34.879987017 +0000 UTC m=+124.050497118" Jun 05 03:20:44.088856 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:44.088822 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:44.089356 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:44.088877 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:44.093694 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:44.093672 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:44.904695 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:44.904667 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:20:44.948236 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:20:44.948205 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b84cf445-xlqtc"] Jun 05 03:21:09.971665 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:09.971602 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8b84cf445-xlqtc" podUID="c2fdc105-6680-4ee2-b2db-3dc195181604" containerName="console" containerID="cri-o://12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729" gracePeriod=15 Jun 05 03:21:10.213056 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.213031 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:21:10.311454 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.311429 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-serving-cert\") pod \"c2fdc105-6680-4ee2-b2db-3dc195181604\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " Jun 05 03:21:10.311596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.311464 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-service-ca\") pod \"c2fdc105-6680-4ee2-b2db-3dc195181604\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " Jun 05 03:21:10.311596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.311480 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-oauth-config\") pod \"c2fdc105-6680-4ee2-b2db-3dc195181604\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " Jun 05 03:21:10.311596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.311506 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m74r7\" (UniqueName: \"kubernetes.io/projected/c2fdc105-6680-4ee2-b2db-3dc195181604-kube-api-access-m74r7\") pod \"c2fdc105-6680-4ee2-b2db-3dc195181604\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " Jun 05 03:21:10.311596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.311531 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-oauth-serving-cert\") pod \"c2fdc105-6680-4ee2-b2db-3dc195181604\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " Jun 05 03:21:10.311596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.311577 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-console-config\") pod \"c2fdc105-6680-4ee2-b2db-3dc195181604\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " Jun 05 03:21:10.311846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.311631 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-trusted-ca-bundle\") pod \"c2fdc105-6680-4ee2-b2db-3dc195181604\" (UID: \"c2fdc105-6680-4ee2-b2db-3dc195181604\") " Jun 05 03:21:10.312065 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.312032 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c2fdc105-6680-4ee2-b2db-3dc195181604" (UID: "c2fdc105-6680-4ee2-b2db-3dc195181604"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:21:10.312171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.312060 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-console-config" (OuterVolumeSpecName: "console-config") pod "c2fdc105-6680-4ee2-b2db-3dc195181604" (UID: "c2fdc105-6680-4ee2-b2db-3dc195181604"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:21:10.312171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.312079 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-service-ca" (OuterVolumeSpecName: "service-ca") pod "c2fdc105-6680-4ee2-b2db-3dc195181604" (UID: "c2fdc105-6680-4ee2-b2db-3dc195181604"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:21:10.312171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.312161 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c2fdc105-6680-4ee2-b2db-3dc195181604" (UID: "c2fdc105-6680-4ee2-b2db-3dc195181604"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:21:10.313758 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.313735 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2fdc105-6680-4ee2-b2db-3dc195181604-kube-api-access-m74r7" (OuterVolumeSpecName: "kube-api-access-m74r7") pod "c2fdc105-6680-4ee2-b2db-3dc195181604" (UID: "c2fdc105-6680-4ee2-b2db-3dc195181604"). InnerVolumeSpecName "kube-api-access-m74r7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:21:10.314143 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.314116 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c2fdc105-6680-4ee2-b2db-3dc195181604" (UID: "c2fdc105-6680-4ee2-b2db-3dc195181604"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:21:10.314229 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.314188 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c2fdc105-6680-4ee2-b2db-3dc195181604" (UID: "c2fdc105-6680-4ee2-b2db-3dc195181604"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:21:10.412418 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.412396 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-console-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:10.412418 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.412416 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-trusted-ca-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:10.412536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.412425 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:10.412536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.412434 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-service-ca\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:10.412536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.412442 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c2fdc105-6680-4ee2-b2db-3dc195181604-console-oauth-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:10.412536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.412450 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m74r7\" (UniqueName: \"kubernetes.io/projected/c2fdc105-6680-4ee2-b2db-3dc195181604-kube-api-access-m74r7\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:10.412536 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:10.412458 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c2fdc105-6680-4ee2-b2db-3dc195181604-oauth-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:11.002952 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.002915 2552 generic.go:356] "Generic (PLEG): container finished" podID="c2fdc105-6680-4ee2-b2db-3dc195181604" containerID="12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729" exitCode=0 Jun 05 03:21:11.003353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.002984 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b84cf445-xlqtc" Jun 05 03:21:11.003353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.003006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b84cf445-xlqtc" event={"ID":"c2fdc105-6680-4ee2-b2db-3dc195181604","Type":"ContainerDied","Data":"12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729"} Jun 05 03:21:11.003353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.003064 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b84cf445-xlqtc" event={"ID":"c2fdc105-6680-4ee2-b2db-3dc195181604","Type":"ContainerDied","Data":"562d5c550d4864ee72411caf9c96224bbadfcefed77b63dfeb774fcb8c7bfd46"} Jun 05 03:21:11.003353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.003087 2552 scope.go:117] "RemoveContainer" containerID="12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729" Jun 05 03:21:11.011638 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.011620 2552 scope.go:117] "RemoveContainer" containerID="12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729" Jun 05 03:21:11.011899 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:21:11.011878 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729\": container with ID starting with 12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729 not found: ID does not exist" containerID="12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729" Jun 05 03:21:11.011964 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.011905 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729"} err="failed to get container status \"12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729\": rpc error: code = NotFound desc = could not find container \"12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729\": container with ID starting with 12264fa703fed0e7adcf29ed28aa257ac9ac6d6280e18d65f786b356156f0729 not found: ID does not exist" Jun 05 03:21:11.022027 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.022004 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b84cf445-xlqtc"] Jun 05 03:21:11.025431 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.025411 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b84cf445-xlqtc"] Jun 05 03:21:11.290272 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:11.290204 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2fdc105-6680-4ee2-b2db-3dc195181604" path="/var/lib/kubelet/pods/c2fdc105-6680-4ee2-b2db-3dc195181604/volumes" Jun 05 03:21:35.619287 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.619256 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f"] Jun 05 03:21:35.619813 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.619687 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2fdc105-6680-4ee2-b2db-3dc195181604" containerName="console" Jun 05 03:21:35.619813 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.619705 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2fdc105-6680-4ee2-b2db-3dc195181604" containerName="console" Jun 05 03:21:35.619813 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.619765 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2fdc105-6680-4ee2-b2db-3dc195181604" containerName="console" Jun 05 03:21:35.623869 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.623849 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.626288 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.626266 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:21:35.626884 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.626866 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2k9hz\"" Jun 05 03:21:35.627001 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.626893 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:21:35.632410 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.632386 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f"] Jun 05 03:21:35.794364 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.794335 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.794466 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.794376 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qj54\" (UniqueName: \"kubernetes.io/projected/4c8a0eee-4791-4a32-944d-519f9b3e3921-kube-api-access-6qj54\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.794466 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.794396 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.895592 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.895535 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.895592 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.895570 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qj54\" (UniqueName: \"kubernetes.io/projected/4c8a0eee-4791-4a32-944d-519f9b3e3921-kube-api-access-6qj54\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.895592 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.895589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.895935 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.895913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.896046 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.895958 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.903233 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.903207 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qj54\" (UniqueName: \"kubernetes.io/projected/4c8a0eee-4791-4a32-944d-519f9b3e3921-kube-api-access-6qj54\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:35.933559 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:35.933539 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:36.057527 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:36.057501 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f"] Jun 05 03:21:36.059605 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:21:36.059582 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8a0eee_4791_4a32_944d_519f9b3e3921.slice/crio-a68fbdf66049f5f9d0828e3103ddd7eb333a6dd6b3a12f730f138d412845d849 WatchSource:0}: Error finding container a68fbdf66049f5f9d0828e3103ddd7eb333a6dd6b3a12f730f138d412845d849: Status 404 returned error can't find the container with id a68fbdf66049f5f9d0828e3103ddd7eb333a6dd6b3a12f730f138d412845d849 Jun 05 03:21:36.097787 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:36.097750 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" event={"ID":"4c8a0eee-4791-4a32-944d-519f9b3e3921","Type":"ContainerStarted","Data":"a68fbdf66049f5f9d0828e3103ddd7eb333a6dd6b3a12f730f138d412845d849"} Jun 05 03:21:43.124464 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:43.124427 2552 generic.go:356] "Generic (PLEG): container finished" podID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerID="faa1f5771241f3841a5800d219c3353abdd80a158ffafaadab7018c4d2598c94" exitCode=0 Jun 05 03:21:43.124887 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:43.124503 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" event={"ID":"4c8a0eee-4791-4a32-944d-519f9b3e3921","Type":"ContainerDied","Data":"faa1f5771241f3841a5800d219c3353abdd80a158ffafaadab7018c4d2598c94"} Jun 05 03:21:46.137718 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:46.137687 2552 generic.go:356] "Generic (PLEG): container finished" podID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerID="d41e893a2991256182ab5cf7745b9a91b9f14e0a49a41ee0116cfd91e9afdb69" exitCode=0 Jun 05 03:21:46.138111 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:46.137729 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" event={"ID":"4c8a0eee-4791-4a32-944d-519f9b3e3921","Type":"ContainerDied","Data":"d41e893a2991256182ab5cf7745b9a91b9f14e0a49a41ee0116cfd91e9afdb69"} Jun 05 03:21:53.168879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:53.168844 2552 generic.go:356] "Generic (PLEG): container finished" podID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerID="32032216fcf479f66d03a6c5bab451acbb45b85f044c43abc727b4ff936a4111" exitCode=0 Jun 05 03:21:53.168879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:53.168882 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" event={"ID":"4c8a0eee-4791-4a32-944d-519f9b3e3921","Type":"ContainerDied","Data":"32032216fcf479f66d03a6c5bab451acbb45b85f044c43abc727b4ff936a4111"} Jun 05 03:21:54.298225 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.298202 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:54.338703 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.338678 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qj54\" (UniqueName: \"kubernetes.io/projected/4c8a0eee-4791-4a32-944d-519f9b3e3921-kube-api-access-6qj54\") pod \"4c8a0eee-4791-4a32-944d-519f9b3e3921\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " Jun 05 03:21:54.338796 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.338763 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-bundle\") pod \"4c8a0eee-4791-4a32-944d-519f9b3e3921\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " Jun 05 03:21:54.338796 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.338792 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-util\") pod \"4c8a0eee-4791-4a32-944d-519f9b3e3921\" (UID: \"4c8a0eee-4791-4a32-944d-519f9b3e3921\") " Jun 05 03:21:54.339374 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.339347 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-bundle" (OuterVolumeSpecName: "bundle") pod "4c8a0eee-4791-4a32-944d-519f9b3e3921" (UID: "4c8a0eee-4791-4a32-944d-519f9b3e3921"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:21:54.340700 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.340674 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c8a0eee-4791-4a32-944d-519f9b3e3921-kube-api-access-6qj54" (OuterVolumeSpecName: "kube-api-access-6qj54") pod "4c8a0eee-4791-4a32-944d-519f9b3e3921" (UID: "4c8a0eee-4791-4a32-944d-519f9b3e3921"). InnerVolumeSpecName "kube-api-access-6qj54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:21:54.343620 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.343601 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-util" (OuterVolumeSpecName: "util") pod "4c8a0eee-4791-4a32-944d-519f9b3e3921" (UID: "4c8a0eee-4791-4a32-944d-519f9b3e3921"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:21:54.439399 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.439341 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:54.439399 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.439371 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4c8a0eee-4791-4a32-944d-519f9b3e3921-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:54.439399 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:54.439380 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qj54\" (UniqueName: \"kubernetes.io/projected/4c8a0eee-4791-4a32-944d-519f9b3e3921-kube-api-access-6qj54\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:21:55.177583 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:55.177554 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" Jun 05 03:21:55.177724 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:55.177555 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19drps2f" event={"ID":"4c8a0eee-4791-4a32-944d-519f9b3e3921","Type":"ContainerDied","Data":"a68fbdf66049f5f9d0828e3103ddd7eb333a6dd6b3a12f730f138d412845d849"} Jun 05 03:21:55.177724 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:55.177690 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a68fbdf66049f5f9d0828e3103ddd7eb333a6dd6b3a12f730f138d412845d849" Jun 05 03:21:58.315448 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315418 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn"] Jun 05 03:21:58.315871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315662 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerName="extract" Jun 05 03:21:58.315871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315672 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerName="extract" Jun 05 03:21:58.315871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315686 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerName="util" Jun 05 03:21:58.315871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315691 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerName="util" Jun 05 03:21:58.315871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315697 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerName="pull" Jun 05 03:21:58.315871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315702 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerName="pull" Jun 05 03:21:58.315871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.315752 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c8a0eee-4791-4a32-944d-519f9b3e3921" containerName="extract" Jun 05 03:21:58.362445 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.362416 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn"] Jun 05 03:21:58.362576 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.362500 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.364644 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.364624 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:21:58.364999 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.364975 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 05 03:21:58.365497 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.365480 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2vb7q\"" Jun 05 03:21:58.463816 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.463789 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr442\" (UniqueName: \"kubernetes.io/projected/7bccda6d-558e-42a2-928e-0ff47c0675a5-kube-api-access-qr442\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pvmnn\" (UID: \"7bccda6d-558e-42a2-928e-0ff47c0675a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.463936 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.463839 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bccda6d-558e-42a2-928e-0ff47c0675a5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pvmnn\" (UID: \"7bccda6d-558e-42a2-928e-0ff47c0675a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.564690 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.564665 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bccda6d-558e-42a2-928e-0ff47c0675a5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pvmnn\" (UID: \"7bccda6d-558e-42a2-928e-0ff47c0675a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.564793 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.564712 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr442\" (UniqueName: \"kubernetes.io/projected/7bccda6d-558e-42a2-928e-0ff47c0675a5-kube-api-access-qr442\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pvmnn\" (UID: \"7bccda6d-558e-42a2-928e-0ff47c0675a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.565061 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.565037 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bccda6d-558e-42a2-928e-0ff47c0675a5-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pvmnn\" (UID: \"7bccda6d-558e-42a2-928e-0ff47c0675a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.572656 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.572613 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr442\" (UniqueName: \"kubernetes.io/projected/7bccda6d-558e-42a2-928e-0ff47c0675a5-kube-api-access-qr442\") pod \"cert-manager-operator-controller-manager-57757f7cfc-pvmnn\" (UID: \"7bccda6d-558e-42a2-928e-0ff47c0675a5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.671737 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.671712 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" Jun 05 03:21:58.817397 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:58.817377 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn"] Jun 05 03:21:58.819897 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:21:58.819871 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bccda6d_558e_42a2_928e_0ff47c0675a5.slice/crio-876c2760d0364e41439ae396dae72767551b0c61ec485823deb83e077ae13184 WatchSource:0}: Error finding container 876c2760d0364e41439ae396dae72767551b0c61ec485823deb83e077ae13184: Status 404 returned error can't find the container with id 876c2760d0364e41439ae396dae72767551b0c61ec485823deb83e077ae13184 Jun 05 03:21:59.193312 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:21:59.193241 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" event={"ID":"7bccda6d-558e-42a2-928e-0ff47c0675a5","Type":"ContainerStarted","Data":"876c2760d0364e41439ae396dae72767551b0c61ec485823deb83e077ae13184"} Jun 05 03:22:08.230395 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:08.230358 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" event={"ID":"7bccda6d-558e-42a2-928e-0ff47c0675a5","Type":"ContainerStarted","Data":"c565ccb0b39cd51c161634e47529109746b4ce8d4c7d847b46074915365c7ac6"} Jun 05 03:22:08.248741 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:08.248701 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-pvmnn" podStartSLOduration=1.435819672 podStartE2EDuration="10.248688109s" totalImagesPullingTime="8.812868437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:22:08.247882423 +0000 UTC m=+217.418392524" watchObservedRunningTime="2026-06-05 03:22:08.248688109 +0000 UTC m=+217.419198201" Jun 05 03:22:10.592839 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.592808 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4"] Jun 05 03:22:10.595181 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.595164 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.597252 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.597223 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:22:10.597986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.597967 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:22:10.598079 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.597995 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2k9hz\"" Jun 05 03:22:10.603183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.603166 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4"] Jun 05 03:22:10.653551 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.653529 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.653651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.653564 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfhxm\" (UniqueName: \"kubernetes.io/projected/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-kube-api-access-bfhxm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.653651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.653591 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.754466 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.754442 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.754559 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.754477 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfhxm\" (UniqueName: \"kubernetes.io/projected/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-kube-api-access-bfhxm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.754559 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.754502 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.754797 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.754783 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.754873 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.754853 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.761569 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.761546 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfhxm\" (UniqueName: \"kubernetes.io/projected/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-kube-api-access-bfhxm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:10.905697 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:10.905632 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:11.029210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:11.029181 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4"] Jun 05 03:22:11.031790 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:22:11.031759 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a4bc67b_4439_4921_a9ca_4af2aa970cb8.slice/crio-0b7cccac37fc2169f9775fdb55aa9b8b0c3bce8eba533f07ac186b691b98e0f1 WatchSource:0}: Error finding container 0b7cccac37fc2169f9775fdb55aa9b8b0c3bce8eba533f07ac186b691b98e0f1: Status 404 returned error can't find the container with id 0b7cccac37fc2169f9775fdb55aa9b8b0c3bce8eba533f07ac186b691b98e0f1 Jun 05 03:22:11.244600 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:11.244542 2552 generic.go:356] "Generic (PLEG): container finished" podID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerID="55e4eb667ada275765d914036adda6833d22daefac1ea46252393919f3838e9a" exitCode=0 Jun 05 03:22:11.244600 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:11.244584 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" event={"ID":"2a4bc67b-4439-4921-a9ca-4af2aa970cb8","Type":"ContainerDied","Data":"55e4eb667ada275765d914036adda6833d22daefac1ea46252393919f3838e9a"} Jun 05 03:22:11.244740 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:11.244616 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" event={"ID":"2a4bc67b-4439-4921-a9ca-4af2aa970cb8","Type":"ContainerStarted","Data":"0b7cccac37fc2169f9775fdb55aa9b8b0c3bce8eba533f07ac186b691b98e0f1"} Jun 05 03:22:12.184954 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.184909 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs"] Jun 05 03:22:12.186888 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.186873 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:12.189001 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.188967 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qll6j\"" Jun 05 03:22:12.189101 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.189024 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 05 03:22:12.189634 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.189619 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 05 03:22:12.196245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.196227 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs"] Jun 05 03:22:12.266155 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.266126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b6b9a-365c-4818-90d3-4f376f8c2368-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fm5gs\" (UID: \"f96b6b9a-365c-4818-90d3-4f376f8c2368\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:12.266291 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.266164 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn899\" (UniqueName: \"kubernetes.io/projected/f96b6b9a-365c-4818-90d3-4f376f8c2368-kube-api-access-tn899\") pod \"cert-manager-cainjector-5d99449ffd-fm5gs\" (UID: \"f96b6b9a-365c-4818-90d3-4f376f8c2368\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:12.367106 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.367071 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b6b9a-365c-4818-90d3-4f376f8c2368-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fm5gs\" (UID: \"f96b6b9a-365c-4818-90d3-4f376f8c2368\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:12.367257 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.367193 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn899\" (UniqueName: \"kubernetes.io/projected/f96b6b9a-365c-4818-90d3-4f376f8c2368-kube-api-access-tn899\") pod \"cert-manager-cainjector-5d99449ffd-fm5gs\" (UID: \"f96b6b9a-365c-4818-90d3-4f376f8c2368\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:12.374939 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.374915 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn899\" (UniqueName: \"kubernetes.io/projected/f96b6b9a-365c-4818-90d3-4f376f8c2368-kube-api-access-tn899\") pod \"cert-manager-cainjector-5d99449ffd-fm5gs\" (UID: \"f96b6b9a-365c-4818-90d3-4f376f8c2368\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:12.375427 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.375399 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f96b6b9a-365c-4818-90d3-4f376f8c2368-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-fm5gs\" (UID: \"f96b6b9a-365c-4818-90d3-4f376f8c2368\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:12.505433 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:12.505366 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" Jun 05 03:22:13.230721 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:13.226154 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs"] Jun 05 03:22:13.254897 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:13.254868 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" event={"ID":"2a4bc67b-4439-4921-a9ca-4af2aa970cb8","Type":"ContainerStarted","Data":"407e9f716c52738845f9ce32d6e045a779d1a76b494dcbf365cbe7f67dbb2483"} Jun 05 03:22:13.256077 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:13.256050 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" event={"ID":"f96b6b9a-365c-4818-90d3-4f376f8c2368","Type":"ContainerStarted","Data":"97947ae04271c27ddfa563995d4b18ea6dcd035c765fc9858fd9e001bc85b19b"} Jun 05 03:22:14.261747 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:14.261711 2552 generic.go:356] "Generic (PLEG): container finished" podID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerID="407e9f716c52738845f9ce32d6e045a779d1a76b494dcbf365cbe7f67dbb2483" exitCode=0 Jun 05 03:22:14.262099 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:14.261796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" event={"ID":"2a4bc67b-4439-4921-a9ca-4af2aa970cb8","Type":"ContainerDied","Data":"407e9f716c52738845f9ce32d6e045a779d1a76b494dcbf365cbe7f67dbb2483"} Jun 05 03:22:15.268845 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:15.268805 2552 generic.go:356] "Generic (PLEG): container finished" podID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerID="3e576ee02626541b20b10eaedbacadb15fc7fca8f069c52591a53b445a123e06" exitCode=0 Jun 05 03:22:15.269264 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:15.268894 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" event={"ID":"2a4bc67b-4439-4921-a9ca-4af2aa970cb8","Type":"ContainerDied","Data":"3e576ee02626541b20b10eaedbacadb15fc7fca8f069c52591a53b445a123e06"} Jun 05 03:22:16.398944 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.398919 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:16.503125 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.503055 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-bundle\") pod \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " Jun 05 03:22:16.503251 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.503172 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-util\") pod \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " Jun 05 03:22:16.503251 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.503203 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfhxm\" (UniqueName: \"kubernetes.io/projected/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-kube-api-access-bfhxm\") pod \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\" (UID: \"2a4bc67b-4439-4921-a9ca-4af2aa970cb8\") " Jun 05 03:22:16.503523 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.503500 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-bundle" (OuterVolumeSpecName: "bundle") pod "2a4bc67b-4439-4921-a9ca-4af2aa970cb8" (UID: "2a4bc67b-4439-4921-a9ca-4af2aa970cb8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:22:16.505199 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.505177 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-kube-api-access-bfhxm" (OuterVolumeSpecName: "kube-api-access-bfhxm") pod "2a4bc67b-4439-4921-a9ca-4af2aa970cb8" (UID: "2a4bc67b-4439-4921-a9ca-4af2aa970cb8"). InnerVolumeSpecName "kube-api-access-bfhxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:22:16.507677 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.507637 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-util" (OuterVolumeSpecName: "util") pod "2a4bc67b-4439-4921-a9ca-4af2aa970cb8" (UID: "2a4bc67b-4439-4921-a9ca-4af2aa970cb8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:22:16.589650 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.589622 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5"] Jun 05 03:22:16.589925 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.589907 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerName="pull" Jun 05 03:22:16.589925 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.589923 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerName="pull" Jun 05 03:22:16.590101 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.589944 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerName="util" Jun 05 03:22:16.590101 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.589952 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerName="util" Jun 05 03:22:16.590101 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.589979 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerName="extract" Jun 05 03:22:16.590101 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.589987 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerName="extract" Jun 05 03:22:16.590101 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.590056 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a4bc67b-4439-4921-a9ca-4af2aa970cb8" containerName="extract" Jun 05 03:22:16.594348 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.594309 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:16.596171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.596153 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jg8fs\"" Jun 05 03:22:16.599926 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.599897 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5"] Jun 05 03:22:16.603617 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.603595 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:22:16.603711 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.603620 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfhxm\" (UniqueName: \"kubernetes.io/projected/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-kube-api-access-bfhxm\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:22:16.603711 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.603635 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2a4bc67b-4439-4921-a9ca-4af2aa970cb8-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:22:16.704863 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.704828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5225c70-d63a-4102-a9f4-2f95a9a60421-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5qzd5\" (UID: \"d5225c70-d63a-4102-a9f4-2f95a9a60421\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:16.705012 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.704868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhv2x\" (UniqueName: \"kubernetes.io/projected/d5225c70-d63a-4102-a9f4-2f95a9a60421-kube-api-access-jhv2x\") pod \"cert-manager-webhook-7dc76cbb94-5qzd5\" (UID: \"d5225c70-d63a-4102-a9f4-2f95a9a60421\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:16.805759 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.805728 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5225c70-d63a-4102-a9f4-2f95a9a60421-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5qzd5\" (UID: \"d5225c70-d63a-4102-a9f4-2f95a9a60421\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:16.805922 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.805778 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhv2x\" (UniqueName: \"kubernetes.io/projected/d5225c70-d63a-4102-a9f4-2f95a9a60421-kube-api-access-jhv2x\") pod \"cert-manager-webhook-7dc76cbb94-5qzd5\" (UID: \"d5225c70-d63a-4102-a9f4-2f95a9a60421\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:16.814571 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.814546 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5225c70-d63a-4102-a9f4-2f95a9a60421-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-5qzd5\" (UID: \"d5225c70-d63a-4102-a9f4-2f95a9a60421\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:16.814678 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.814660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhv2x\" (UniqueName: \"kubernetes.io/projected/d5225c70-d63a-4102-a9f4-2f95a9a60421-kube-api-access-jhv2x\") pod \"cert-manager-webhook-7dc76cbb94-5qzd5\" (UID: \"d5225c70-d63a-4102-a9f4-2f95a9a60421\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:16.903746 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:16.903719 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:17.025825 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.025802 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5"] Jun 05 03:22:17.028150 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:22:17.028125 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5225c70_d63a_4102_a9f4_2f95a9a60421.slice/crio-98a450cc3ecb0e679e7dfbc4f42c4673124c8d8fdbe6645111947dca5daab67f WatchSource:0}: Error finding container 98a450cc3ecb0e679e7dfbc4f42c4673124c8d8fdbe6645111947dca5daab67f: Status 404 returned error can't find the container with id 98a450cc3ecb0e679e7dfbc4f42c4673124c8d8fdbe6645111947dca5daab67f Jun 05 03:22:17.284016 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.283984 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" event={"ID":"2a4bc67b-4439-4921-a9ca-4af2aa970cb8","Type":"ContainerDied","Data":"0b7cccac37fc2169f9775fdb55aa9b8b0c3bce8eba533f07ac186b691b98e0f1"} Jun 05 03:22:17.284177 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.284057 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b7cccac37fc2169f9775fdb55aa9b8b0c3bce8eba533f07ac186b691b98e0f1" Jun 05 03:22:17.284177 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.283997 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqv2m4" Jun 05 03:22:17.290832 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.290808 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" event={"ID":"f96b6b9a-365c-4818-90d3-4f376f8c2368","Type":"ContainerStarted","Data":"f986a7fee5c92a8663c6ca27a0d2d59e00e0a38d06988015d8c5a705ae2fe735"} Jun 05 03:22:17.290832 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.290834 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" event={"ID":"d5225c70-d63a-4102-a9f4-2f95a9a60421","Type":"ContainerStarted","Data":"347ce6ef584491ee0abb437baae1f55ab1a910ab63ea681eb225c1a058f7e3b7"} Jun 05 03:22:17.291018 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.290848 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" event={"ID":"d5225c70-d63a-4102-a9f4-2f95a9a60421","Type":"ContainerStarted","Data":"98a450cc3ecb0e679e7dfbc4f42c4673124c8d8fdbe6645111947dca5daab67f"} Jun 05 03:22:17.291018 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.290862 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:17.322677 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.322607 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-fm5gs" podStartSLOduration=2.322856523 podStartE2EDuration="5.322596002s" totalImagesPullingTime="2.999739479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:22:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:22:17.322062755 +0000 UTC m=+226.492572858" watchObservedRunningTime="2026-06-05 03:22:17.322596002 +0000 UTC m=+226.493106103" Jun 05 03:22:17.343495 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:17.343453 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" podStartSLOduration=1.343441382 podStartE2EDuration="1.343441382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:22:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:22:17.341862138 +0000 UTC m=+226.512372240" watchObservedRunningTime="2026-06-05 03:22:17.343441382 +0000 UTC m=+226.513951482" Jun 05 03:22:23.293600 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:23.293571 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-5qzd5" Jun 05 03:22:23.895950 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:23.895917 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6"] Jun 05 03:22:23.940195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:23.940162 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6"] Jun 05 03:22:23.940365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:23.940212 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:23.943002 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:23.942980 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 03:22:23.943113 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:23.943024 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-89zj2\"" Jun 05 03:22:23.943699 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:23.943682 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 03:22:24.056820 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.056800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7463ed7c-401a-4573-abb7-2ddb5dbd284f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hrsn6\" (UID: \"7463ed7c-401a-4573-abb7-2ddb5dbd284f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:24.056921 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.056829 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmtbt\" (UniqueName: \"kubernetes.io/projected/7463ed7c-401a-4573-abb7-2ddb5dbd284f-kube-api-access-hmtbt\") pod \"openshift-lws-operator-fd8ccff4c-hrsn6\" (UID: \"7463ed7c-401a-4573-abb7-2ddb5dbd284f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:24.157675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.157624 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7463ed7c-401a-4573-abb7-2ddb5dbd284f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hrsn6\" (UID: \"7463ed7c-401a-4573-abb7-2ddb5dbd284f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:24.157675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.157652 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmtbt\" (UniqueName: \"kubernetes.io/projected/7463ed7c-401a-4573-abb7-2ddb5dbd284f-kube-api-access-hmtbt\") pod \"openshift-lws-operator-fd8ccff4c-hrsn6\" (UID: \"7463ed7c-401a-4573-abb7-2ddb5dbd284f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:24.157952 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.157936 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7463ed7c-401a-4573-abb7-2ddb5dbd284f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hrsn6\" (UID: \"7463ed7c-401a-4573-abb7-2ddb5dbd284f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:24.165520 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.165503 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmtbt\" (UniqueName: \"kubernetes.io/projected/7463ed7c-401a-4573-abb7-2ddb5dbd284f-kube-api-access-hmtbt\") pod \"openshift-lws-operator-fd8ccff4c-hrsn6\" (UID: \"7463ed7c-401a-4573-abb7-2ddb5dbd284f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:24.249115 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.249099 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" Jun 05 03:22:24.384425 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:24.384400 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6"] Jun 05 03:22:24.386800 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:22:24.386771 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7463ed7c_401a_4573_abb7_2ddb5dbd284f.slice/crio-26cdcaf093f7acc3cd86edb82cf2343cf561eee378676d0bfd00277b669c6f5c WatchSource:0}: Error finding container 26cdcaf093f7acc3cd86edb82cf2343cf561eee378676d0bfd00277b669c6f5c: Status 404 returned error can't find the container with id 26cdcaf093f7acc3cd86edb82cf2343cf561eee378676d0bfd00277b669c6f5c Jun 05 03:22:25.325934 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:25.325902 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" event={"ID":"7463ed7c-401a-4573-abb7-2ddb5dbd284f","Type":"ContainerStarted","Data":"26cdcaf093f7acc3cd86edb82cf2343cf561eee378676d0bfd00277b669c6f5c"} Jun 05 03:22:27.334422 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:27.334391 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" event={"ID":"7463ed7c-401a-4573-abb7-2ddb5dbd284f","Type":"ContainerStarted","Data":"eb206d19f572452043b6ae858b2322b3907d8f84f0e50733fade4ec1419ef79d"} Jun 05 03:22:27.348848 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:27.348798 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hrsn6" podStartSLOduration=1.779762005 podStartE2EDuration="4.348782928s" totalImagesPullingTime="2.569020923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:22:27.348058676 +0000 UTC m=+236.518568790" watchObservedRunningTime="2026-06-05 03:22:27.348782928 +0000 UTC m=+236.519293031" Jun 05 03:22:29.868330 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.868282 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln"] Jun 05 03:22:29.870962 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.870946 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:29.873221 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.873194 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:22:29.873221 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.873205 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:22:29.873221 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.873222 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2k9hz\"" Jun 05 03:22:29.879005 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.878983 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln"] Jun 05 03:22:29.997253 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.997220 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2hld\" (UniqueName: \"kubernetes.io/projected/14312e7b-54d0-4d97-aa04-81fc602d4255-kube-api-access-w2hld\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:29.997397 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.997263 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:29.997397 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:29.997385 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.098603 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.098578 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.098737 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.098622 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2hld\" (UniqueName: \"kubernetes.io/projected/14312e7b-54d0-4d97-aa04-81fc602d4255-kube-api-access-w2hld\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.098737 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.098642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.098954 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.098934 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.098954 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.098949 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.106810 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.106791 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2hld\" (UniqueName: \"kubernetes.io/projected/14312e7b-54d0-4d97-aa04-81fc602d4255-kube-api-access-w2hld\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.179871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.179825 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:30.305846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.305821 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln"] Jun 05 03:22:30.307254 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:22:30.307228 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14312e7b_54d0_4d97_aa04_81fc602d4255.slice/crio-bc656d5457b6cdb90fc25dbe62e01c80c2f3c03b124c4248ae67c4a8e71ee61e WatchSource:0}: Error finding container bc656d5457b6cdb90fc25dbe62e01c80c2f3c03b124c4248ae67c4a8e71ee61e: Status 404 returned error can't find the container with id bc656d5457b6cdb90fc25dbe62e01c80c2f3c03b124c4248ae67c4a8e71ee61e Jun 05 03:22:30.348170 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:30.348147 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" event={"ID":"14312e7b-54d0-4d97-aa04-81fc602d4255","Type":"ContainerStarted","Data":"bc656d5457b6cdb90fc25dbe62e01c80c2f3c03b124c4248ae67c4a8e71ee61e"} Jun 05 03:22:31.353283 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:31.353250 2552 generic.go:356] "Generic (PLEG): container finished" podID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerID="98b15c369f587ba40602729408d4f53370d75d356e3933e22498c29f10f9f51d" exitCode=0 Jun 05 03:22:31.353674 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:31.353350 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" event={"ID":"14312e7b-54d0-4d97-aa04-81fc602d4255","Type":"ContainerDied","Data":"98b15c369f587ba40602729408d4f53370d75d356e3933e22498c29f10f9f51d"} Jun 05 03:22:32.359645 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:32.359614 2552 generic.go:356] "Generic (PLEG): container finished" podID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerID="5c6a030bf14e76dde5b8b77689d44c4821faad1a45edc676e2c985989e8e244d" exitCode=0 Jun 05 03:22:32.359956 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:32.359700 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" event={"ID":"14312e7b-54d0-4d97-aa04-81fc602d4255","Type":"ContainerDied","Data":"5c6a030bf14e76dde5b8b77689d44c4821faad1a45edc676e2c985989e8e244d"} Jun 05 03:22:33.365169 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:33.365133 2552 generic.go:356] "Generic (PLEG): container finished" podID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerID="91bdce8763f0098f509293badaddb63831d49d3d10f3c62a5b696ffb781b36b6" exitCode=0 Jun 05 03:22:33.365576 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:33.365208 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" event={"ID":"14312e7b-54d0-4d97-aa04-81fc602d4255","Type":"ContainerDied","Data":"91bdce8763f0098f509293badaddb63831d49d3d10f3c62a5b696ffb781b36b6"} Jun 05 03:22:34.489902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.489881 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:34.635155 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.635093 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2hld\" (UniqueName: \"kubernetes.io/projected/14312e7b-54d0-4d97-aa04-81fc602d4255-kube-api-access-w2hld\") pod \"14312e7b-54d0-4d97-aa04-81fc602d4255\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " Jun 05 03:22:34.635155 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.635128 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-bundle\") pod \"14312e7b-54d0-4d97-aa04-81fc602d4255\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " Jun 05 03:22:34.635155 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.635152 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-util\") pod \"14312e7b-54d0-4d97-aa04-81fc602d4255\" (UID: \"14312e7b-54d0-4d97-aa04-81fc602d4255\") " Jun 05 03:22:34.635947 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.635921 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-bundle" (OuterVolumeSpecName: "bundle") pod "14312e7b-54d0-4d97-aa04-81fc602d4255" (UID: "14312e7b-54d0-4d97-aa04-81fc602d4255"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:22:34.637136 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.637113 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14312e7b-54d0-4d97-aa04-81fc602d4255-kube-api-access-w2hld" (OuterVolumeSpecName: "kube-api-access-w2hld") pod "14312e7b-54d0-4d97-aa04-81fc602d4255" (UID: "14312e7b-54d0-4d97-aa04-81fc602d4255"). InnerVolumeSpecName "kube-api-access-w2hld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:22:34.640989 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.640971 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-util" (OuterVolumeSpecName: "util") pod "14312e7b-54d0-4d97-aa04-81fc602d4255" (UID: "14312e7b-54d0-4d97-aa04-81fc602d4255"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:22:34.736133 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.736111 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2hld\" (UniqueName: \"kubernetes.io/projected/14312e7b-54d0-4d97-aa04-81fc602d4255-kube-api-access-w2hld\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:22:34.736230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.736136 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:22:34.736230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:34.736149 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14312e7b-54d0-4d97-aa04-81fc602d4255-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:22:35.375989 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:35.375964 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" Jun 05 03:22:35.375989 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:35.375982 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdk29ln" event={"ID":"14312e7b-54d0-4d97-aa04-81fc602d4255","Type":"ContainerDied","Data":"bc656d5457b6cdb90fc25dbe62e01c80c2f3c03b124c4248ae67c4a8e71ee61e"} Jun 05 03:22:35.376242 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:35.376030 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc656d5457b6cdb90fc25dbe62e01c80c2f3c03b124c4248ae67c4a8e71ee61e" Jun 05 03:22:36.246183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246148 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws"] Jun 05 03:22:36.246643 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246577 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerName="extract" Jun 05 03:22:36.246643 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246595 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerName="extract" Jun 05 03:22:36.246643 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246619 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerName="util" Jun 05 03:22:36.246643 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246627 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerName="util" Jun 05 03:22:36.246854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246652 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerName="pull" Jun 05 03:22:36.246854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246662 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerName="pull" Jun 05 03:22:36.246854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.246731 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="14312e7b-54d0-4d97-aa04-81fc602d4255" containerName="extract" Jun 05 03:22:36.248739 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.248719 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.250960 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.250942 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7xw54\"" Jun 05 03:22:36.251071 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.250945 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 03:22:36.251071 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.250946 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 03:22:36.251071 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.250985 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 03:22:36.259832 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.259812 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws"] Jun 05 03:22:36.345726 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.345697 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83fca9d2-cf9b-400a-b8a6-434831c6027c-manager-config\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.345828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.345735 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83fca9d2-cf9b-400a-b8a6-434831c6027c-metrics-cert\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.345828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.345756 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrjjr\" (UniqueName: \"kubernetes.io/projected/83fca9d2-cf9b-400a-b8a6-434831c6027c-kube-api-access-rrjjr\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.345897 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.345833 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83fca9d2-cf9b-400a-b8a6-434831c6027c-cert\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.446197 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.446170 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83fca9d2-cf9b-400a-b8a6-434831c6027c-manager-config\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.446351 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.446205 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83fca9d2-cf9b-400a-b8a6-434831c6027c-metrics-cert\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.446351 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.446239 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrjjr\" (UniqueName: \"kubernetes.io/projected/83fca9d2-cf9b-400a-b8a6-434831c6027c-kube-api-access-rrjjr\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.446351 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.446278 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83fca9d2-cf9b-400a-b8a6-434831c6027c-cert\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.446893 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.446875 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83fca9d2-cf9b-400a-b8a6-434831c6027c-manager-config\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.448622 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.448601 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83fca9d2-cf9b-400a-b8a6-434831c6027c-metrics-cert\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.448708 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.448693 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83fca9d2-cf9b-400a-b8a6-434831c6027c-cert\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.454190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.454169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrjjr\" (UniqueName: \"kubernetes.io/projected/83fca9d2-cf9b-400a-b8a6-434831c6027c-kube-api-access-rrjjr\") pod \"lws-controller-manager-67bbfff89b-r5rws\" (UID: \"83fca9d2-cf9b-400a-b8a6-434831c6027c\") " pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.557133 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.557104 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:36.685115 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:36.685088 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws"] Jun 05 03:22:36.686837 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:22:36.686809 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fca9d2_cf9b_400a_b8a6_434831c6027c.slice/crio-8d192cdb52fb44ebb1730af812ecff56de1201ff36cbaaa67509d248e215757c WatchSource:0}: Error finding container 8d192cdb52fb44ebb1730af812ecff56de1201ff36cbaaa67509d248e215757c: Status 404 returned error can't find the container with id 8d192cdb52fb44ebb1730af812ecff56de1201ff36cbaaa67509d248e215757c Jun 05 03:22:37.384839 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:37.384805 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" event={"ID":"83fca9d2-cf9b-400a-b8a6-434831c6027c","Type":"ContainerStarted","Data":"8d192cdb52fb44ebb1730af812ecff56de1201ff36cbaaa67509d248e215757c"} Jun 05 03:22:39.395130 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:39.395100 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" event={"ID":"83fca9d2-cf9b-400a-b8a6-434831c6027c","Type":"ContainerStarted","Data":"bc6f73d346e6fc749190d8f0fe577b491ac683433db9ae825e679de54fd31c0f"} Jun 05 03:22:39.395516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:39.395147 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:39.411894 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:39.411848 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" podStartSLOduration=1.203456082 podStartE2EDuration="3.411836057s" totalImagesPullingTime="2.208379975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:22:39.411213074 +0000 UTC m=+248.581723175" watchObservedRunningTime="2026-06-05 03:22:39.411836057 +0000 UTC m=+248.582346157" Jun 05 03:22:46.627583 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.627554 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc"] Jun 05 03:22:46.629859 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.629843 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.633002 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.632983 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 03:22:46.633232 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.633197 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 03:22:46.633346 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.633202 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 03:22:46.633346 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.633209 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lvtkg\"" Jun 05 03:22:46.633468 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.633368 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 03:22:46.653199 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.653180 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc"] Jun 05 03:22:46.719748 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.719724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g7hw\" (UniqueName: \"kubernetes.io/projected/868f2bcb-d394-42fd-af82-280991960096-kube-api-access-4g7hw\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.719876 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.719774 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/868f2bcb-d394-42fd-af82-280991960096-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.719876 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.719803 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/868f2bcb-d394-42fd-af82-280991960096-manifests\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.719876 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.719850 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/868f2bcb-d394-42fd-af82-280991960096-webhook-cert\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.720023 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.719889 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/868f2bcb-d394-42fd-af82-280991960096-tmp\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.820543 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.820509 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/868f2bcb-d394-42fd-af82-280991960096-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.820666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.820548 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/868f2bcb-d394-42fd-af82-280991960096-manifests\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.820666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.820565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/868f2bcb-d394-42fd-af82-280991960096-webhook-cert\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.820666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.820585 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/868f2bcb-d394-42fd-af82-280991960096-tmp\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.820666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.820642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g7hw\" (UniqueName: \"kubernetes.io/projected/868f2bcb-d394-42fd-af82-280991960096-kube-api-access-4g7hw\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.820918 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.820900 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/868f2bcb-d394-42fd-af82-280991960096-manifests\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.822891 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.822868 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/868f2bcb-d394-42fd-af82-280991960096-tmp\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.822999 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.822988 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/868f2bcb-d394-42fd-af82-280991960096-webhook-cert\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.823180 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.823160 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/868f2bcb-d394-42fd-af82-280991960096-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.828607 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.828586 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g7hw\" (UniqueName: \"kubernetes.io/projected/868f2bcb-d394-42fd-af82-280991960096-kube-api-access-4g7hw\") pod \"opendatahub-operator-controller-manager-bdb887f5b-7m6zc\" (UID: \"868f2bcb-d394-42fd-af82-280991960096\") " pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:46.939576 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:46.939521 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:47.071368 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:47.071342 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc"] Jun 05 03:22:47.075264 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:22:47.075241 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868f2bcb_d394_42fd_af82_280991960096.slice/crio-e4a6e988e6491ef01d314127cbeea271ccf24be946619c244c2cb0d4cb77eccb WatchSource:0}: Error finding container e4a6e988e6491ef01d314127cbeea271ccf24be946619c244c2cb0d4cb77eccb: Status 404 returned error can't find the container with id e4a6e988e6491ef01d314127cbeea271ccf24be946619c244c2cb0d4cb77eccb Jun 05 03:22:47.431062 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:47.431030 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" event={"ID":"868f2bcb-d394-42fd-af82-280991960096","Type":"ContainerStarted","Data":"e4a6e988e6491ef01d314127cbeea271ccf24be946619c244c2cb0d4cb77eccb"} Jun 05 03:22:50.400898 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:50.400872 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67bbfff89b-r5rws" Jun 05 03:22:50.447968 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:50.447929 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" event={"ID":"868f2bcb-d394-42fd-af82-280991960096","Type":"ContainerStarted","Data":"0e9847261cd5148526dddf9ebcc173e36f8ed34282e5c6da26c079567bb0553a"} Jun 05 03:22:51.453667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:51.453637 2552 generic.go:356] "Generic (PLEG): container finished" podID="868f2bcb-d394-42fd-af82-280991960096" containerID="0e9847261cd5148526dddf9ebcc173e36f8ed34282e5c6da26c079567bb0553a" exitCode=0 Jun 05 03:22:51.454048 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:51.453708 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" event={"ID":"868f2bcb-d394-42fd-af82-280991960096","Type":"ContainerDied","Data":"0e9847261cd5148526dddf9ebcc173e36f8ed34282e5c6da26c079567bb0553a"} Jun 05 03:22:52.461184 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:52.461151 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" event={"ID":"868f2bcb-d394-42fd-af82-280991960096","Type":"ContainerStarted","Data":"9b3a37bf67e61e47b3f5be2b9d9a7ecd834f0e64ecba5025468a8a5fcc14955d"} Jun 05 03:22:52.461613 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:52.461278 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:22:52.482094 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:22:52.482034 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" podStartSLOduration=2.331808074 podStartE2EDuration="6.482014286s" totalImagesPullingTime="3.215735259s" totalInitContainerRuntime="934.470953ms" isStatefulPod=false podCreationTimestamp="2026-06-05 03:22:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:22:52.479910599 +0000 UTC m=+261.650420702" watchObservedRunningTime="2026-06-05 03:22:52.482014286 +0000 UTC m=+261.652524390" Jun 05 03:23:03.467085 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:03.467050 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bdb887f5b-7m6zc" Jun 05 03:23:09.220816 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.220786 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp"] Jun 05 03:23:09.227388 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.227359 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.229515 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.229494 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:23:09.229667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.229642 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2k9hz\"" Jun 05 03:23:09.229730 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.229697 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:23:09.232507 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.232485 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp"] Jun 05 03:23:09.392585 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.392547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.392786 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.392613 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.392786 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.392646 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxbt\" (UniqueName: \"kubernetes.io/projected/84af414f-73db-4f01-8950-2038eb98a570-kube-api-access-vjxbt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.493778 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.493701 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.493778 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.493745 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.493963 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.493778 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxbt\" (UniqueName: \"kubernetes.io/projected/84af414f-73db-4f01-8950-2038eb98a570-kube-api-access-vjxbt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.494079 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.494061 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.494172 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.494150 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.503349 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.503304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxbt\" (UniqueName: \"kubernetes.io/projected/84af414f-73db-4f01-8950-2038eb98a570-kube-api-access-vjxbt\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.537910 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.537886 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:09.669148 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:09.669115 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp"] Jun 05 03:23:09.673770 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:23:09.673741 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84af414f_73db_4f01_8950_2038eb98a570.slice/crio-a18e43030c01858dde4d0517f710cb258b4e12232ebd91963fb61d9a147e2cb0 WatchSource:0}: Error finding container a18e43030c01858dde4d0517f710cb258b4e12232ebd91963fb61d9a147e2cb0: Status 404 returned error can't find the container with id a18e43030c01858dde4d0517f710cb258b4e12232ebd91963fb61d9a147e2cb0 Jun 05 03:23:10.540822 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:10.540789 2552 generic.go:356] "Generic (PLEG): container finished" podID="84af414f-73db-4f01-8950-2038eb98a570" containerID="7ae1ba9b68e641f879e3eeab04732acf709cd2641966fa20e7ef3c3051d856c1" exitCode=0 Jun 05 03:23:10.541191 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:10.540872 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" event={"ID":"84af414f-73db-4f01-8950-2038eb98a570","Type":"ContainerDied","Data":"7ae1ba9b68e641f879e3eeab04732acf709cd2641966fa20e7ef3c3051d856c1"} Jun 05 03:23:10.541191 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:10.540925 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" event={"ID":"84af414f-73db-4f01-8950-2038eb98a570","Type":"ContainerStarted","Data":"a18e43030c01858dde4d0517f710cb258b4e12232ebd91963fb61d9a147e2cb0"} Jun 05 03:23:12.550178 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:12.550138 2552 generic.go:356] "Generic (PLEG): container finished" podID="84af414f-73db-4f01-8950-2038eb98a570" containerID="012f6fa95d512ee8057881976e6075076117074bc00454f65623873e70b209f7" exitCode=0 Jun 05 03:23:12.550582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:12.550229 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" event={"ID":"84af414f-73db-4f01-8950-2038eb98a570","Type":"ContainerDied","Data":"012f6fa95d512ee8057881976e6075076117074bc00454f65623873e70b209f7"} Jun 05 03:23:13.556499 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:13.556465 2552 generic.go:356] "Generic (PLEG): container finished" podID="84af414f-73db-4f01-8950-2038eb98a570" containerID="8f0e5a00d9b29a3a54e1d5423e35bdd20ed23f21d4716bf59900814fa449cb1f" exitCode=0 Jun 05 03:23:13.556863 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:13.556553 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" event={"ID":"84af414f-73db-4f01-8950-2038eb98a570","Type":"ContainerDied","Data":"8f0e5a00d9b29a3a54e1d5423e35bdd20ed23f21d4716bf59900814fa449cb1f"} Jun 05 03:23:14.684997 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.684975 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:14.733435 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.733409 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjxbt\" (UniqueName: \"kubernetes.io/projected/84af414f-73db-4f01-8950-2038eb98a570-kube-api-access-vjxbt\") pod \"84af414f-73db-4f01-8950-2038eb98a570\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " Jun 05 03:23:14.733573 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.733467 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-bundle\") pod \"84af414f-73db-4f01-8950-2038eb98a570\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " Jun 05 03:23:14.733573 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.733491 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-util\") pod \"84af414f-73db-4f01-8950-2038eb98a570\" (UID: \"84af414f-73db-4f01-8950-2038eb98a570\") " Jun 05 03:23:14.734707 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.734674 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-bundle" (OuterVolumeSpecName: "bundle") pod "84af414f-73db-4f01-8950-2038eb98a570" (UID: "84af414f-73db-4f01-8950-2038eb98a570"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:23:14.736056 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.736024 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84af414f-73db-4f01-8950-2038eb98a570-kube-api-access-vjxbt" (OuterVolumeSpecName: "kube-api-access-vjxbt") pod "84af414f-73db-4f01-8950-2038eb98a570" (UID: "84af414f-73db-4f01-8950-2038eb98a570"). InnerVolumeSpecName "kube-api-access-vjxbt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:23:14.739453 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.739424 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-util" (OuterVolumeSpecName: "util") pod "84af414f-73db-4f01-8950-2038eb98a570" (UID: "84af414f-73db-4f01-8950-2038eb98a570"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:23:14.834292 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.834223 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjxbt\" (UniqueName: \"kubernetes.io/projected/84af414f-73db-4f01-8950-2038eb98a570-kube-api-access-vjxbt\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:23:14.834292 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.834248 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:23:14.834292 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:14.834257 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/84af414f-73db-4f01-8950-2038eb98a570-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:23:15.518636 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.518601 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f"] Jun 05 03:23:15.518955 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.518942 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84af414f-73db-4f01-8950-2038eb98a570" containerName="extract" Jun 05 03:23:15.519040 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.518956 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="84af414f-73db-4f01-8950-2038eb98a570" containerName="extract" Jun 05 03:23:15.519040 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.518969 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84af414f-73db-4f01-8950-2038eb98a570" containerName="util" Jun 05 03:23:15.519040 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.518975 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="84af414f-73db-4f01-8950-2038eb98a570" containerName="util" Jun 05 03:23:15.519040 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.518985 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84af414f-73db-4f01-8950-2038eb98a570" containerName="pull" Jun 05 03:23:15.519040 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.518990 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="84af414f-73db-4f01-8950-2038eb98a570" containerName="pull" Jun 05 03:23:15.519184 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.519050 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="84af414f-73db-4f01-8950-2038eb98a570" containerName="extract" Jun 05 03:23:15.527842 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.527821 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:15.530868 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.530846 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 05 03:23:15.531605 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.531585 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qjhm5\"" Jun 05 03:23:15.533663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.533622 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f"] Jun 05 03:23:15.540384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.540355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcl8g\" (UniqueName: \"kubernetes.io/projected/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-kube-api-access-dcl8g\") pod \"llmisvc-controller-manager-864bfd7bc9-p5x2f\" (UID: \"4f9c839b-8ff7-4ee0-ae36-54602d7865c7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:15.540516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.540410 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p5x2f\" (UID: \"4f9c839b-8ff7-4ee0-ae36-54602d7865c7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:15.566781 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.566714 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" Jun 05 03:23:15.566781 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.566716 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066c2dp" event={"ID":"84af414f-73db-4f01-8950-2038eb98a570","Type":"ContainerDied","Data":"a18e43030c01858dde4d0517f710cb258b4e12232ebd91963fb61d9a147e2cb0"} Jun 05 03:23:15.566781 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.566758 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a18e43030c01858dde4d0517f710cb258b4e12232ebd91963fb61d9a147e2cb0" Jun 05 03:23:15.641141 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.641116 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcl8g\" (UniqueName: \"kubernetes.io/projected/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-kube-api-access-dcl8g\") pod \"llmisvc-controller-manager-864bfd7bc9-p5x2f\" (UID: \"4f9c839b-8ff7-4ee0-ae36-54602d7865c7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:15.641293 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.641159 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p5x2f\" (UID: \"4f9c839b-8ff7-4ee0-ae36-54602d7865c7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:15.641293 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:23:15.641281 2552 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 05 03:23:15.641446 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:23:15.641370 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-cert podName:4f9c839b-8ff7-4ee0-ae36-54602d7865c7 nodeName:}" failed. No retries permitted until 2026-06-05 03:23:16.141347563 +0000 UTC m=+285.311857642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-cert") pod "llmisvc-controller-manager-864bfd7bc9-p5x2f" (UID: "4f9c839b-8ff7-4ee0-ae36-54602d7865c7") : secret "llmisvc-webhook-server-cert" not found Jun 05 03:23:15.651437 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:15.651415 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcl8g\" (UniqueName: \"kubernetes.io/projected/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-kube-api-access-dcl8g\") pod \"llmisvc-controller-manager-864bfd7bc9-p5x2f\" (UID: \"4f9c839b-8ff7-4ee0-ae36-54602d7865c7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:16.145131 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:16.145095 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p5x2f\" (UID: \"4f9c839b-8ff7-4ee0-ae36-54602d7865c7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:16.147207 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:16.147186 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f9c839b-8ff7-4ee0-ae36-54602d7865c7-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-p5x2f\" (UID: \"4f9c839b-8ff7-4ee0-ae36-54602d7865c7\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:16.442658 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:16.442590 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:16.571265 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:16.571171 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f"] Jun 05 03:23:16.573880 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:23:16.573850 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f9c839b_8ff7_4ee0_ae36_54602d7865c7.slice/crio-ae594f63e52fd9cace34576c2c4d826e6152110a22c333faf1271fd2d60c572d WatchSource:0}: Error finding container ae594f63e52fd9cace34576c2c4d826e6152110a22c333faf1271fd2d60c572d: Status 404 returned error can't find the container with id ae594f63e52fd9cace34576c2c4d826e6152110a22c333faf1271fd2d60c572d Jun 05 03:23:17.578880 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:17.578840 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" event={"ID":"4f9c839b-8ff7-4ee0-ae36-54602d7865c7","Type":"ContainerStarted","Data":"ae594f63e52fd9cace34576c2c4d826e6152110a22c333faf1271fd2d60c572d"} Jun 05 03:23:20.594685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:20.594651 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" event={"ID":"4f9c839b-8ff7-4ee0-ae36-54602d7865c7","Type":"ContainerStarted","Data":"f48e63eb174f917e5e79332a771fa1b5ffa896ee51820580422cf2962a9124d4"} Jun 05 03:23:20.595094 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:20.594768 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:23:20.613543 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:20.613499 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" podStartSLOduration=1.9686853 podStartE2EDuration="5.613484664s" totalImagesPullingTime="3.644799364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:23:20.612058564 +0000 UTC m=+289.782568664" watchObservedRunningTime="2026-06-05 03:23:20.613484664 +0000 UTC m=+289.783994765" Jun 05 03:23:23.660284 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.660250 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc"] Jun 05 03:23:23.664591 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.664572 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.667299 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.667274 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:23:23.667452 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.667431 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2k9hz\"" Jun 05 03:23:23.667908 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.667891 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:23:23.674679 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.674659 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc"] Jun 05 03:23:23.704820 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.704797 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.704912 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.704841 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.704912 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.704878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqxkw\" (UniqueName: \"kubernetes.io/projected/ecbdbffa-518e-4565-9eef-36e364dea675-kube-api-access-fqxkw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.805300 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.805272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqxkw\" (UniqueName: \"kubernetes.io/projected/ecbdbffa-518e-4565-9eef-36e364dea675-kube-api-access-fqxkw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.805471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.805358 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.805471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.805412 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.805758 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.805736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.805828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.805761 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.821290 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.821259 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqxkw\" (UniqueName: \"kubernetes.io/projected/ecbdbffa-518e-4565-9eef-36e364dea675-kube-api-access-fqxkw\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:23.974608 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:23.974557 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:24.111776 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:24.111725 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc"] Jun 05 03:23:24.114507 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:23:24.114484 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbdbffa_518e_4565_9eef_36e364dea675.slice/crio-528c553ecebf84fd30bac5052814d5b8fc2ffb22ff354a5e93ea14122c8da735 WatchSource:0}: Error finding container 528c553ecebf84fd30bac5052814d5b8fc2ffb22ff354a5e93ea14122c8da735: Status 404 returned error can't find the container with id 528c553ecebf84fd30bac5052814d5b8fc2ffb22ff354a5e93ea14122c8da735 Jun 05 03:23:24.613420 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:24.613389 2552 generic.go:356] "Generic (PLEG): container finished" podID="ecbdbffa-518e-4565-9eef-36e364dea675" containerID="210fb563152f546099d67b8c6709820bb617fad37cb09542ea48d9ef076a9f2e" exitCode=0 Jun 05 03:23:24.613579 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:24.613481 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" event={"ID":"ecbdbffa-518e-4565-9eef-36e364dea675","Type":"ContainerDied","Data":"210fb563152f546099d67b8c6709820bb617fad37cb09542ea48d9ef076a9f2e"} Jun 05 03:23:24.613579 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:24.613540 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" event={"ID":"ecbdbffa-518e-4565-9eef-36e364dea675","Type":"ContainerStarted","Data":"528c553ecebf84fd30bac5052814d5b8fc2ffb22ff354a5e93ea14122c8da735"} Jun 05 03:23:26.624228 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:26.624196 2552 generic.go:356] "Generic (PLEG): container finished" podID="ecbdbffa-518e-4565-9eef-36e364dea675" containerID="1f3d600ad918d971e4708369a323fddb41c758c84c9c7520ca6061356401787c" exitCode=0 Jun 05 03:23:26.624696 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:26.624238 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" event={"ID":"ecbdbffa-518e-4565-9eef-36e364dea675","Type":"ContainerDied","Data":"1f3d600ad918d971e4708369a323fddb41c758c84c9c7520ca6061356401787c"} Jun 05 03:23:27.630451 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:27.630421 2552 generic.go:356] "Generic (PLEG): container finished" podID="ecbdbffa-518e-4565-9eef-36e364dea675" containerID="7e5a7d5035ce64a9892fe7a9a4cbaa86eb502e32bfddb6431e3a5dd284f49721" exitCode=0 Jun 05 03:23:27.630862 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:27.630477 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" event={"ID":"ecbdbffa-518e-4565-9eef-36e364dea675","Type":"ContainerDied","Data":"7e5a7d5035ce64a9892fe7a9a4cbaa86eb502e32bfddb6431e3a5dd284f49721"} Jun 05 03:23:28.762253 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.762225 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:28.847505 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.847479 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-bundle\") pod \"ecbdbffa-518e-4565-9eef-36e364dea675\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " Jun 05 03:23:28.847645 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.847525 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-util\") pod \"ecbdbffa-518e-4565-9eef-36e364dea675\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " Jun 05 03:23:28.847645 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.847563 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqxkw\" (UniqueName: \"kubernetes.io/projected/ecbdbffa-518e-4565-9eef-36e364dea675-kube-api-access-fqxkw\") pod \"ecbdbffa-518e-4565-9eef-36e364dea675\" (UID: \"ecbdbffa-518e-4565-9eef-36e364dea675\") " Jun 05 03:23:28.848336 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.848292 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-bundle" (OuterVolumeSpecName: "bundle") pod "ecbdbffa-518e-4565-9eef-36e364dea675" (UID: "ecbdbffa-518e-4565-9eef-36e364dea675"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:23:28.849717 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.849690 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecbdbffa-518e-4565-9eef-36e364dea675-kube-api-access-fqxkw" (OuterVolumeSpecName: "kube-api-access-fqxkw") pod "ecbdbffa-518e-4565-9eef-36e364dea675" (UID: "ecbdbffa-518e-4565-9eef-36e364dea675"). InnerVolumeSpecName "kube-api-access-fqxkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:23:28.853060 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.853031 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-util" (OuterVolumeSpecName: "util") pod "ecbdbffa-518e-4565-9eef-36e364dea675" (UID: "ecbdbffa-518e-4565-9eef-36e364dea675"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:23:28.948241 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.948182 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:23:28.948241 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.948207 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqxkw\" (UniqueName: \"kubernetes.io/projected/ecbdbffa-518e-4565-9eef-36e364dea675-kube-api-access-fqxkw\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:23:28.948241 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:28.948217 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ecbdbffa-518e-4565-9eef-36e364dea675-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:23:29.641679 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:29.641602 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" Jun 05 03:23:29.641679 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:29.641614 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762armgvc" event={"ID":"ecbdbffa-518e-4565-9eef-36e364dea675","Type":"ContainerDied","Data":"528c553ecebf84fd30bac5052814d5b8fc2ffb22ff354a5e93ea14122c8da735"} Jun 05 03:23:29.641679 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:29.641655 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="528c553ecebf84fd30bac5052814d5b8fc2ffb22ff354a5e93ea14122c8da735" Jun 05 03:23:31.241308 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:31.241283 2552 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 03:23:41.980241 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980211 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-68fd4ddf97-grh4k"] Jun 05 03:23:41.982582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980520 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbdbffa-518e-4565-9eef-36e364dea675" containerName="extract" Jun 05 03:23:41.982582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980539 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbdbffa-518e-4565-9eef-36e364dea675" containerName="extract" Jun 05 03:23:41.982582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980553 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbdbffa-518e-4565-9eef-36e364dea675" containerName="util" Jun 05 03:23:41.982582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980559 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbdbffa-518e-4565-9eef-36e364dea675" containerName="util" Jun 05 03:23:41.982582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980576 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbdbffa-518e-4565-9eef-36e364dea675" containerName="pull" Jun 05 03:23:41.982582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980594 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbdbffa-518e-4565-9eef-36e364dea675" containerName="pull" Jun 05 03:23:41.982582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.980644 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbdbffa-518e-4565-9eef-36e364dea675" containerName="extract" Jun 05 03:23:41.983423 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.983408 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:41.986371 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.986352 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-j6lw5\"" Jun 05 03:23:41.986479 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.986424 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 03:23:41.993472 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:41.993454 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-68fd4ddf97-grh4k"] Jun 05 03:23:42.046526 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.046494 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p48s4\" (UniqueName: \"kubernetes.io/projected/62b78551-8f23-46ec-87ca-414cc5ec46fa-kube-api-access-p48s4\") pod \"dashboard-redirect-68fd4ddf97-grh4k\" (UID: \"62b78551-8f23-46ec-87ca-414cc5ec46fa\") " pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:42.046621 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.046545 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/62b78551-8f23-46ec-87ca-414cc5ec46fa-redirect-config\") pod \"dashboard-redirect-68fd4ddf97-grh4k\" (UID: \"62b78551-8f23-46ec-87ca-414cc5ec46fa\") " pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:42.147748 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.147724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/62b78551-8f23-46ec-87ca-414cc5ec46fa-redirect-config\") pod \"dashboard-redirect-68fd4ddf97-grh4k\" (UID: \"62b78551-8f23-46ec-87ca-414cc5ec46fa\") " pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:42.147847 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.147784 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p48s4\" (UniqueName: \"kubernetes.io/projected/62b78551-8f23-46ec-87ca-414cc5ec46fa-kube-api-access-p48s4\") pod \"dashboard-redirect-68fd4ddf97-grh4k\" (UID: \"62b78551-8f23-46ec-87ca-414cc5ec46fa\") " pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:42.148390 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.148370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/62b78551-8f23-46ec-87ca-414cc5ec46fa-redirect-config\") pod \"dashboard-redirect-68fd4ddf97-grh4k\" (UID: \"62b78551-8f23-46ec-87ca-414cc5ec46fa\") " pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:42.172824 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.172801 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p48s4\" (UniqueName: \"kubernetes.io/projected/62b78551-8f23-46ec-87ca-414cc5ec46fa-kube-api-access-p48s4\") pod \"dashboard-redirect-68fd4ddf97-grh4k\" (UID: \"62b78551-8f23-46ec-87ca-414cc5ec46fa\") " pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:42.295002 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.294943 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" Jun 05 03:23:42.424846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.424812 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-68fd4ddf97-grh4k"] Jun 05 03:23:42.427603 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:23:42.427574 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62b78551_8f23_46ec_87ca_414cc5ec46fa.slice/crio-48baeda7107a5376f53944be4950c34be3c14e4d43d4ff8748ff00b00fca967a WatchSource:0}: Error finding container 48baeda7107a5376f53944be4950c34be3c14e4d43d4ff8748ff00b00fca967a: Status 404 returned error can't find the container with id 48baeda7107a5376f53944be4950c34be3c14e4d43d4ff8748ff00b00fca967a Jun 05 03:23:42.428879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.428863 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:23:42.703222 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:42.703188 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" event={"ID":"62b78551-8f23-46ec-87ca-414cc5ec46fa","Type":"ContainerStarted","Data":"48baeda7107a5376f53944be4950c34be3c14e4d43d4ff8748ff00b00fca967a"} Jun 05 03:23:46.723183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:46.723144 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" event={"ID":"62b78551-8f23-46ec-87ca-414cc5ec46fa","Type":"ContainerStarted","Data":"abe052b88a8fd75a22a90085480475eb680e3fa8730585fb1e8de0d81933fcf7"} Jun 05 03:23:46.737943 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:46.737899 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-68fd4ddf97-grh4k" podStartSLOduration=2.243749806 podStartE2EDuration="5.73788466s" totalImagesPullingTime="3.494134854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:23:46.73715288 +0000 UTC m=+315.907662983" watchObservedRunningTime="2026-06-05 03:23:46.73788466 +0000 UTC m=+315.908394761" Jun 05 03:23:51.600843 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:23:51.600814 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-p5x2f" Jun 05 03:24:02.562087 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.562056 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m"] Jun 05 03:24:02.569050 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.569032 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.572197 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.572178 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 03:24:02.572561 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.572541 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-652tm\"" Jun 05 03:24:02.573678 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.573658 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 03:24:02.574122 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.574109 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 03:24:02.589741 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.589719 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m"] Jun 05 03:24:02.700223 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700429 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700236 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700429 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700293 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700429 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700413 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700440 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bcf597-62fa-4ece-a90d-dba258ba1bae-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700464 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700487 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700522 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.700582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.700565 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98nn2\" (UniqueName: \"kubernetes.io/projected/93bcf597-62fa-4ece-a90d-dba258ba1bae-kube-api-access-98nn2\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.801774 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.801744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.801965 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.801784 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.801965 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.801824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.801965 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.801856 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.801965 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.801880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bcf597-62fa-4ece-a90d-dba258ba1bae-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802205 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802205 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802057 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802205 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802097 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802205 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802151 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98nn2\" (UniqueName: \"kubernetes.io/projected/93bcf597-62fa-4ece-a90d-dba258ba1bae-kube-api-access-98nn2\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802433 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802269 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802433 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802288 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802587 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802542 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802587 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802573 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.802735 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.802713 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bcf597-62fa-4ece-a90d-dba258ba1bae-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.804079 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.804047 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.804379 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.804361 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.809597 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.809577 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bcf597-62fa-4ece-a90d-dba258ba1bae-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.809958 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.809940 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98nn2\" (UniqueName: \"kubernetes.io/projected/93bcf597-62fa-4ece-a90d-dba258ba1bae-kube-api-access-98nn2\") pod \"data-science-gateway-data-science-gateway-class-74759f9795sld7m\" (UID: \"93bcf597-62fa-4ece-a90d-dba258ba1bae\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:02.879576 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:02.879492 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:03.010779 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:03.010755 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m"] Jun 05 03:24:03.012242 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:03.012216 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bcf597_62fa_4ece_a90d_dba258ba1bae.slice/crio-b3bc05101baae42ff5657b1c2080b7bf6fb60d6dd90ba2ea49969f312749776d WatchSource:0}: Error finding container b3bc05101baae42ff5657b1c2080b7bf6fb60d6dd90ba2ea49969f312749776d: Status 404 returned error can't find the container with id b3bc05101baae42ff5657b1c2080b7bf6fb60d6dd90ba2ea49969f312749776d Jun 05 03:24:03.802972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:03.802938 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" event={"ID":"93bcf597-62fa-4ece-a90d-dba258ba1bae","Type":"ContainerStarted","Data":"b3bc05101baae42ff5657b1c2080b7bf6fb60d6dd90ba2ea49969f312749776d"} Jun 05 03:24:06.191288 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:06.191245 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:24:06.191582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:06.191332 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:24:06.191582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:06.191365 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:24:06.819327 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:06.819292 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" event={"ID":"93bcf597-62fa-4ece-a90d-dba258ba1bae","Type":"ContainerStarted","Data":"99c56c1f7e736b1c8ca058a741d8959b6fce700af6b48e55f534bce3d871b533"} Jun 05 03:24:06.841333 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:06.841276 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" podStartSLOduration=1.66454876 podStartE2EDuration="4.841261908s" totalImagesPullingTime="3.176713148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:24:06.839290338 +0000 UTC m=+336.009800479" watchObservedRunningTime="2026-06-05 03:24:06.841261908 +0000 UTC m=+336.011772008" Jun 05 03:24:06.880046 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:06.880023 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:07.311140 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.311114 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c9m9d"] Jun 05 03:24:07.314520 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.314500 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" Jun 05 03:24:07.316671 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.316646 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mp97l\"" Jun 05 03:24:07.316783 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.316654 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 03:24:07.317425 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.317403 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 03:24:07.323630 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.323607 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c9m9d"] Jun 05 03:24:07.445127 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.445084 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdf9s\" (UniqueName: \"kubernetes.io/projected/77bd0748-6d33-4184-ac71-58c36a68ae13-kube-api-access-sdf9s\") pod \"kuadrant-operator-catalog-c9m9d\" (UID: \"77bd0748-6d33-4184-ac71-58c36a68ae13\") " pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" Jun 05 03:24:07.545685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.545658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdf9s\" (UniqueName: \"kubernetes.io/projected/77bd0748-6d33-4184-ac71-58c36a68ae13-kube-api-access-sdf9s\") pod \"kuadrant-operator-catalog-c9m9d\" (UID: \"77bd0748-6d33-4184-ac71-58c36a68ae13\") " pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" Jun 05 03:24:07.553197 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.553170 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdf9s\" (UniqueName: \"kubernetes.io/projected/77bd0748-6d33-4184-ac71-58c36a68ae13-kube-api-access-sdf9s\") pod \"kuadrant-operator-catalog-c9m9d\" (UID: \"77bd0748-6d33-4184-ac71-58c36a68ae13\") " pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" Jun 05 03:24:07.625398 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.625341 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" Jun 05 03:24:07.677754 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.677725 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c9m9d"] Jun 05 03:24:07.749403 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.749378 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c9m9d"] Jun 05 03:24:07.751418 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:07.751389 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bd0748_6d33_4184_ac71_58c36a68ae13.slice/crio-d6170d1122922da7d21bd9a2c7fca5c3ea3c34442f1786776c80c04c74c302af WatchSource:0}: Error finding container d6170d1122922da7d21bd9a2c7fca5c3ea3c34442f1786776c80c04c74c302af: Status 404 returned error can't find the container with id d6170d1122922da7d21bd9a2c7fca5c3ea3c34442f1786776c80c04c74c302af Jun 05 03:24:07.824840 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.824798 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" event={"ID":"77bd0748-6d33-4184-ac71-58c36a68ae13","Type":"ContainerStarted","Data":"d6170d1122922da7d21bd9a2c7fca5c3ea3c34442f1786776c80c04c74c302af"} Jun 05 03:24:07.884571 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.884504 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:07.885907 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.885889 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pn22d"] Jun 05 03:24:07.890255 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.890239 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:07.895025 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:07.895005 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pn22d"] Jun 05 03:24:08.049420 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.049394 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h8ph\" (UniqueName: \"kubernetes.io/projected/95474b49-17df-4ec2-8ea9-e48a9f88cb4b-kube-api-access-2h8ph\") pod \"kuadrant-operator-catalog-pn22d\" (UID: \"95474b49-17df-4ec2-8ea9-e48a9f88cb4b\") " pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:08.150237 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.150169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h8ph\" (UniqueName: \"kubernetes.io/projected/95474b49-17df-4ec2-8ea9-e48a9f88cb4b-kube-api-access-2h8ph\") pod \"kuadrant-operator-catalog-pn22d\" (UID: \"95474b49-17df-4ec2-8ea9-e48a9f88cb4b\") " pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:08.157285 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.157261 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h8ph\" (UniqueName: \"kubernetes.io/projected/95474b49-17df-4ec2-8ea9-e48a9f88cb4b-kube-api-access-2h8ph\") pod \"kuadrant-operator-catalog-pn22d\" (UID: \"95474b49-17df-4ec2-8ea9-e48a9f88cb4b\") " pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:08.200451 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.200421 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:08.328030 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.327908 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pn22d"] Jun 05 03:24:08.330128 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:08.330106 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95474b49_17df_4ec2_8ea9_e48a9f88cb4b.slice/crio-80ba457dcb4d1058eec0ad2f1c5d3ca3d0522a4ac1386db642fe821e47ace46e WatchSource:0}: Error finding container 80ba457dcb4d1058eec0ad2f1c5d3ca3d0522a4ac1386db642fe821e47ace46e: Status 404 returned error can't find the container with id 80ba457dcb4d1058eec0ad2f1c5d3ca3d0522a4ac1386db642fe821e47ace46e Jun 05 03:24:08.835128 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.835093 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" event={"ID":"95474b49-17df-4ec2-8ea9-e48a9f88cb4b","Type":"ContainerStarted","Data":"80ba457dcb4d1058eec0ad2f1c5d3ca3d0522a4ac1386db642fe821e47ace46e"} Jun 05 03:24:08.835386 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.835358 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:08.836270 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:08.836251 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795sld7m" Jun 05 03:24:10.846290 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:10.846255 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" event={"ID":"95474b49-17df-4ec2-8ea9-e48a9f88cb4b","Type":"ContainerStarted","Data":"779a39da1e863b638edf9844f0a3f4d433b6fff7d3d1c0b0e5db7d105a9597ac"} Jun 05 03:24:10.847760 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:10.847732 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" event={"ID":"77bd0748-6d33-4184-ac71-58c36a68ae13","Type":"ContainerStarted","Data":"b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628"} Jun 05 03:24:10.847875 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:10.847732 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" podUID="77bd0748-6d33-4184-ac71-58c36a68ae13" containerName="registry-server" containerID="cri-o://b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628" gracePeriod=2 Jun 05 03:24:10.861592 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:10.861503 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" podStartSLOduration=2.3624092709999998 podStartE2EDuration="3.861488635s" totalImagesPullingTime="1.499079364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:24:10.859206179 +0000 UTC m=+340.029716282" watchObservedRunningTime="2026-06-05 03:24:10.861488635 +0000 UTC m=+340.031998740" Jun 05 03:24:10.873178 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:10.873141 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" podStartSLOduration=1.7980853350000001 podStartE2EDuration="3.873128073s" totalImagesPullingTime="2.075042738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:24:10.871818764 +0000 UTC m=+340.042328866" watchObservedRunningTime="2026-06-05 03:24:10.873128073 +0000 UTC m=+340.043638173" Jun 05 03:24:11.086300 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.086276 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" Jun 05 03:24:11.180835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.180780 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdf9s\" (UniqueName: \"kubernetes.io/projected/77bd0748-6d33-4184-ac71-58c36a68ae13-kube-api-access-sdf9s\") pod \"77bd0748-6d33-4184-ac71-58c36a68ae13\" (UID: \"77bd0748-6d33-4184-ac71-58c36a68ae13\") " Jun 05 03:24:11.182794 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.182769 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bd0748-6d33-4184-ac71-58c36a68ae13-kube-api-access-sdf9s" (OuterVolumeSpecName: "kube-api-access-sdf9s") pod "77bd0748-6d33-4184-ac71-58c36a68ae13" (UID: "77bd0748-6d33-4184-ac71-58c36a68ae13"). InnerVolumeSpecName "kube-api-access-sdf9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:24:11.281924 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.281899 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdf9s\" (UniqueName: \"kubernetes.io/projected/77bd0748-6d33-4184-ac71-58c36a68ae13-kube-api-access-sdf9s\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:11.853418 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.853385 2552 generic.go:356] "Generic (PLEG): container finished" podID="77bd0748-6d33-4184-ac71-58c36a68ae13" containerID="b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628" exitCode=0 Jun 05 03:24:11.853850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.853437 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" Jun 05 03:24:11.853850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.853464 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" event={"ID":"77bd0748-6d33-4184-ac71-58c36a68ae13","Type":"ContainerDied","Data":"b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628"} Jun 05 03:24:11.853850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.853537 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-c9m9d" event={"ID":"77bd0748-6d33-4184-ac71-58c36a68ae13","Type":"ContainerDied","Data":"d6170d1122922da7d21bd9a2c7fca5c3ea3c34442f1786776c80c04c74c302af"} Jun 05 03:24:11.853850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.853559 2552 scope.go:117] "RemoveContainer" containerID="b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628" Jun 05 03:24:11.864413 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.864381 2552 scope.go:117] "RemoveContainer" containerID="b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628" Jun 05 03:24:11.864957 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:24:11.864936 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628\": container with ID starting with b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628 not found: ID does not exist" containerID="b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628" Jun 05 03:24:11.865039 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.864980 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628"} err="failed to get container status \"b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628\": rpc error: code = NotFound desc = could not find container \"b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628\": container with ID starting with b99a75c46f0b3e3ab05eda429b2f0a5016123d77955110b6e5aadedd9ead4628 not found: ID does not exist" Jun 05 03:24:11.868449 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.868427 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c9m9d"] Jun 05 03:24:11.871907 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:11.871888 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-c9m9d"] Jun 05 03:24:13.292353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:13.292304 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77bd0748-6d33-4184-ac71-58c36a68ae13" path="/var/lib/kubelet/pods/77bd0748-6d33-4184-ac71-58c36a68ae13/volumes" Jun 05 03:24:18.201443 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:18.201411 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:18.201881 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:18.201461 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:18.223366 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:18.223343 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:18.910100 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:18.910076 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pn22d" Jun 05 03:24:22.519792 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.519708 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5"] Jun 05 03:24:22.520174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.520100 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bd0748-6d33-4184-ac71-58c36a68ae13" containerName="registry-server" Jun 05 03:24:22.520174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.520114 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bd0748-6d33-4184-ac71-58c36a68ae13" containerName="registry-server" Jun 05 03:24:22.520246 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.520180 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bd0748-6d33-4184-ac71-58c36a68ae13" containerName="registry-server" Jun 05 03:24:22.522997 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.522980 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.525140 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.525118 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lldln\"" Jun 05 03:24:22.530698 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.530674 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5"] Jun 05 03:24:22.562022 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.561995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.562123 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.562027 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dzrb\" (UniqueName: \"kubernetes.io/projected/9139143a-6bd3-49cc-ab04-de0d6f9156eb-kube-api-access-7dzrb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.562123 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.562049 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.662484 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.662463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.662598 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.662497 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dzrb\" (UniqueName: \"kubernetes.io/projected/9139143a-6bd3-49cc-ab04-de0d6f9156eb-kube-api-access-7dzrb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.662598 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.662528 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.662824 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.662805 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.662861 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.662828 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.670445 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.670421 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dzrb\" (UniqueName: \"kubernetes.io/projected/9139143a-6bd3-49cc-ab04-de0d6f9156eb-kube-api-access-7dzrb\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.833060 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.833032 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:22.923133 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.923105 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg"] Jun 05 03:24:22.926865 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.926845 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:22.934946 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.934923 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg"] Jun 05 03:24:22.964803 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.964774 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:22.964894 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.964851 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw66d\" (UniqueName: \"kubernetes.io/projected/423a5171-328d-42ca-83cc-36e9361f9aba-kube-api-access-hw66d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:22.964894 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.964881 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:22.965596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:22.965575 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5"] Jun 05 03:24:22.967291 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:22.967265 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9139143a_6bd3_49cc_ab04_de0d6f9156eb.slice/crio-1acd15a82565f33d34ede24292c8299dda2e0219b6e4c3b8505b80781e15ab84 WatchSource:0}: Error finding container 1acd15a82565f33d34ede24292c8299dda2e0219b6e4c3b8505b80781e15ab84: Status 404 returned error can't find the container with id 1acd15a82565f33d34ede24292c8299dda2e0219b6e4c3b8505b80781e15ab84 Jun 05 03:24:23.065705 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.065680 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:23.065816 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.065724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw66d\" (UniqueName: \"kubernetes.io/projected/423a5171-328d-42ca-83cc-36e9361f9aba-kube-api-access-hw66d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:23.065816 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.065747 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:23.066026 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.066009 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:23.066063 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.066042 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:23.074100 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.074080 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw66d\" (UniqueName: \"kubernetes.io/projected/423a5171-328d-42ca-83cc-36e9361f9aba-kube-api-access-hw66d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:23.240088 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.240029 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:23.362558 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.362534 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg"] Jun 05 03:24:23.364442 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:23.364416 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423a5171_328d_42ca_83cc_36e9361f9aba.slice/crio-f6feffabe49a1fc022a25a2f20649ef0cd09da6e8898750a6e1d7dfd8190335f WatchSource:0}: Error finding container f6feffabe49a1fc022a25a2f20649ef0cd09da6e8898750a6e1d7dfd8190335f: Status 404 returned error can't find the container with id f6feffabe49a1fc022a25a2f20649ef0cd09da6e8898750a6e1d7dfd8190335f Jun 05 03:24:23.518010 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.517951 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn"] Jun 05 03:24:23.521555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.521539 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.527507 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.527484 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn"] Jun 05 03:24:23.570718 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.570695 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqtl5\" (UniqueName: \"kubernetes.io/projected/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-kube-api-access-xqtl5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.570820 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.570738 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.570820 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.570758 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.671562 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.671536 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqtl5\" (UniqueName: \"kubernetes.io/projected/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-kube-api-access-xqtl5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.671664 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.671581 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.671664 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.671612 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.671961 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.671940 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.671999 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.671956 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.679565 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.679536 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqtl5\" (UniqueName: \"kubernetes.io/projected/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-kube-api-access-xqtl5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.846175 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.846155 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:23.917241 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.917213 2552 generic.go:356] "Generic (PLEG): container finished" podID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerID="64207a440a0341ed0bd50c364f728479421c8e586f2d3da7f632ccd7fabae7d7" exitCode=0 Jun 05 03:24:23.917420 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.917286 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" event={"ID":"9139143a-6bd3-49cc-ab04-de0d6f9156eb","Type":"ContainerDied","Data":"64207a440a0341ed0bd50c364f728479421c8e586f2d3da7f632ccd7fabae7d7"} Jun 05 03:24:23.917420 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.917355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" event={"ID":"9139143a-6bd3-49cc-ab04-de0d6f9156eb","Type":"ContainerStarted","Data":"1acd15a82565f33d34ede24292c8299dda2e0219b6e4c3b8505b80781e15ab84"} Jun 05 03:24:23.919006 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.918981 2552 generic.go:356] "Generic (PLEG): container finished" podID="423a5171-328d-42ca-83cc-36e9361f9aba" containerID="4787d602bb4c5024c3d4a6cd5a27e1c4d4b0d7816b7ef8f56039f7106f7fce6d" exitCode=0 Jun 05 03:24:23.919116 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.919065 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" event={"ID":"423a5171-328d-42ca-83cc-36e9361f9aba","Type":"ContainerDied","Data":"4787d602bb4c5024c3d4a6cd5a27e1c4d4b0d7816b7ef8f56039f7106f7fce6d"} Jun 05 03:24:23.919116 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.919106 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" event={"ID":"423a5171-328d-42ca-83cc-36e9361f9aba","Type":"ContainerStarted","Data":"f6feffabe49a1fc022a25a2f20649ef0cd09da6e8898750a6e1d7dfd8190335f"} Jun 05 03:24:23.973738 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:23.973714 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn"] Jun 05 03:24:23.975564 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:23.975536 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd48e5b_82b3_47fa_aa4e_f9947a45e17f.slice/crio-25d14cb60f8a9eaeb71e15f82e3ca8cc274b20be5bc8b5ded16a4e25a2de1a9f WatchSource:0}: Error finding container 25d14cb60f8a9eaeb71e15f82e3ca8cc274b20be5bc8b5ded16a4e25a2de1a9f: Status 404 returned error can't find the container with id 25d14cb60f8a9eaeb71e15f82e3ca8cc274b20be5bc8b5ded16a4e25a2de1a9f Jun 05 03:24:24.126530 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.126475 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766"] Jun 05 03:24:24.129912 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.129897 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.139975 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.139952 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766"] Jun 05 03:24:24.175252 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.175230 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.175373 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.175265 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.175373 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.175287 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfmdt\" (UniqueName: \"kubernetes.io/projected/b80807d1-729a-4609-9544-0ac91c43a7bf-kube-api-access-lfmdt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.275787 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.275763 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.275860 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.275794 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.275860 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.275817 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfmdt\" (UniqueName: \"kubernetes.io/projected/b80807d1-729a-4609-9544-0ac91c43a7bf-kube-api-access-lfmdt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.276087 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.276070 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.276126 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.276104 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.283633 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.283609 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfmdt\" (UniqueName: \"kubernetes.io/projected/b80807d1-729a-4609-9544-0ac91c43a7bf-kube-api-access-lfmdt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.447978 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.447925 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:24.570918 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.570894 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766"] Jun 05 03:24:24.572127 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:24.572104 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80807d1_729a_4609_9544_0ac91c43a7bf.slice/crio-324a93e3ca628cc194563e802a2a4b214432a5f8a75661b10b826daa3266df2b WatchSource:0}: Error finding container 324a93e3ca628cc194563e802a2a4b214432a5f8a75661b10b826daa3266df2b: Status 404 returned error can't find the container with id 324a93e3ca628cc194563e802a2a4b214432a5f8a75661b10b826daa3266df2b Jun 05 03:24:24.925163 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.925136 2552 generic.go:356] "Generic (PLEG): container finished" podID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerID="51352331323f3511b2c21ae498e2e7cf03c616b2b3fd2ce6f8a1c9e45ea8b79c" exitCode=0 Jun 05 03:24:24.925256 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.925203 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" event={"ID":"b80807d1-729a-4609-9544-0ac91c43a7bf","Type":"ContainerDied","Data":"51352331323f3511b2c21ae498e2e7cf03c616b2b3fd2ce6f8a1c9e45ea8b79c"} Jun 05 03:24:24.925326 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.925251 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" event={"ID":"b80807d1-729a-4609-9544-0ac91c43a7bf","Type":"ContainerStarted","Data":"324a93e3ca628cc194563e802a2a4b214432a5f8a75661b10b826daa3266df2b"} Jun 05 03:24:24.927154 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.927118 2552 generic.go:356] "Generic (PLEG): container finished" podID="423a5171-328d-42ca-83cc-36e9361f9aba" containerID="08fa779f23056487d065926eb6ecb8c0859f56b9bf9a77c3b414ade7450ea7fd" exitCode=0 Jun 05 03:24:24.927154 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.927149 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" event={"ID":"423a5171-328d-42ca-83cc-36e9361f9aba","Type":"ContainerDied","Data":"08fa779f23056487d065926eb6ecb8c0859f56b9bf9a77c3b414ade7450ea7fd"} Jun 05 03:24:24.928793 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.928770 2552 generic.go:356] "Generic (PLEG): container finished" podID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerID="8644c661261838a264ca1989fbc46f0b80a40005e69f2186a03d6a0b55c492a1" exitCode=0 Jun 05 03:24:24.928906 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.928798 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" event={"ID":"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f","Type":"ContainerDied","Data":"8644c661261838a264ca1989fbc46f0b80a40005e69f2186a03d6a0b55c492a1"} Jun 05 03:24:24.928906 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:24.928842 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" event={"ID":"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f","Type":"ContainerStarted","Data":"25d14cb60f8a9eaeb71e15f82e3ca8cc274b20be5bc8b5ded16a4e25a2de1a9f"} Jun 05 03:24:25.936391 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:25.936335 2552 generic.go:356] "Generic (PLEG): container finished" podID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerID="01a50ee4fa03f9423d67c69203b4b0bfe8b2bc94c770c9737c06162385b3d611" exitCode=0 Jun 05 03:24:25.936743 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:25.936409 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" event={"ID":"9139143a-6bd3-49cc-ab04-de0d6f9156eb","Type":"ContainerDied","Data":"01a50ee4fa03f9423d67c69203b4b0bfe8b2bc94c770c9737c06162385b3d611"} Jun 05 03:24:25.938239 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:25.938215 2552 generic.go:356] "Generic (PLEG): container finished" podID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerID="72447d0f7aeeb6b14c06701202a108fe1c6f845c2ae37b8c4c84cef909cb375b" exitCode=0 Jun 05 03:24:25.938355 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:25.938300 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" event={"ID":"b80807d1-729a-4609-9544-0ac91c43a7bf","Type":"ContainerDied","Data":"72447d0f7aeeb6b14c06701202a108fe1c6f845c2ae37b8c4c84cef909cb375b"} Jun 05 03:24:25.941060 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:25.941034 2552 generic.go:356] "Generic (PLEG): container finished" podID="423a5171-328d-42ca-83cc-36e9361f9aba" containerID="4095b5d3548350a57f4eb17ceed87a3ee2936083dc530705f5c7c050a62dfa59" exitCode=0 Jun 05 03:24:25.941144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:25.941122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" event={"ID":"423a5171-328d-42ca-83cc-36e9361f9aba","Type":"ContainerDied","Data":"4095b5d3548350a57f4eb17ceed87a3ee2936083dc530705f5c7c050a62dfa59"} Jun 05 03:24:26.948292 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:26.948207 2552 generic.go:356] "Generic (PLEG): container finished" podID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerID="4a9c66f02e4531a975ae33204640380196db4423c5cae86b35e3ec6a611e03fc" exitCode=0 Jun 05 03:24:26.948739 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:26.948290 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" event={"ID":"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f","Type":"ContainerDied","Data":"4a9c66f02e4531a975ae33204640380196db4423c5cae86b35e3ec6a611e03fc"} Jun 05 03:24:26.950514 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:26.950491 2552 generic.go:356] "Generic (PLEG): container finished" podID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerID="3be421b8884f2be8fc7ca3abc2eed265dd1769ce714edd73289a0ca9c076d829" exitCode=0 Jun 05 03:24:26.950603 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:26.950570 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" event={"ID":"9139143a-6bd3-49cc-ab04-de0d6f9156eb","Type":"ContainerDied","Data":"3be421b8884f2be8fc7ca3abc2eed265dd1769ce714edd73289a0ca9c076d829"} Jun 05 03:24:26.952592 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:26.952571 2552 generic.go:356] "Generic (PLEG): container finished" podID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerID="34fcdf96812e6509c3753566454e6718e80bf01da15a38df45b8cbfae7a7b91e" exitCode=0 Jun 05 03:24:26.952676 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:26.952626 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" event={"ID":"b80807d1-729a-4609-9544-0ac91c43a7bf","Type":"ContainerDied","Data":"34fcdf96812e6509c3753566454e6718e80bf01da15a38df45b8cbfae7a7b91e"} Jun 05 03:24:27.141851 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.141827 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:27.199273 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.199225 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw66d\" (UniqueName: \"kubernetes.io/projected/423a5171-328d-42ca-83cc-36e9361f9aba-kube-api-access-hw66d\") pod \"423a5171-328d-42ca-83cc-36e9361f9aba\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " Jun 05 03:24:27.199273 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.199262 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-bundle\") pod \"423a5171-328d-42ca-83cc-36e9361f9aba\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " Jun 05 03:24:27.199424 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.199280 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-util\") pod \"423a5171-328d-42ca-83cc-36e9361f9aba\" (UID: \"423a5171-328d-42ca-83cc-36e9361f9aba\") " Jun 05 03:24:27.199746 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.199723 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-bundle" (OuterVolumeSpecName: "bundle") pod "423a5171-328d-42ca-83cc-36e9361f9aba" (UID: "423a5171-328d-42ca-83cc-36e9361f9aba"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:27.201250 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.201223 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/423a5171-328d-42ca-83cc-36e9361f9aba-kube-api-access-hw66d" (OuterVolumeSpecName: "kube-api-access-hw66d") pod "423a5171-328d-42ca-83cc-36e9361f9aba" (UID: "423a5171-328d-42ca-83cc-36e9361f9aba"). InnerVolumeSpecName "kube-api-access-hw66d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:24:27.204540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.204500 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-util" (OuterVolumeSpecName: "util") pod "423a5171-328d-42ca-83cc-36e9361f9aba" (UID: "423a5171-328d-42ca-83cc-36e9361f9aba"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:27.299808 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.299789 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw66d\" (UniqueName: \"kubernetes.io/projected/423a5171-328d-42ca-83cc-36e9361f9aba-kube-api-access-hw66d\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:27.299808 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.299808 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:27.299922 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.299816 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/423a5171-328d-42ca-83cc-36e9361f9aba-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:27.959721 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.959690 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" Jun 05 03:24:27.960119 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.959691 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg" event={"ID":"423a5171-328d-42ca-83cc-36e9361f9aba","Type":"ContainerDied","Data":"f6feffabe49a1fc022a25a2f20649ef0cd09da6e8898750a6e1d7dfd8190335f"} Jun 05 03:24:27.960119 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.959812 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6feffabe49a1fc022a25a2f20649ef0cd09da6e8898750a6e1d7dfd8190335f" Jun 05 03:24:27.962059 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.962030 2552 generic.go:356] "Generic (PLEG): container finished" podID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerID="43da75573d559b129c310cccd339f8745390a4a26257553f11a5a7134cc16b91" exitCode=0 Jun 05 03:24:27.962183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:27.962133 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" event={"ID":"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f","Type":"ContainerDied","Data":"43da75573d559b129c310cccd339f8745390a4a26257553f11a5a7134cc16b91"} Jun 05 03:24:28.100648 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.100622 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:28.134044 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.134025 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:28.208606 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.208581 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfmdt\" (UniqueName: \"kubernetes.io/projected/b80807d1-729a-4609-9544-0ac91c43a7bf-kube-api-access-lfmdt\") pod \"b80807d1-729a-4609-9544-0ac91c43a7bf\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " Jun 05 03:24:28.208735 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.208636 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-bundle\") pod \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " Jun 05 03:24:28.208735 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.208658 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-util\") pod \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " Jun 05 03:24:28.208735 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.208687 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dzrb\" (UniqueName: \"kubernetes.io/projected/9139143a-6bd3-49cc-ab04-de0d6f9156eb-kube-api-access-7dzrb\") pod \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\" (UID: \"9139143a-6bd3-49cc-ab04-de0d6f9156eb\") " Jun 05 03:24:28.208865 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.208796 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-bundle\") pod \"b80807d1-729a-4609-9544-0ac91c43a7bf\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " Jun 05 03:24:28.208865 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.208828 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-util\") pod \"b80807d1-729a-4609-9544-0ac91c43a7bf\" (UID: \"b80807d1-729a-4609-9544-0ac91c43a7bf\") " Jun 05 03:24:28.209613 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.209580 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-bundle" (OuterVolumeSpecName: "bundle") pod "9139143a-6bd3-49cc-ab04-de0d6f9156eb" (UID: "9139143a-6bd3-49cc-ab04-de0d6f9156eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:28.209835 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.209770 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-bundle" (OuterVolumeSpecName: "bundle") pod "b80807d1-729a-4609-9544-0ac91c43a7bf" (UID: "b80807d1-729a-4609-9544-0ac91c43a7bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:28.211144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.211115 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9139143a-6bd3-49cc-ab04-de0d6f9156eb-kube-api-access-7dzrb" (OuterVolumeSpecName: "kube-api-access-7dzrb") pod "9139143a-6bd3-49cc-ab04-de0d6f9156eb" (UID: "9139143a-6bd3-49cc-ab04-de0d6f9156eb"). InnerVolumeSpecName "kube-api-access-7dzrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:24:28.211238 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.211151 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80807d1-729a-4609-9544-0ac91c43a7bf-kube-api-access-lfmdt" (OuterVolumeSpecName: "kube-api-access-lfmdt") pod "b80807d1-729a-4609-9544-0ac91c43a7bf" (UID: "b80807d1-729a-4609-9544-0ac91c43a7bf"). InnerVolumeSpecName "kube-api-access-lfmdt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:24:28.214144 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.214103 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-util" (OuterVolumeSpecName: "util") pod "9139143a-6bd3-49cc-ab04-de0d6f9156eb" (UID: "9139143a-6bd3-49cc-ab04-de0d6f9156eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:28.214832 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.214811 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-util" (OuterVolumeSpecName: "util") pod "b80807d1-729a-4609-9544-0ac91c43a7bf" (UID: "b80807d1-729a-4609-9544-0ac91c43a7bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:28.309953 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.309931 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:28.309953 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.309950 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b80807d1-729a-4609-9544-0ac91c43a7bf-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:28.310055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.309960 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfmdt\" (UniqueName: \"kubernetes.io/projected/b80807d1-729a-4609-9544-0ac91c43a7bf-kube-api-access-lfmdt\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:28.310055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.309969 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:28.310055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.309976 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9139143a-6bd3-49cc-ab04-de0d6f9156eb-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:28.310055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.309984 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dzrb\" (UniqueName: \"kubernetes.io/projected/9139143a-6bd3-49cc-ab04-de0d6f9156eb-kube-api-access-7dzrb\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:28.969549 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.969523 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" Jun 05 03:24:28.969958 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.969515 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5" event={"ID":"9139143a-6bd3-49cc-ab04-de0d6f9156eb","Type":"ContainerDied","Data":"1acd15a82565f33d34ede24292c8299dda2e0219b6e4c3b8505b80781e15ab84"} Jun 05 03:24:28.969958 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.969635 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1acd15a82565f33d34ede24292c8299dda2e0219b6e4c3b8505b80781e15ab84" Jun 05 03:24:28.971512 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.971491 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" Jun 05 03:24:28.971610 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.971491 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766" event={"ID":"b80807d1-729a-4609-9544-0ac91c43a7bf","Type":"ContainerDied","Data":"324a93e3ca628cc194563e802a2a4b214432a5f8a75661b10b826daa3266df2b"} Jun 05 03:24:28.971610 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:28.971544 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="324a93e3ca628cc194563e802a2a4b214432a5f8a75661b10b826daa3266df2b" Jun 05 03:24:29.093180 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.093160 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:29.115426 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.115400 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqtl5\" (UniqueName: \"kubernetes.io/projected/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-kube-api-access-xqtl5\") pod \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " Jun 05 03:24:29.115545 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.115445 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-util\") pod \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " Jun 05 03:24:29.115545 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.115477 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-bundle\") pod \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\" (UID: \"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f\") " Jun 05 03:24:29.115946 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.115920 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-bundle" (OuterVolumeSpecName: "bundle") pod "5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" (UID: "5bd48e5b-82b3-47fa-aa4e-f9947a45e17f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:29.117535 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.117506 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-kube-api-access-xqtl5" (OuterVolumeSpecName: "kube-api-access-xqtl5") pod "5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" (UID: "5bd48e5b-82b3-47fa-aa4e-f9947a45e17f"). InnerVolumeSpecName "kube-api-access-xqtl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:24:29.123517 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.123478 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-util" (OuterVolumeSpecName: "util") pod "5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" (UID: "5bd48e5b-82b3-47fa-aa4e-f9947a45e17f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:24:29.216181 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.216158 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:29.216181 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.216179 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqtl5\" (UniqueName: \"kubernetes.io/projected/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-kube-api-access-xqtl5\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:29.216301 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.216188 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5bd48e5b-82b3-47fa-aa4e-f9947a45e17f-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:24:29.979593 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.979566 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" Jun 05 03:24:29.980073 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.979593 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn" event={"ID":"5bd48e5b-82b3-47fa-aa4e-f9947a45e17f","Type":"ContainerDied","Data":"25d14cb60f8a9eaeb71e15f82e3ca8cc274b20be5bc8b5ded16a4e25a2de1a9f"} Jun 05 03:24:29.980073 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:29.979639 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25d14cb60f8a9eaeb71e15f82e3ca8cc274b20be5bc8b5ded16a4e25a2de1a9f" Jun 05 03:24:34.479460 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479425 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544668dffc-sfdnm"] Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479745 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerName="util" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479756 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerName="util" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479767 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerName="util" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479773 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerName="util" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479779 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerName="pull" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479785 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerName="pull" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479799 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423a5171-328d-42ca-83cc-36e9361f9aba" containerName="pull" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479805 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="423a5171-328d-42ca-83cc-36e9361f9aba" containerName="pull" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479812 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerName="extract" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479817 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerName="extract" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479824 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerName="pull" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479829 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerName="pull" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479835 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerName="extract" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479840 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerName="extract" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479847 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423a5171-328d-42ca-83cc-36e9361f9aba" containerName="util" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479852 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="423a5171-328d-42ca-83cc-36e9361f9aba" containerName="util" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479857 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerName="extract" Jun 05 03:24:34.479854 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479862 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerName="extract" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479868 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerName="pull" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479873 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerName="pull" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479881 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerName="util" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479885 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerName="util" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479895 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="423a5171-328d-42ca-83cc-36e9361f9aba" containerName="extract" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479899 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="423a5171-328d-42ca-83cc-36e9361f9aba" containerName="extract" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479949 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="9139143a-6bd3-49cc-ab04-de0d6f9156eb" containerName="extract" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479956 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="423a5171-328d-42ca-83cc-36e9361f9aba" containerName="extract" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479965 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd48e5b-82b3-47fa-aa4e-f9947a45e17f" containerName="extract" Jun 05 03:24:34.480384 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.479971 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80807d1-729a-4609-9544-0ac91c43a7bf" containerName="extract" Jun 05 03:24:34.484190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.484173 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.492726 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.492699 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544668dffc-sfdnm"] Jun 05 03:24:34.556058 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.556033 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-service-ca\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.556188 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.556065 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-trusted-ca-bundle\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.556188 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.556087 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d652103-a8e7-477a-94df-4bcf68954557-console-oauth-config\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.556188 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.556102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-oauth-serving-cert\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.556375 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.556203 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d652103-a8e7-477a-94df-4bcf68954557-console-serving-cert\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.556375 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.556244 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-console-config\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.556375 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.556268 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77t22\" (UniqueName: \"kubernetes.io/projected/3d652103-a8e7-477a-94df-4bcf68954557-kube-api-access-77t22\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.656947 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.656915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d652103-a8e7-477a-94df-4bcf68954557-console-serving-cert\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657062 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.656954 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-console-config\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657062 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.656978 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77t22\" (UniqueName: \"kubernetes.io/projected/3d652103-a8e7-477a-94df-4bcf68954557-kube-api-access-77t22\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657062 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.657050 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-service-ca\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657213 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.657078 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-trusted-ca-bundle\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657213 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.657116 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d652103-a8e7-477a-94df-4bcf68954557-console-oauth-config\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657213 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.657139 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-oauth-serving-cert\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657823 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.657791 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-console-config\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657915 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.657845 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-service-ca\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.657915 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.657883 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-oauth-serving-cert\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.658177 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.658150 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d652103-a8e7-477a-94df-4bcf68954557-trusted-ca-bundle\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.659788 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.659762 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d652103-a8e7-477a-94df-4bcf68954557-console-oauth-config\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.659844 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.659824 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d652103-a8e7-477a-94df-4bcf68954557-console-serving-cert\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.664918 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.664896 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77t22\" (UniqueName: \"kubernetes.io/projected/3d652103-a8e7-477a-94df-4bcf68954557-kube-api-access-77t22\") pod \"console-544668dffc-sfdnm\" (UID: \"3d652103-a8e7-477a-94df-4bcf68954557\") " pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.794729 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.794664 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:34.927627 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:34.927601 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544668dffc-sfdnm"] Jun 05 03:24:34.929216 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:34.929195 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d652103_a8e7_477a_94df_4bcf68954557.slice/crio-e2d5dae101ff7cb8be863dd7c887e0dd68e15e6bc1086cae7ad8ff036cdafa76 WatchSource:0}: Error finding container e2d5dae101ff7cb8be863dd7c887e0dd68e15e6bc1086cae7ad8ff036cdafa76: Status 404 returned error can't find the container with id e2d5dae101ff7cb8be863dd7c887e0dd68e15e6bc1086cae7ad8ff036cdafa76 Jun 05 03:24:35.010303 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:35.010278 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544668dffc-sfdnm" event={"ID":"3d652103-a8e7-477a-94df-4bcf68954557","Type":"ContainerStarted","Data":"5ba08b21378374d9ef797b50fded15f360e5b102e1a1ba7424f2e51a37ff8fea"} Jun 05 03:24:35.010418 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:35.010333 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544668dffc-sfdnm" event={"ID":"3d652103-a8e7-477a-94df-4bcf68954557","Type":"ContainerStarted","Data":"e2d5dae101ff7cb8be863dd7c887e0dd68e15e6bc1086cae7ad8ff036cdafa76"} Jun 05 03:24:35.030467 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:35.030423 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544668dffc-sfdnm" podStartSLOduration=1.030408559 podStartE2EDuration="1.030408559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:24:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:24:35.027970335 +0000 UTC m=+364.198480461" watchObservedRunningTime="2026-06-05 03:24:35.030408559 +0000 UTC m=+364.200918660" Jun 05 03:24:38.799222 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:38.799190 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj"] Jun 05 03:24:38.804988 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:38.804968 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" Jun 05 03:24:38.808171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:38.808151 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 03:24:38.808285 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:38.808269 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nfdx6\"" Jun 05 03:24:38.815857 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:38.815836 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj"] Jun 05 03:24:38.892411 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:38.892377 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frzb2\" (UniqueName: \"kubernetes.io/projected/5a779663-70fd-4b67-863c-ae365c39e780-kube-api-access-frzb2\") pod \"dns-operator-controller-manager-864dd78c4c-mxljj\" (UID: \"5a779663-70fd-4b67-863c-ae365c39e780\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" Jun 05 03:24:38.993448 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:38.993411 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frzb2\" (UniqueName: \"kubernetes.io/projected/5a779663-70fd-4b67-863c-ae365c39e780-kube-api-access-frzb2\") pod \"dns-operator-controller-manager-864dd78c4c-mxljj\" (UID: \"5a779663-70fd-4b67-863c-ae365c39e780\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" Jun 05 03:24:39.006669 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:39.006645 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frzb2\" (UniqueName: \"kubernetes.io/projected/5a779663-70fd-4b67-863c-ae365c39e780-kube-api-access-frzb2\") pod \"dns-operator-controller-manager-864dd78c4c-mxljj\" (UID: \"5a779663-70fd-4b67-863c-ae365c39e780\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" Jun 05 03:24:39.116250 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:39.116195 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" Jun 05 03:24:39.251632 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:39.251605 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj"] Jun 05 03:24:39.252744 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:39.252715 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a779663_70fd_4b67_863c_ae365c39e780.slice/crio-31badbaa1bc9ea15e8f8a772b6b0b1798fc8ba65dbb08f5969e6b23af80a40c6 WatchSource:0}: Error finding container 31badbaa1bc9ea15e8f8a772b6b0b1798fc8ba65dbb08f5969e6b23af80a40c6: Status 404 returned error can't find the container with id 31badbaa1bc9ea15e8f8a772b6b0b1798fc8ba65dbb08f5969e6b23af80a40c6 Jun 05 03:24:40.040092 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:40.040060 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" event={"ID":"5a779663-70fd-4b67-863c-ae365c39e780","Type":"ContainerStarted","Data":"31badbaa1bc9ea15e8f8a772b6b0b1798fc8ba65dbb08f5969e6b23af80a40c6"} Jun 05 03:24:42.053405 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:42.053361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" event={"ID":"5a779663-70fd-4b67-863c-ae365c39e780","Type":"ContainerStarted","Data":"80626768a92ed329cf098ef4334d37507a539614dc7652a3eac6746018801868"} Jun 05 03:24:42.053863 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:42.053426 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" Jun 05 03:24:42.069514 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:42.069445 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" podStartSLOduration=2.062492089 podStartE2EDuration="4.069427258s" totalImagesPullingTime="2.006935169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:24:42.068483007 +0000 UTC m=+371.238993122" watchObservedRunningTime="2026-06-05 03:24:42.069427258 +0000 UTC m=+371.239937361" Jun 05 03:24:43.640934 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.640897 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb"] Jun 05 03:24:43.644387 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.644364 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:43.646778 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.646759 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h2smm\"" Jun 05 03:24:43.655844 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.655823 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb"] Jun 05 03:24:43.729385 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.729358 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a9d3e2-87e8-4098-895a-9852e15e09f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:43.729474 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.729431 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrpw5\" (UniqueName: \"kubernetes.io/projected/68a9d3e2-87e8-4098-895a-9852e15e09f9-kube-api-access-nrpw5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:43.830021 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.829996 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrpw5\" (UniqueName: \"kubernetes.io/projected/68a9d3e2-87e8-4098-895a-9852e15e09f9-kube-api-access-nrpw5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:43.830113 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.830034 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a9d3e2-87e8-4098-895a-9852e15e09f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:43.830368 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.830353 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a9d3e2-87e8-4098-895a-9852e15e09f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:43.840703 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.840680 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrpw5\" (UniqueName: \"kubernetes.io/projected/68a9d3e2-87e8-4098-895a-9852e15e09f9-kube-api-access-nrpw5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:43.954546 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:43.954491 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:44.104111 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:44.104087 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb"] Jun 05 03:24:44.105681 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:44.105661 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a9d3e2_87e8_4098_895a_9852e15e09f9.slice/crio-a2ba2a92422a08b2f815633d2831ddee55fec5982108ba435aae637302794ba3 WatchSource:0}: Error finding container a2ba2a92422a08b2f815633d2831ddee55fec5982108ba435aae637302794ba3: Status 404 returned error can't find the container with id a2ba2a92422a08b2f815633d2831ddee55fec5982108ba435aae637302794ba3 Jun 05 03:24:44.795496 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:44.795464 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:44.795910 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:44.795537 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:44.801098 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:44.801077 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:45.072986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:45.072956 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" event={"ID":"68a9d3e2-87e8-4098-895a-9852e15e09f9","Type":"ContainerStarted","Data":"a2ba2a92422a08b2f815633d2831ddee55fec5982108ba435aae637302794ba3"} Jun 05 03:24:45.076963 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:45.076940 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544668dffc-sfdnm" Jun 05 03:24:45.132605 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:45.132575 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6748fff7-j2tg8"] Jun 05 03:24:46.855838 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:46.855811 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh"] Jun 05 03:24:46.859834 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:46.859814 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:24:46.862108 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:46.862087 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rjfks\"" Jun 05 03:24:46.870555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:46.870505 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh"] Jun 05 03:24:46.958546 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:46.958516 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hnsm\" (UniqueName: \"kubernetes.io/projected/79fefe09-9669-4742-a4a9-d624899b94b0-kube-api-access-6hnsm\") pod \"limitador-operator-controller-manager-859d7b78bd-8lssh\" (UID: \"79fefe09-9669-4742-a4a9-d624899b94b0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:24:47.059725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:47.059695 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hnsm\" (UniqueName: \"kubernetes.io/projected/79fefe09-9669-4742-a4a9-d624899b94b0-kube-api-access-6hnsm\") pod \"limitador-operator-controller-manager-859d7b78bd-8lssh\" (UID: \"79fefe09-9669-4742-a4a9-d624899b94b0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:24:47.071218 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:47.071193 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hnsm\" (UniqueName: \"kubernetes.io/projected/79fefe09-9669-4742-a4a9-d624899b94b0-kube-api-access-6hnsm\") pod \"limitador-operator-controller-manager-859d7b78bd-8lssh\" (UID: \"79fefe09-9669-4742-a4a9-d624899b94b0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:24:47.174056 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:47.173987 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:24:47.315007 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:47.314977 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh"] Jun 05 03:24:47.316710 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:24:47.316681 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fefe09_9669_4742_a4a9_d624899b94b0.slice/crio-545ebf90f43b19105605de8ed11074bbbecd56617e82f375de6243404b9a310e WatchSource:0}: Error finding container 545ebf90f43b19105605de8ed11074bbbecd56617e82f375de6243404b9a310e: Status 404 returned error can't find the container with id 545ebf90f43b19105605de8ed11074bbbecd56617e82f375de6243404b9a310e Jun 05 03:24:48.092190 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:48.092156 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" event={"ID":"79fefe09-9669-4742-a4a9-d624899b94b0","Type":"ContainerStarted","Data":"545ebf90f43b19105605de8ed11074bbbecd56617e82f375de6243404b9a310e"} Jun 05 03:24:49.101388 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:49.101305 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" event={"ID":"68a9d3e2-87e8-4098-895a-9852e15e09f9","Type":"ContainerStarted","Data":"a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a"} Jun 05 03:24:49.118785 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:49.118679 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" podStartSLOduration=1.366583843 podStartE2EDuration="6.118659674s" totalImagesPullingTime="4.752075831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:24:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:24:49.118382436 +0000 UTC m=+378.288892538" watchObservedRunningTime="2026-06-05 03:24:49.118659674 +0000 UTC m=+378.289169775" Jun 05 03:24:50.108129 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:50.108048 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" event={"ID":"79fefe09-9669-4742-a4a9-d624899b94b0","Type":"ContainerStarted","Data":"c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d"} Jun 05 03:24:50.108506 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:50.108184 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:24:50.108506 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:50.108380 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:24:50.129459 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:50.129413 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" podStartSLOduration=1.6138211070000001 podStartE2EDuration="4.129400179s" totalImagesPullingTime="2.515579072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:24:50.128215501 +0000 UTC m=+379.298725603" watchObservedRunningTime="2026-06-05 03:24:50.129400179 +0000 UTC m=+379.299910281" Jun 05 03:24:53.061493 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:24:53.061464 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mxljj" Jun 05 03:25:01.114995 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:01.114967 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:01.115380 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:01.115113 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:02.342707 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.342676 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn"] Jun 05 03:25:02.347620 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.347605 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.362849 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.362825 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn"] Jun 05 03:25:02.491930 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.491893 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb3def8e-b9e1-4621-9048-8aaaa13125f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.491930 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.491932 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbrnh\" (UniqueName: \"kubernetes.io/projected/bb3def8e-b9e1-4621-9048-8aaaa13125f8-kube-api-access-cbrnh\") pod \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.592387 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.592347 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb3def8e-b9e1-4621-9048-8aaaa13125f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.592588 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.592405 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbrnh\" (UniqueName: \"kubernetes.io/projected/bb3def8e-b9e1-4621-9048-8aaaa13125f8-kube-api-access-cbrnh\") pod \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.592843 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.592778 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb3def8e-b9e1-4621-9048-8aaaa13125f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.604673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.604652 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbrnh\" (UniqueName: \"kubernetes.io/projected/bb3def8e-b9e1-4621-9048-8aaaa13125f8-kube-api-access-cbrnh\") pod \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.657743 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.657719 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.786834 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.786806 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn"] Jun 05 03:25:02.795192 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.795165 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn"] Jun 05 03:25:02.809850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.809823 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg"] Jun 05 03:25:02.814672 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.814653 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:02.826245 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.826222 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg"] Jun 05 03:25:02.834579 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.834557 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb"] Jun 05 03:25:02.834755 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.834718 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" containerName="manager" containerID="cri-o://a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a" gracePeriod=2 Jun 05 03:25:02.844055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.843982 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb"] Jun 05 03:25:02.853487 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.853258 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh"] Jun 05 03:25:02.853606 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.853490 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" containerName="manager" containerID="cri-o://c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d" gracePeriod=2 Jun 05 03:25:02.855520 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:02.855488 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:02.865019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.864999 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh"] Jun 05 03:25:02.882284 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.882259 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw"] Jun 05 03:25:02.882686 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.882670 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" containerName="manager" Jun 05 03:25:02.882765 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.882689 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" containerName="manager" Jun 05 03:25:02.882765 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.882715 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" containerName="manager" Jun 05 03:25:02.882765 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.882724 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" containerName="manager" Jun 05 03:25:02.882916 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.882818 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" containerName="manager" Jun 05 03:25:02.882916 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.882829 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" containerName="manager" Jun 05 03:25:02.886628 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.886609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" Jun 05 03:25:02.888715 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:02.888691 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:02.894975 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.894952 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m5qh\" (UniqueName: \"kubernetes.io/projected/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-kube-api-access-4m5qh\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjmzg\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:02.895116 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.895091 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjmzg\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:02.900198 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.900122 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw"] Jun 05 03:25:02.917905 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:02.917867 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lssh\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:02.947952 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:02.947924 2552 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 05 03:25:02.947952 ip-10-0-141-163 kubenswrapper[2552]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-lmgkn_kuadrant-system_bb3def8e-b9e1-4621-9048-8aaaa13125f8_0(c1664e1a9682abd12d1d4f04292d3dad4ff19cc5660e55d633d37736b610df28): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-lmgkn to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c1664e1a9682abd12d1d4f04292d3dad4ff19cc5660e55d633d37736b610df28" Netns:"/var/run/netns/33a68bc6-a015-436d-8b10-153ade259c40" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-lmgkn;K8S_POD_INFRA_CONTAINER_ID=c1664e1a9682abd12d1d4f04292d3dad4ff19cc5660e55d633d37736b610df28;K8S_POD_UID=bb3def8e-b9e1-4621-9048-8aaaa13125f8" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn/bb3def8e-b9e1-4621-9048-8aaaa13125f8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-lmgkn in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-lmgkn in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-lmgkn" not found Jun 05 03:25:02.947952 ip-10-0-141-163 kubenswrapper[2552]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 05 03:25:02.947952 ip-10-0-141-163 kubenswrapper[2552]: > Jun 05 03:25:02.948100 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:02.947993 2552 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 05 03:25:02.948100 ip-10-0-141-163 kubenswrapper[2552]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-lmgkn_kuadrant-system_bb3def8e-b9e1-4621-9048-8aaaa13125f8_0(c1664e1a9682abd12d1d4f04292d3dad4ff19cc5660e55d633d37736b610df28): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-lmgkn to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"c1664e1a9682abd12d1d4f04292d3dad4ff19cc5660e55d633d37736b610df28" Netns:"/var/run/netns/33a68bc6-a015-436d-8b10-153ade259c40" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-lmgkn;K8S_POD_INFRA_CONTAINER_ID=c1664e1a9682abd12d1d4f04292d3dad4ff19cc5660e55d633d37736b610df28;K8S_POD_UID=bb3def8e-b9e1-4621-9048-8aaaa13125f8" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn/bb3def8e-b9e1-4621-9048-8aaaa13125f8]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-lmgkn in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-lmgkn in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-lmgkn" not found Jun 05 03:25:02.948100 ip-10-0-141-163 kubenswrapper[2552]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 05 03:25:02.948100 ip-10-0-141-163 kubenswrapper[2552]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:02.996491 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.996457 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjmzg\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:02.996651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.996525 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbx4t\" (UniqueName: \"kubernetes.io/projected/9bc84a97-fa92-42b3-80ff-bc9d5e908a4f-kube-api-access-nbx4t\") pod \"limitador-operator-controller-manager-859d7b78bd-fz2vw\" (UID: \"9bc84a97-fa92-42b3-80ff-bc9d5e908a4f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" Jun 05 03:25:02.996651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.996569 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m5qh\" (UniqueName: \"kubernetes.io/projected/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-kube-api-access-4m5qh\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjmzg\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:02.996935 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:02.996912 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjmzg\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:03.015889 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.015854 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m5qh\" (UniqueName: \"kubernetes.io/projected/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-kube-api-access-4m5qh\") pod \"kuadrant-operator-controller-manager-55467d9f7-xjmzg\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:03.077291 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.077266 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:03.079874 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.079844 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:03.081927 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.081902 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lssh\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:03.084415 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.084398 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:03.086712 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.086688 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lssh\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:03.088958 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.088929 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:03.097406 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.097363 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbx4t\" (UniqueName: \"kubernetes.io/projected/9bc84a97-fa92-42b3-80ff-bc9d5e908a4f-kube-api-access-nbx4t\") pod \"limitador-operator-controller-manager-859d7b78bd-fz2vw\" (UID: \"9bc84a97-fa92-42b3-80ff-bc9d5e908a4f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" Jun 05 03:25:03.113604 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.113582 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbx4t\" (UniqueName: \"kubernetes.io/projected/9bc84a97-fa92-42b3-80ff-bc9d5e908a4f-kube-api-access-nbx4t\") pod \"limitador-operator-controller-manager-859d7b78bd-fz2vw\" (UID: \"9bc84a97-fa92-42b3-80ff-bc9d5e908a4f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" Jun 05 03:25:03.129487 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.129472 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:03.190987 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.190955 2552 generic.go:356] "Generic (PLEG): container finished" podID="79fefe09-9669-4742-a4a9-d624899b94b0" containerID="c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d" exitCode=0 Jun 05 03:25:03.191122 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.190996 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:03.191122 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.191049 2552 scope.go:117] "RemoveContainer" containerID="c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d" Jun 05 03:25:03.193634 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.193592 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:03.195383 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.194865 2552 generic.go:356] "Generic (PLEG): container finished" podID="68a9d3e2-87e8-4098-895a-9852e15e09f9" containerID="a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a" exitCode=0 Jun 05 03:25:03.195383 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.194947 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:03.195383 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.195291 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:03.196083 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.195916 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lssh\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:03.197633 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.197584 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="bb3def8e-b9e1-4621-9048-8aaaa13125f8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:03.197747 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.197726 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hnsm\" (UniqueName: \"kubernetes.io/projected/79fefe09-9669-4742-a4a9-d624899b94b0-kube-api-access-6hnsm\") pod \"79fefe09-9669-4742-a4a9-d624899b94b0\" (UID: \"79fefe09-9669-4742-a4a9-d624899b94b0\") " Jun 05 03:25:03.197839 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.197820 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a9d3e2-87e8-4098-895a-9852e15e09f9-extensions-socket-volume\") pod \"68a9d3e2-87e8-4098-895a-9852e15e09f9\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " Jun 05 03:25:03.197932 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.197854 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrpw5\" (UniqueName: \"kubernetes.io/projected/68a9d3e2-87e8-4098-895a-9852e15e09f9-kube-api-access-nrpw5\") pod \"68a9d3e2-87e8-4098-895a-9852e15e09f9\" (UID: \"68a9d3e2-87e8-4098-895a-9852e15e09f9\") " Jun 05 03:25:03.198432 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.198407 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68a9d3e2-87e8-4098-895a-9852e15e09f9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "68a9d3e2-87e8-4098-895a-9852e15e09f9" (UID: "68a9d3e2-87e8-4098-895a-9852e15e09f9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:25:03.199203 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.199176 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:03.199871 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.199846 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79fefe09-9669-4742-a4a9-d624899b94b0-kube-api-access-6hnsm" (OuterVolumeSpecName: "kube-api-access-6hnsm") pod "79fefe09-9669-4742-a4a9-d624899b94b0" (UID: "79fefe09-9669-4742-a4a9-d624899b94b0"). InnerVolumeSpecName "kube-api-access-6hnsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:25:03.200001 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.199980 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a9d3e2-87e8-4098-895a-9852e15e09f9-kube-api-access-nrpw5" (OuterVolumeSpecName: "kube-api-access-nrpw5") pod "68a9d3e2-87e8-4098-895a-9852e15e09f9" (UID: "68a9d3e2-87e8-4098-895a-9852e15e09f9"). InnerVolumeSpecName "kube-api-access-nrpw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:25:03.200676 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.200642 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lssh\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:03.204214 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.204195 2552 scope.go:117] "RemoveContainer" containerID="c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d" Jun 05 03:25:03.204470 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.204446 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d\": container with ID starting with c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d not found: ID does not exist" containerID="c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d" Jun 05 03:25:03.204568 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.204477 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d"} err="failed to get container status \"c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d\": rpc error: code = NotFound desc = could not find container \"c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d\": container with ID starting with c4c7c2b0f11c409c06e1370fdd9f6af1d9c6069e1472baaa855155ea9c96a99d not found: ID does not exist" Jun 05 03:25:03.204568 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.204496 2552 scope.go:117] "RemoveContainer" containerID="a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a" Jun 05 03:25:03.205218 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.205195 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:03.207227 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.207192 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-45tfb\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-45tfb" Jun 05 03:25:03.208699 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.208678 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8lssh\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8lssh" Jun 05 03:25:03.210235 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.210215 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="bb3def8e-b9e1-4621-9048-8aaaa13125f8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:03.213289 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.213267 2552 scope.go:117] "RemoveContainer" containerID="a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a" Jun 05 03:25:03.213620 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:03.213578 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a\": container with ID starting with a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a not found: ID does not exist" containerID="a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a" Jun 05 03:25:03.213708 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.213613 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a"} err="failed to get container status \"a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a\": rpc error: code = NotFound desc = could not find container \"a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a\": container with ID starting with a8b263152ed4238acd286c4a3f7a69c6d0733f8d402afbec5c4264858935a08a not found: ID does not exist" Jun 05 03:25:03.268723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.268694 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg"] Jun 05 03:25:03.270475 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:25:03.270452 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ea1dcb_0b86_4bb0_bfbe_317c098f7a07.slice/crio-187de867b7913452ac515f39006bb59cf52faed416e339f85db771a74c78ea86 WatchSource:0}: Error finding container 187de867b7913452ac515f39006bb59cf52faed416e339f85db771a74c78ea86: Status 404 returned error can't find the container with id 187de867b7913452ac515f39006bb59cf52faed416e339f85db771a74c78ea86 Jun 05 03:25:03.279427 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.279404 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" Jun 05 03:25:03.291919 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.291890 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a9d3e2-87e8-4098-895a-9852e15e09f9" path="/var/lib/kubelet/pods/68a9d3e2-87e8-4098-895a-9852e15e09f9/volumes" Jun 05 03:25:03.292375 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.292351 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79fefe09-9669-4742-a4a9-d624899b94b0" path="/var/lib/kubelet/pods/79fefe09-9669-4742-a4a9-d624899b94b0/volumes" Jun 05 03:25:03.298326 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.298295 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb3def8e-b9e1-4621-9048-8aaaa13125f8-extensions-socket-volume\") pod \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " Jun 05 03:25:03.298440 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.298345 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbrnh\" (UniqueName: \"kubernetes.io/projected/bb3def8e-b9e1-4621-9048-8aaaa13125f8-kube-api-access-cbrnh\") pod \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\" (UID: \"bb3def8e-b9e1-4621-9048-8aaaa13125f8\") " Jun 05 03:25:03.298548 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.298523 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb3def8e-b9e1-4621-9048-8aaaa13125f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bb3def8e-b9e1-4621-9048-8aaaa13125f8" (UID: "bb3def8e-b9e1-4621-9048-8aaaa13125f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:25:03.298604 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.298583 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hnsm\" (UniqueName: \"kubernetes.io/projected/79fefe09-9669-4742-a4a9-d624899b94b0-kube-api-access-6hnsm\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:03.298651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.298602 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68a9d3e2-87e8-4098-895a-9852e15e09f9-extensions-socket-volume\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:03.298651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.298616 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrpw5\" (UniqueName: \"kubernetes.io/projected/68a9d3e2-87e8-4098-895a-9852e15e09f9-kube-api-access-nrpw5\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:03.300282 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.300251 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb3def8e-b9e1-4621-9048-8aaaa13125f8-kube-api-access-cbrnh" (OuterVolumeSpecName: "kube-api-access-cbrnh") pod "bb3def8e-b9e1-4621-9048-8aaaa13125f8" (UID: "bb3def8e-b9e1-4621-9048-8aaaa13125f8"). InnerVolumeSpecName "kube-api-access-cbrnh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:25:03.399022 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.398996 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb3def8e-b9e1-4621-9048-8aaaa13125f8-extensions-socket-volume\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:03.399022 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.399021 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbrnh\" (UniqueName: \"kubernetes.io/projected/bb3def8e-b9e1-4621-9048-8aaaa13125f8-kube-api-access-cbrnh\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:03.417585 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:03.417560 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw"] Jun 05 03:25:03.419418 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:25:03.419383 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bc84a97_fa92_42b3_80ff_bc9d5e908a4f.slice/crio-d9f51622a425a11a1712fb1825dab572b3119a391a1464ad572b4e83917032e8 WatchSource:0}: Error finding container d9f51622a425a11a1712fb1825dab572b3119a391a1464ad572b4e83917032e8: Status 404 returned error can't find the container with id d9f51622a425a11a1712fb1825dab572b3119a391a1464ad572b4e83917032e8 Jun 05 03:25:04.202058 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.202022 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" event={"ID":"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07","Type":"ContainerStarted","Data":"c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18"} Jun 05 03:25:04.202222 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.202078 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" event={"ID":"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07","Type":"ContainerStarted","Data":"187de867b7913452ac515f39006bb59cf52faed416e339f85db771a74c78ea86"} Jun 05 03:25:04.202222 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.202136 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:04.204411 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.204386 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" event={"ID":"9bc84a97-fa92-42b3-80ff-bc9d5e908a4f","Type":"ContainerStarted","Data":"ca2b58167a96153fb6d14712d665a1273f4e5a1882cfefd5c74dff8296096349"} Jun 05 03:25:04.204552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.204437 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" Jun 05 03:25:04.204552 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.204458 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" event={"ID":"9bc84a97-fa92-42b3-80ff-bc9d5e908a4f","Type":"ContainerStarted","Data":"d9f51622a425a11a1712fb1825dab572b3119a391a1464ad572b4e83917032e8"} Jun 05 03:25:04.211002 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.210981 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:04.226755 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:04.226698 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-lmgkn\" is forbidden: User \"system:node:ip-10-0-141-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-163.ec2.internal' and this object" podUID="bb3def8e-b9e1-4621-9048-8aaaa13125f8" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-lmgkn" Jun 05 03:25:04.226885 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.226839 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" podStartSLOduration=2.226827081 podStartE2EDuration="2.226827081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:25:04.22510662 +0000 UTC m=+393.395616720" watchObservedRunningTime="2026-06-05 03:25:04.226827081 +0000 UTC m=+393.397337181" Jun 05 03:25:04.245876 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:04.245746 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" podStartSLOduration=2.245731656 podStartE2EDuration="2.245731656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:25:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:25:04.245429341 +0000 UTC m=+393.415939453" watchObservedRunningTime="2026-06-05 03:25:04.245731656 +0000 UTC m=+393.416241759" Jun 05 03:25:05.292368 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:05.292310 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb3def8e-b9e1-4621-9048-8aaaa13125f8" path="/var/lib/kubelet/pods/bb3def8e-b9e1-4621-9048-8aaaa13125f8/volumes" Jun 05 03:25:10.159140 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.159101 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b6748fff7-j2tg8" podUID="d39e86a2-b8f3-47ab-acc8-93591e5fc95f" containerName="console" containerID="cri-o://00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af" gracePeriod=15 Jun 05 03:25:10.406846 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.406822 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:25:10.560029 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560007 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-service-ca\") pod \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " Jun 05 03:25:10.560184 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560040 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-config\") pod \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " Jun 05 03:25:10.560184 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560065 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-oauth-serving-cert\") pod \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " Jun 05 03:25:10.560184 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560083 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-trusted-ca-bundle\") pod \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " Jun 05 03:25:10.560184 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560150 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnzck\" (UniqueName: \"kubernetes.io/projected/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-kube-api-access-xnzck\") pod \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " Jun 05 03:25:10.560416 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560203 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-serving-cert\") pod \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " Jun 05 03:25:10.560416 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560227 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-oauth-config\") pod \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\" (UID: \"d39e86a2-b8f3-47ab-acc8-93591e5fc95f\") " Jun 05 03:25:10.560529 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560409 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-service-ca" (OuterVolumeSpecName: "service-ca") pod "d39e86a2-b8f3-47ab-acc8-93591e5fc95f" (UID: "d39e86a2-b8f3-47ab-acc8-93591e5fc95f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:25:10.560529 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560486 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-config" (OuterVolumeSpecName: "console-config") pod "d39e86a2-b8f3-47ab-acc8-93591e5fc95f" (UID: "d39e86a2-b8f3-47ab-acc8-93591e5fc95f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:25:10.560529 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560502 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-service-ca\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:10.560529 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560500 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d39e86a2-b8f3-47ab-acc8-93591e5fc95f" (UID: "d39e86a2-b8f3-47ab-acc8-93591e5fc95f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:25:10.560795 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.560769 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d39e86a2-b8f3-47ab-acc8-93591e5fc95f" (UID: "d39e86a2-b8f3-47ab-acc8-93591e5fc95f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:25:10.562435 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.562399 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d39e86a2-b8f3-47ab-acc8-93591e5fc95f" (UID: "d39e86a2-b8f3-47ab-acc8-93591e5fc95f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:25:10.562435 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.562421 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d39e86a2-b8f3-47ab-acc8-93591e5fc95f" (UID: "d39e86a2-b8f3-47ab-acc8-93591e5fc95f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:25:10.562563 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.562481 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-kube-api-access-xnzck" (OuterVolumeSpecName: "kube-api-access-xnzck") pod "d39e86a2-b8f3-47ab-acc8-93591e5fc95f" (UID: "d39e86a2-b8f3-47ab-acc8-93591e5fc95f"). InnerVolumeSpecName "kube-api-access-xnzck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:25:10.661462 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.661430 2552 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:10.661462 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.661456 2552 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-oauth-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:10.661634 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.661470 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-trusted-ca-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:10.661634 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.661483 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnzck\" (UniqueName: \"kubernetes.io/projected/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-kube-api-access-xnzck\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:10.661634 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.661495 2552 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-serving-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:10.661634 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:10.661506 2552 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d39e86a2-b8f3-47ab-acc8-93591e5fc95f-console-oauth-config\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:11.251676 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.251641 2552 generic.go:356] "Generic (PLEG): container finished" podID="d39e86a2-b8f3-47ab-acc8-93591e5fc95f" containerID="00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af" exitCode=0 Jun 05 03:25:11.252050 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.251687 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b6748fff7-j2tg8" Jun 05 03:25:11.252050 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.251712 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6748fff7-j2tg8" event={"ID":"d39e86a2-b8f3-47ab-acc8-93591e5fc95f","Type":"ContainerDied","Data":"00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af"} Jun 05 03:25:11.252050 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.251791 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b6748fff7-j2tg8" event={"ID":"d39e86a2-b8f3-47ab-acc8-93591e5fc95f","Type":"ContainerDied","Data":"9356b32e7fd13ab8ab9a4feb1ba83a04e4ce78e34f39fe9a9834076f6375d7e9"} Jun 05 03:25:11.252050 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.251817 2552 scope.go:117] "RemoveContainer" containerID="00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af" Jun 05 03:25:11.261634 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.261618 2552 scope.go:117] "RemoveContainer" containerID="00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af" Jun 05 03:25:11.261907 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:11.261888 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af\": container with ID starting with 00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af not found: ID does not exist" containerID="00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af" Jun 05 03:25:11.261942 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.261916 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af"} err="failed to get container status \"00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af\": rpc error: code = NotFound desc = could not find container \"00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af\": container with ID starting with 00f05255bbc559cecbbb986161f3851ce695d18518d6e8227ac0a85bf96e30af not found: ID does not exist" Jun 05 03:25:11.273610 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.273587 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b6748fff7-j2tg8"] Jun 05 03:25:11.276970 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.276949 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b6748fff7-j2tg8"] Jun 05 03:25:11.291422 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:11.291401 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d39e86a2-b8f3-47ab-acc8-93591e5fc95f" path="/var/lib/kubelet/pods/d39e86a2-b8f3-47ab-acc8-93591e5fc95f/volumes" Jun 05 03:25:15.218794 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.218762 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:15.219156 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.218830 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fz2vw" Jun 05 03:25:15.523821 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.523744 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v"] Jun 05 03:25:15.524125 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.524109 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d39e86a2-b8f3-47ab-acc8-93591e5fc95f" containerName="console" Jun 05 03:25:15.524168 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.524128 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d39e86a2-b8f3-47ab-acc8-93591e5fc95f" containerName="console" Jun 05 03:25:15.524203 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.524179 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d39e86a2-b8f3-47ab-acc8-93591e5fc95f" containerName="console" Jun 05 03:25:15.530648 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.530628 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.544829 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.544808 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v"] Jun 05 03:25:15.697434 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.697403 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w77dg\" (UniqueName: \"kubernetes.io/projected/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-kube-api-access-w77dg\") pod \"kuadrant-operator-controller-manager-86878c769f-5fs8v\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.697584 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.697483 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5fs8v\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.798121 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.798093 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77dg\" (UniqueName: \"kubernetes.io/projected/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-kube-api-access-w77dg\") pod \"kuadrant-operator-controller-manager-86878c769f-5fs8v\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.798263 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.798156 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5fs8v\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.798571 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.798553 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5fs8v\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.808017 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.807984 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w77dg\" (UniqueName: \"kubernetes.io/projected/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-kube-api-access-w77dg\") pod \"kuadrant-operator-controller-manager-86878c769f-5fs8v\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.840996 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.840974 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:15.971338 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:15.971300 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v"] Jun 05 03:25:15.973499 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:25:15.973468 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a75cf6_80c9_49cd_bc20_411ae35f20a0.slice/crio-7ac5c435fa5969e91d4abdd1df60a09b86d23b97c26c90e421a6500d721a3e0d WatchSource:0}: Error finding container 7ac5c435fa5969e91d4abdd1df60a09b86d23b97c26c90e421a6500d721a3e0d: Status 404 returned error can't find the container with id 7ac5c435fa5969e91d4abdd1df60a09b86d23b97c26c90e421a6500d721a3e0d Jun 05 03:25:16.280448 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:16.280364 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" event={"ID":"a2a75cf6-80c9-49cd-bc20-411ae35f20a0","Type":"ContainerStarted","Data":"41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb"} Jun 05 03:25:16.280448 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:16.280414 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" event={"ID":"a2a75cf6-80c9-49cd-bc20-411ae35f20a0","Type":"ContainerStarted","Data":"7ac5c435fa5969e91d4abdd1df60a09b86d23b97c26c90e421a6500d721a3e0d"} Jun 05 03:25:16.280448 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:16.280444 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:16.301391 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:16.301347 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" podStartSLOduration=1.301330523 podStartE2EDuration="1.301330523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:25:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:25:16.299741463 +0000 UTC m=+405.470251564" watchObservedRunningTime="2026-06-05 03:25:16.301330523 +0000 UTC m=+405.471840614" Jun 05 03:25:27.291690 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.291655 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:25:27.340516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.340487 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg"] Jun 05 03:25:27.340740 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.340714 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" podUID="b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" containerName="manager" containerID="cri-o://c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18" gracePeriod=10 Jun 05 03:25:27.583654 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.583634 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:27.689088 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.689064 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-extensions-socket-volume\") pod \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " Jun 05 03:25:27.689218 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.689125 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m5qh\" (UniqueName: \"kubernetes.io/projected/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-kube-api-access-4m5qh\") pod \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\" (UID: \"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07\") " Jun 05 03:25:27.689458 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.689434 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" (UID: "b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:25:27.691023 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.691003 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-kube-api-access-4m5qh" (OuterVolumeSpecName: "kube-api-access-4m5qh") pod "b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" (UID: "b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07"). InnerVolumeSpecName "kube-api-access-4m5qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:25:27.790294 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.790270 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-extensions-socket-volume\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:27.790294 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:27.790291 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m5qh\" (UniqueName: \"kubernetes.io/projected/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07-kube-api-access-4m5qh\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:28.354661 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.354625 2552 generic.go:356] "Generic (PLEG): container finished" podID="b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" containerID="c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18" exitCode=0 Jun 05 03:25:28.355021 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.354665 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" Jun 05 03:25:28.355021 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.354711 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" event={"ID":"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07","Type":"ContainerDied","Data":"c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18"} Jun 05 03:25:28.355021 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.354760 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg" event={"ID":"b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07","Type":"ContainerDied","Data":"187de867b7913452ac515f39006bb59cf52faed416e339f85db771a74c78ea86"} Jun 05 03:25:28.355021 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.354782 2552 scope.go:117] "RemoveContainer" containerID="c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18" Jun 05 03:25:28.364358 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.364340 2552 scope.go:117] "RemoveContainer" containerID="c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18" Jun 05 03:25:28.364610 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:28.364591 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18\": container with ID starting with c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18 not found: ID does not exist" containerID="c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18" Jun 05 03:25:28.364651 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.364618 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18"} err="failed to get container status \"c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18\": rpc error: code = NotFound desc = could not find container \"c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18\": container with ID starting with c4b071a47cc0d196b7e8751ce64ed6c358e7cc392af9cc3b499f956e6f24fa18 not found: ID does not exist" Jun 05 03:25:28.386212 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.386190 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg"] Jun 05 03:25:28.393632 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:28.393611 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-xjmzg"] Jun 05 03:25:29.292184 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:29.292148 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" path="/var/lib/kubelet/pods/b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07/volumes" Jun 05 03:25:31.480377 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.480348 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297"] Jun 05 03:25:31.480906 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.480887 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" containerName="manager" Jun 05 03:25:31.480987 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.480909 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" containerName="manager" Jun 05 03:25:31.481039 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.480995 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2ea1dcb-0b86-4bb0-bfbe-317c098f7a07" containerName="manager" Jun 05 03:25:31.484095 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.484068 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.486658 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.486626 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vx8hn\"" Jun 05 03:25:31.497270 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.497248 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297"] Jun 05 03:25:31.518645 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518590 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.518645 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518617 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082c3638-d9de-426c-aefc-78e7ce4c2500-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.518784 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.518784 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518697 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.518784 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518731 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.518938 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ndz\" (UniqueName: \"kubernetes.io/projected/082c3638-d9de-426c-aefc-78e7ce4c2500-kube-api-access-v2ndz\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.518938 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518875 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.518938 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518911 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.519045 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.518938 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619550 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619521 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619558 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619585 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ndz\" (UniqueName: \"kubernetes.io/projected/082c3638-d9de-426c-aefc-78e7ce4c2500-kube-api-access-v2ndz\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619679 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619713 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619736 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.619828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619798 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082c3638-d9de-426c-aefc-78e7ce4c2500-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.620065 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.619937 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.620124 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.620083 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.620180 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.620115 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.620239 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.620224 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.620541 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.620513 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/082c3638-d9de-426c-aefc-78e7ce4c2500-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.621769 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.621751 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.622043 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.622025 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.630836 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.630815 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/082c3638-d9de-426c-aefc-78e7ce4c2500-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.630989 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.630970 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ndz\" (UniqueName: \"kubernetes.io/projected/082c3638-d9de-426c-aefc-78e7ce4c2500-kube-api-access-v2ndz\") pod \"maas-default-gateway-openshift-default-687ff6996-qp297\" (UID: \"082c3638-d9de-426c-aefc-78e7ce4c2500\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.797728 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.797697 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:31.928423 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.928400 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297"] Jun 05 03:25:31.929702 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:25:31.929674 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod082c3638_d9de_426c_aefc_78e7ce4c2500.slice/crio-cf5792ea5929a2f0d80f2fd62e8c19af6755ef8e1ddd8d97fe38f97aae69b542 WatchSource:0}: Error finding container cf5792ea5929a2f0d80f2fd62e8c19af6755ef8e1ddd8d97fe38f97aae69b542: Status 404 returned error can't find the container with id cf5792ea5929a2f0d80f2fd62e8c19af6755ef8e1ddd8d97fe38f97aae69b542 Jun 05 03:25:31.932774 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.932101 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:25:31.932774 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.932180 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:25:31.932774 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:31.932219 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:25:32.376782 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:32.376747 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" event={"ID":"082c3638-d9de-426c-aefc-78e7ce4c2500","Type":"ContainerStarted","Data":"354ebaf7eb9e25c908c31d77c23a323c870ab848ea7827d3639ac8c01c741697"} Jun 05 03:25:32.376958 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:32.376796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" event={"ID":"082c3638-d9de-426c-aefc-78e7ce4c2500","Type":"ContainerStarted","Data":"cf5792ea5929a2f0d80f2fd62e8c19af6755ef8e1ddd8d97fe38f97aae69b542"} Jun 05 03:25:32.440555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:32.440501 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" podStartSLOduration=1.4404854870000001 podStartE2EDuration="1.440485487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:25:32.438014651 +0000 UTC m=+421.608524756" watchObservedRunningTime="2026-06-05 03:25:32.440485487 +0000 UTC m=+421.610995587" Jun 05 03:25:32.797874 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:32.797845 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:32.802942 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:32.802915 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:33.382494 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:33.382462 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:33.383253 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:33.383236 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:25:48.855157 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:48.855123 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ll7j2"] Jun 05 03:25:48.858210 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:48.858191 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ll7j2" Jun 05 03:25:48.860444 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:48.860425 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8rjtn\"" Jun 05 03:25:48.864390 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:48.864368 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ll7j2"] Jun 05 03:25:48.949033 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:48.949008 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhdww\" (UniqueName: \"kubernetes.io/projected/26409f3a-e093-458f-9b4b-e497bdca9040-kube-api-access-fhdww\") pod \"authorino-58cd955675-ll7j2\" (UID: \"26409f3a-e093-458f-9b4b-e497bdca9040\") " pod="kuadrant-system/authorino-58cd955675-ll7j2" Jun 05 03:25:49.050271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:49.050241 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhdww\" (UniqueName: \"kubernetes.io/projected/26409f3a-e093-458f-9b4b-e497bdca9040-kube-api-access-fhdww\") pod \"authorino-58cd955675-ll7j2\" (UID: \"26409f3a-e093-458f-9b4b-e497bdca9040\") " pod="kuadrant-system/authorino-58cd955675-ll7j2" Jun 05 03:25:49.058004 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:49.057978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhdww\" (UniqueName: \"kubernetes.io/projected/26409f3a-e093-458f-9b4b-e497bdca9040-kube-api-access-fhdww\") pod \"authorino-58cd955675-ll7j2\" (UID: \"26409f3a-e093-458f-9b4b-e497bdca9040\") " pod="kuadrant-system/authorino-58cd955675-ll7j2" Jun 05 03:25:49.169345 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:49.169269 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ll7j2" Jun 05 03:25:49.303904 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:25:49.303873 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26409f3a_e093_458f_9b4b_e497bdca9040.slice/crio-82ebc7b350b18627b1341af0d7f81561ad15f1dbeae5b1508589b4eb80c388fa WatchSource:0}: Error finding container 82ebc7b350b18627b1341af0d7f81561ad15f1dbeae5b1508589b4eb80c388fa: Status 404 returned error can't find the container with id 82ebc7b350b18627b1341af0d7f81561ad15f1dbeae5b1508589b4eb80c388fa Jun 05 03:25:49.304117 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:49.304092 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ll7j2"] Jun 05 03:25:49.465130 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:49.465055 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ll7j2" event={"ID":"26409f3a-e093-458f-9b4b-e497bdca9040","Type":"ContainerStarted","Data":"82ebc7b350b18627b1341af0d7f81561ad15f1dbeae5b1508589b4eb80c388fa"} Jun 05 03:25:53.491337 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:53.491287 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ll7j2" event={"ID":"26409f3a-e093-458f-9b4b-e497bdca9040","Type":"ContainerStarted","Data":"e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf"} Jun 05 03:25:53.504883 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:53.504838 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ll7j2" podStartSLOduration=2.105546854 podStartE2EDuration="5.504822631s" totalImagesPullingTime="3.399275777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:25:53.503424841 +0000 UTC m=+442.673934942" watchObservedRunningTime="2026-06-05 03:25:53.504822631 +0000 UTC m=+442.675332732" Jun 05 03:25:53.887353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:53.887307 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ll7j2"] Jun 05 03:25:55.506159 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:55.506107 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ll7j2" podUID="26409f3a-e093-458f-9b4b-e497bdca9040" containerName="authorino" containerID="cri-o://e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf" gracePeriod=30 Jun 05 03:25:55.741325 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:55.741298 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ll7j2" Jun 05 03:25:55.813300 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:55.813275 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhdww\" (UniqueName: \"kubernetes.io/projected/26409f3a-e093-458f-9b4b-e497bdca9040-kube-api-access-fhdww\") pod \"26409f3a-e093-458f-9b4b-e497bdca9040\" (UID: \"26409f3a-e093-458f-9b4b-e497bdca9040\") " Jun 05 03:25:55.815240 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:55.815213 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26409f3a-e093-458f-9b4b-e497bdca9040-kube-api-access-fhdww" (OuterVolumeSpecName: "kube-api-access-fhdww") pod "26409f3a-e093-458f-9b4b-e497bdca9040" (UID: "26409f3a-e093-458f-9b4b-e497bdca9040"). InnerVolumeSpecName "kube-api-access-fhdww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:25:55.914176 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:55.914135 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhdww\" (UniqueName: \"kubernetes.io/projected/26409f3a-e093-458f-9b4b-e497bdca9040-kube-api-access-fhdww\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:25:56.512607 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.512574 2552 generic.go:356] "Generic (PLEG): container finished" podID="26409f3a-e093-458f-9b4b-e497bdca9040" containerID="e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf" exitCode=0 Jun 05 03:25:56.513019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.512609 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ll7j2" Jun 05 03:25:56.513019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.512651 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ll7j2" event={"ID":"26409f3a-e093-458f-9b4b-e497bdca9040","Type":"ContainerDied","Data":"e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf"} Jun 05 03:25:56.513019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.512688 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ll7j2" event={"ID":"26409f3a-e093-458f-9b4b-e497bdca9040","Type":"ContainerDied","Data":"82ebc7b350b18627b1341af0d7f81561ad15f1dbeae5b1508589b4eb80c388fa"} Jun 05 03:25:56.513019 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.512705 2552 scope.go:117] "RemoveContainer" containerID="e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf" Jun 05 03:25:56.521794 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.521777 2552 scope.go:117] "RemoveContainer" containerID="e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf" Jun 05 03:25:56.522029 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:25:56.522011 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf\": container with ID starting with e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf not found: ID does not exist" containerID="e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf" Jun 05 03:25:56.522097 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.522041 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf"} err="failed to get container status \"e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf\": rpc error: code = NotFound desc = could not find container \"e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf\": container with ID starting with e3270d4a44b6f593145f2da7070082c503639154d90049004d45a696d4a9bdcf not found: ID does not exist" Jun 05 03:25:56.533071 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.533048 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ll7j2"] Jun 05 03:25:56.535762 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:56.535740 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ll7j2"] Jun 05 03:25:57.292305 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:25:57.292265 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26409f3a-e093-458f-9b4b-e497bdca9040" path="/var/lib/kubelet/pods/26409f3a-e093-458f-9b4b-e497bdca9040/volumes" Jun 05 03:26:17.328275 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.328241 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4"] Jun 05 03:26:17.328719 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.328625 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26409f3a-e093-458f-9b4b-e497bdca9040" containerName="authorino" Jun 05 03:26:17.328719 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.328638 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="26409f3a-e093-458f-9b4b-e497bdca9040" containerName="authorino" Jun 05 03:26:17.328719 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.328711 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="26409f3a-e093-458f-9b4b-e497bdca9040" containerName="authorino" Jun 05 03:26:17.333511 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.333492 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.335915 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.335894 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 05 03:26:17.336062 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.335982 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2k9hz\"" Jun 05 03:26:17.336540 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.336513 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 05 03:26:17.342111 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.342092 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4"] Jun 05 03:26:17.477671 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.477649 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.477799 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.477680 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7x7z\" (UniqueName: \"kubernetes.io/projected/d977c32d-ae0b-423c-a7c1-f21915e1e36b-kube-api-access-l7x7z\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.477799 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.477708 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.578807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.578746 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.578807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.578778 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7x7z\" (UniqueName: \"kubernetes.io/projected/d977c32d-ae0b-423c-a7c1-f21915e1e36b-kube-api-access-l7x7z\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.578807 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.578800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.579145 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.579125 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.579185 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.579150 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.594579 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.594553 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7x7z\" (UniqueName: \"kubernetes.io/projected/d977c32d-ae0b-423c-a7c1-f21915e1e36b-kube-api-access-l7x7z\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.643091 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.643069 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:17.768704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:17.768680 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4"] Jun 05 03:26:17.770205 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:26:17.770181 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd977c32d_ae0b_423c_a7c1_f21915e1e36b.slice/crio-d9e3e27c9f324e93fd81954a1da417a361036134fd09eeacccb1485911b469df WatchSource:0}: Error finding container d9e3e27c9f324e93fd81954a1da417a361036134fd09eeacccb1485911b469df: Status 404 returned error can't find the container with id d9e3e27c9f324e93fd81954a1da417a361036134fd09eeacccb1485911b469df Jun 05 03:26:18.636022 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:18.635984 2552 generic.go:356] "Generic (PLEG): container finished" podID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerID="89a30e711e4ca51aa58a3581001200328aae02c5ad0be161123c4c07e34eb841" exitCode=0 Jun 05 03:26:18.636390 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:18.636065 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" event={"ID":"d977c32d-ae0b-423c-a7c1-f21915e1e36b","Type":"ContainerDied","Data":"89a30e711e4ca51aa58a3581001200328aae02c5ad0be161123c4c07e34eb841"} Jun 05 03:26:18.636390 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:18.636111 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" event={"ID":"d977c32d-ae0b-423c-a7c1-f21915e1e36b","Type":"ContainerStarted","Data":"d9e3e27c9f324e93fd81954a1da417a361036134fd09eeacccb1485911b469df"} Jun 05 03:26:19.643176 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:19.643144 2552 generic.go:356] "Generic (PLEG): container finished" podID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerID="f8600dcfa07e3f3260f95d2fae8217664e8e1e96187f3a4ec46f7549e5388a71" exitCode=0 Jun 05 03:26:19.643566 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:19.643231 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" event={"ID":"d977c32d-ae0b-423c-a7c1-f21915e1e36b","Type":"ContainerDied","Data":"f8600dcfa07e3f3260f95d2fae8217664e8e1e96187f3a4ec46f7549e5388a71"} Jun 05 03:26:20.651930 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:20.651889 2552 generic.go:356] "Generic (PLEG): container finished" podID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerID="1e6d6b5cec96fe39bac84c5153965e3e3974bcaa010dfaed8ca5dca10b4c384f" exitCode=0 Jun 05 03:26:20.652306 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:20.651936 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" event={"ID":"d977c32d-ae0b-423c-a7c1-f21915e1e36b","Type":"ContainerDied","Data":"1e6d6b5cec96fe39bac84c5153965e3e3974bcaa010dfaed8ca5dca10b4c384f"} Jun 05 03:26:21.786463 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:21.786443 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:21.911363 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:21.911284 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-util\") pod \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " Jun 05 03:26:21.911363 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:21.911346 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-bundle\") pod \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " Jun 05 03:26:21.911527 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:21.911382 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l7x7z\" (UniqueName: \"kubernetes.io/projected/d977c32d-ae0b-423c-a7c1-f21915e1e36b-kube-api-access-l7x7z\") pod \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\" (UID: \"d977c32d-ae0b-423c-a7c1-f21915e1e36b\") " Jun 05 03:26:21.911856 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:21.911825 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-bundle" (OuterVolumeSpecName: "bundle") pod "d977c32d-ae0b-423c-a7c1-f21915e1e36b" (UID: "d977c32d-ae0b-423c-a7c1-f21915e1e36b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:26:21.913379 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:21.913354 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d977c32d-ae0b-423c-a7c1-f21915e1e36b-kube-api-access-l7x7z" (OuterVolumeSpecName: "kube-api-access-l7x7z") pod "d977c32d-ae0b-423c-a7c1-f21915e1e36b" (UID: "d977c32d-ae0b-423c-a7c1-f21915e1e36b"). InnerVolumeSpecName "kube-api-access-l7x7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:26:21.916942 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:21.916918 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-util" (OuterVolumeSpecName: "util") pod "d977c32d-ae0b-423c-a7c1-f21915e1e36b" (UID: "d977c32d-ae0b-423c-a7c1-f21915e1e36b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:26:22.012880 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:22.012855 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l7x7z\" (UniqueName: \"kubernetes.io/projected/d977c32d-ae0b-423c-a7c1-f21915e1e36b-kube-api-access-l7x7z\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:26:22.012880 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:22.012877 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-util\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:26:22.013020 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:22.012887 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d977c32d-ae0b-423c-a7c1-f21915e1e36b-bundle\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:26:22.670260 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:22.670234 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" Jun 05 03:26:22.670438 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:22.670254 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70rmjz4" event={"ID":"d977c32d-ae0b-423c-a7c1-f21915e1e36b","Type":"ContainerDied","Data":"d9e3e27c9f324e93fd81954a1da417a361036134fd09eeacccb1485911b469df"} Jun 05 03:26:22.670438 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:22.670344 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9e3e27c9f324e93fd81954a1da417a361036134fd09eeacccb1485911b469df" Jun 05 03:26:40.080776 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.080741 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:26:40.081268 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.081248 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerName="pull" Jun 05 03:26:40.081395 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.081271 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerName="pull" Jun 05 03:26:40.081395 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.081302 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerName="util" Jun 05 03:26:40.081395 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.081311 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerName="util" Jun 05 03:26:40.081395 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.081355 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerName="extract" Jun 05 03:26:40.081395 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.081365 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerName="extract" Jun 05 03:26:40.081754 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.081462 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d977c32d-ae0b-423c-a7c1-f21915e1e36b" containerName="extract" Jun 05 03:26:40.085756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.085735 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:40.087852 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.087827 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 03:26:40.087958 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.087885 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 03:26:40.087958 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.087885 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-78mpw\"" Jun 05 03:26:40.088500 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.088476 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 03:26:40.094863 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.094846 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:26:40.144501 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.144477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsqlb\" (UniqueName: \"kubernetes.io/projected/2ff80e0a-76ae-4887-90b0-291d53ef44f4-kube-api-access-gsqlb\") pod \"maas-keycloak-0\" (UID: \"2ff80e0a-76ae-4887-90b0-291d53ef44f4\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:40.245083 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.245060 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsqlb\" (UniqueName: \"kubernetes.io/projected/2ff80e0a-76ae-4887-90b0-291d53ef44f4-kube-api-access-gsqlb\") pod \"maas-keycloak-0\" (UID: \"2ff80e0a-76ae-4887-90b0-291d53ef44f4\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:40.252352 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.252327 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsqlb\" (UniqueName: \"kubernetes.io/projected/2ff80e0a-76ae-4887-90b0-291d53ef44f4-kube-api-access-gsqlb\") pod \"maas-keycloak-0\" (UID: \"2ff80e0a-76ae-4887-90b0-291d53ef44f4\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:40.395739 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.395686 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:40.523154 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.523128 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:26:40.524246 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:26:40.524224 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff80e0a_76ae_4887_90b0_291d53ef44f4.slice/crio-9b1a17b7c8a9e4fd650302067b21c122eb8e1775fa1a90b0cf7b861f1fc0c837 WatchSource:0}: Error finding container 9b1a17b7c8a9e4fd650302067b21c122eb8e1775fa1a90b0cf7b861f1fc0c837: Status 404 returned error can't find the container with id 9b1a17b7c8a9e4fd650302067b21c122eb8e1775fa1a90b0cf7b861f1fc0c837 Jun 05 03:26:40.770796 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:40.770732 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ff80e0a-76ae-4887-90b0-291d53ef44f4","Type":"ContainerStarted","Data":"9b1a17b7c8a9e4fd650302067b21c122eb8e1775fa1a90b0cf7b861f1fc0c837"} Jun 05 03:26:45.805461 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:45.805420 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ff80e0a-76ae-4887-90b0-291d53ef44f4","Type":"ContainerStarted","Data":"3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7"} Jun 05 03:26:45.823003 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:45.822951 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.26362763 podStartE2EDuration="5.822936851s" totalImagesPullingTime="4.559309221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:26:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:26:45.82023622 +0000 UTC m=+494.990746345" watchObservedRunningTime="2026-06-05 03:26:45.822936851 +0000 UTC m=+494.993446984" Jun 05 03:26:46.396151 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:46.396112 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:46.398045 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:46.398010 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:47.396852 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:47.396798 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:48.396294 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:48.396238 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:49.396972 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:49.396934 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:50.395872 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:50.395833 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:50.396663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:50.396504 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:51.405582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:51.405545 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:52.396802 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:52.396750 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:53.396890 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:53.396844 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:54.396694 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:54.396640 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:55.397013 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:55.396959 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:56.396627 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:56.396580 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:57.396589 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:57.396550 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.48:9000/health/started\": dial tcp 10.134.0.48:9000: connect: connection refused" Jun 05 03:26:58.513233 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:58.513193 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 03:26:58.528232 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:26:58.528195 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:27:08.519234 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:08.519192 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:27:09.627879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.627841 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-677f4f47b5-5v9xt"] Jun 05 03:27:09.633229 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.633208 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-677f4f47b5-5v9xt" Jun 05 03:27:09.635564 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.635542 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8rjtn\"" Jun 05 03:27:09.637281 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.637257 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-677f4f47b5-5v9xt"] Jun 05 03:27:09.733325 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.733301 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh6bc\" (UniqueName: \"kubernetes.io/projected/0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3-kube-api-access-xh6bc\") pod \"authorino-677f4f47b5-5v9xt\" (UID: \"0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3\") " pod="kuadrant-system/authorino-677f4f47b5-5v9xt" Jun 05 03:27:09.744246 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.744225 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-677f4f47b5-5v9xt"] Jun 05 03:27:09.744435 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:27:09.744414 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xh6bc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-677f4f47b5-5v9xt" podUID="0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3" Jun 05 03:27:09.772254 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.772230 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6746dfb985-9t5sj"] Jun 05 03:27:09.775806 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.775793 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:09.777723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.777708 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 03:27:09.781205 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.781184 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6746dfb985-9t5sj"] Jun 05 03:27:09.834072 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.834047 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh6bc\" (UniqueName: \"kubernetes.io/projected/0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3-kube-api-access-xh6bc\") pod \"authorino-677f4f47b5-5v9xt\" (UID: \"0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3\") " pod="kuadrant-system/authorino-677f4f47b5-5v9xt" Jun 05 03:27:09.841707 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.841683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh6bc\" (UniqueName: \"kubernetes.io/projected/0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3-kube-api-access-xh6bc\") pod \"authorino-677f4f47b5-5v9xt\" (UID: \"0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3\") " pod="kuadrant-system/authorino-677f4f47b5-5v9xt" Jun 05 03:27:09.934404 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.934356 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-tls-cert\") pod \"authorino-6746dfb985-9t5sj\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:09.934492 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.934406 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njzns\" (UniqueName: \"kubernetes.io/projected/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-kube-api-access-njzns\") pod \"authorino-6746dfb985-9t5sj\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:09.985015 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.984990 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-677f4f47b5-5v9xt" Jun 05 03:27:09.993663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:09.993636 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-677f4f47b5-5v9xt" Jun 05 03:27:10.034936 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.034917 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njzns\" (UniqueName: \"kubernetes.io/projected/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-kube-api-access-njzns\") pod \"authorino-6746dfb985-9t5sj\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:10.035045 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.034967 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-tls-cert\") pod \"authorino-6746dfb985-9t5sj\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:10.037233 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.037214 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-tls-cert\") pod \"authorino-6746dfb985-9t5sj\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:10.041585 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.041568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njzns\" (UniqueName: \"kubernetes.io/projected/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-kube-api-access-njzns\") pod \"authorino-6746dfb985-9t5sj\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:10.085561 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.085540 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:27:10.135701 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.135664 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh6bc\" (UniqueName: \"kubernetes.io/projected/0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3-kube-api-access-xh6bc\") pod \"0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3\" (UID: \"0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3\") " Jun 05 03:27:10.137774 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.137744 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3-kube-api-access-xh6bc" (OuterVolumeSpecName: "kube-api-access-xh6bc") pod "0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3" (UID: "0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3"). InnerVolumeSpecName "kube-api-access-xh6bc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:27:10.210231 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.210203 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6746dfb985-9t5sj"] Jun 05 03:27:10.211487 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:27:10.211460 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaabd467d_ed52_4ff1_ae78_53858cd4e5dc.slice/crio-45e8b56f99f197c38580cecb6854dd54cc479103c391bfb68bcbf1cb604b8214 WatchSource:0}: Error finding container 45e8b56f99f197c38580cecb6854dd54cc479103c391bfb68bcbf1cb604b8214: Status 404 returned error can't find the container with id 45e8b56f99f197c38580cecb6854dd54cc479103c391bfb68bcbf1cb604b8214 Jun 05 03:27:10.236783 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.236754 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh6bc\" (UniqueName: \"kubernetes.io/projected/0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3-kube-api-access-xh6bc\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:27:10.991594 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.991562 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6746dfb985-9t5sj" event={"ID":"aabd467d-ed52-4ff1-ae78-53858cd4e5dc","Type":"ContainerStarted","Data":"4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04"} Jun 05 03:27:10.991996 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.991607 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6746dfb985-9t5sj" event={"ID":"aabd467d-ed52-4ff1-ae78-53858cd4e5dc","Type":"ContainerStarted","Data":"45e8b56f99f197c38580cecb6854dd54cc479103c391bfb68bcbf1cb604b8214"} Jun 05 03:27:10.991996 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:10.991740 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-677f4f47b5-5v9xt" Jun 05 03:27:11.005597 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:11.005556 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6746dfb985-9t5sj" podStartSLOduration=1.698869009 podStartE2EDuration="2.005542542s" totalImagesPullingTime="306.673533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:27:11.00481674 +0000 UTC m=+520.175326838" watchObservedRunningTime="2026-06-05 03:27:11.005542542 +0000 UTC m=+520.176052644" Jun 05 03:27:11.026898 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:11.026875 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-677f4f47b5-5v9xt"] Jun 05 03:27:11.030738 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:11.030716 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-677f4f47b5-5v9xt"] Jun 05 03:27:11.291984 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:11.291907 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3" path="/var/lib/kubelet/pods/0980f5e2-64d7-4cf1-b681-fe9b3e7d99a3/volumes" Jun 05 03:27:14.619520 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.619485 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d79495cc9-7l5wq"] Jun 05 03:27:14.630259 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.630229 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d79495cc9-7l5wq"] Jun 05 03:27:14.630414 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.630351 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:27:14.632588 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.632565 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 03:27:14.632778 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.632758 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5bbd8\"" Jun 05 03:27:14.773510 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.773482 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chcn8\" (UniqueName: \"kubernetes.io/projected/82566d7b-e7c9-4ecf-9e12-a568b43e5dd9-kube-api-access-chcn8\") pod \"maas-controller-5d79495cc9-7l5wq\" (UID: \"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9\") " pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:27:14.874208 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.874152 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chcn8\" (UniqueName: \"kubernetes.io/projected/82566d7b-e7c9-4ecf-9e12-a568b43e5dd9-kube-api-access-chcn8\") pod \"maas-controller-5d79495cc9-7l5wq\" (UID: \"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9\") " pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:27:14.882577 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.882551 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chcn8\" (UniqueName: \"kubernetes.io/projected/82566d7b-e7c9-4ecf-9e12-a568b43e5dd9-kube-api-access-chcn8\") pod \"maas-controller-5d79495cc9-7l5wq\" (UID: \"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9\") " pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:27:14.941572 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:14.941549 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:27:15.094386 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:15.094362 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d79495cc9-7l5wq"] Jun 05 03:27:15.096038 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:27:15.096017 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82566d7b_e7c9_4ecf_9e12_a568b43e5dd9.slice/crio-d59012bcb5524700a9cbc52347439adec077ffd16bc0f3a8d71720619835a27f WatchSource:0}: Error finding container d59012bcb5524700a9cbc52347439adec077ffd16bc0f3a8d71720619835a27f: Status 404 returned error can't find the container with id d59012bcb5524700a9cbc52347439adec077ffd16bc0f3a8d71720619835a27f Jun 05 03:27:16.025399 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:16.025358 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" event={"ID":"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9","Type":"ContainerStarted","Data":"d59012bcb5524700a9cbc52347439adec077ffd16bc0f3a8d71720619835a27f"} Jun 05 03:27:18.038818 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:18.038719 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" event={"ID":"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9","Type":"ContainerStarted","Data":"dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5"} Jun 05 03:27:18.038818 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:18.038778 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:27:18.055494 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:18.055297 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" podStartSLOduration=1.5964741660000001 podStartE2EDuration="4.055278651s" totalImagesPullingTime="2.458804485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:27:18.054253709 +0000 UTC m=+527.224763810" watchObservedRunningTime="2026-06-05 03:27:18.055278651 +0000 UTC m=+527.225788756" Jun 05 03:27:29.050946 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:29.050869 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:27:46.797906 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:46.797875 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7b68b6f647-xx8jc"] Jun 05 03:27:46.801691 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:46.801669 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:46.803654 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:46.803630 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 05 03:27:46.803757 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:46.803706 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lxpt7\"" Jun 05 03:27:46.811146 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:46.811127 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b68b6f647-xx8jc"] Jun 05 03:27:46.910673 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:46.910645 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-maas-api-tls\") pod \"maas-api-7b68b6f647-xx8jc\" (UID: \"4a5882ff-d92c-4b36-bd9a-a8ec838441fd\") " pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:46.910847 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:46.910710 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955vz\" (UniqueName: \"kubernetes.io/projected/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-kube-api-access-955vz\") pod \"maas-api-7b68b6f647-xx8jc\" (UID: \"4a5882ff-d92c-4b36-bd9a-a8ec838441fd\") " pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:47.011136 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.011106 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-maas-api-tls\") pod \"maas-api-7b68b6f647-xx8jc\" (UID: \"4a5882ff-d92c-4b36-bd9a-a8ec838441fd\") " pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:47.011310 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.011161 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955vz\" (UniqueName: \"kubernetes.io/projected/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-kube-api-access-955vz\") pod \"maas-api-7b68b6f647-xx8jc\" (UID: \"4a5882ff-d92c-4b36-bd9a-a8ec838441fd\") " pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:47.011310 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:27:47.011261 2552 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 05 03:27:47.011481 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:27:47.011369 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-maas-api-tls podName:4a5882ff-d92c-4b36-bd9a-a8ec838441fd nodeName:}" failed. No retries permitted until 2026-06-05 03:27:47.511350808 +0000 UTC m=+556.681860889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-maas-api-tls") pod "maas-api-7b68b6f647-xx8jc" (UID: "4a5882ff-d92c-4b36-bd9a-a8ec838441fd") : secret "maas-api-serving-cert" not found Jun 05 03:27:47.021377 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.021349 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-955vz\" (UniqueName: \"kubernetes.io/projected/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-kube-api-access-955vz\") pod \"maas-api-7b68b6f647-xx8jc\" (UID: \"4a5882ff-d92c-4b36-bd9a-a8ec838441fd\") " pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:47.236449 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.236373 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gq5zt"] Jun 05 03:27:47.240241 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.240220 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" Jun 05 03:27:47.242810 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.242792 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 05 03:27:47.259135 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.259108 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gq5zt"] Jun 05 03:27:47.314554 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.314520 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c896j\" (UniqueName: \"kubernetes.io/projected/c5ea08c8-2c06-406c-a739-821a5e438c52-kube-api-access-c896j\") pod \"payload-pre-processing-67d7689b65-gq5zt\" (UID: \"c5ea08c8-2c06-406c-a739-821a5e438c52\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" Jun 05 03:27:47.415658 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.415620 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c896j\" (UniqueName: \"kubernetes.io/projected/c5ea08c8-2c06-406c-a739-821a5e438c52-kube-api-access-c896j\") pod \"payload-pre-processing-67d7689b65-gq5zt\" (UID: \"c5ea08c8-2c06-406c-a739-821a5e438c52\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" Jun 05 03:27:47.423303 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.423282 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c896j\" (UniqueName: \"kubernetes.io/projected/c5ea08c8-2c06-406c-a739-821a5e438c52-kube-api-access-c896j\") pod \"payload-pre-processing-67d7689b65-gq5zt\" (UID: \"c5ea08c8-2c06-406c-a739-821a5e438c52\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" Jun 05 03:27:47.516473 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.516403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-maas-api-tls\") pod \"maas-api-7b68b6f647-xx8jc\" (UID: \"4a5882ff-d92c-4b36-bd9a-a8ec838441fd\") " pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:47.518687 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.518660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a5882ff-d92c-4b36-bd9a-a8ec838441fd-maas-api-tls\") pod \"maas-api-7b68b6f647-xx8jc\" (UID: \"4a5882ff-d92c-4b36-bd9a-a8ec838441fd\") " pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:47.557128 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.557095 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" Jun 05 03:27:47.687008 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.686976 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-gq5zt"] Jun 05 03:27:47.687934 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:27:47.687911 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ea08c8_2c06_406c_a739_821a5e438c52.slice/crio-aa227b77a921c0813d63dd87d8517441a51961c17fc84130567715d507c71563 WatchSource:0}: Error finding container aa227b77a921c0813d63dd87d8517441a51961c17fc84130567715d507c71563: Status 404 returned error can't find the container with id aa227b77a921c0813d63dd87d8517441a51961c17fc84130567715d507c71563 Jun 05 03:27:47.713430 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.713407 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:47.857381 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:47.856761 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b68b6f647-xx8jc"] Jun 05 03:27:48.214297 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:48.214220 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b68b6f647-xx8jc" event={"ID":"4a5882ff-d92c-4b36-bd9a-a8ec838441fd","Type":"ContainerStarted","Data":"c76e3fa22e2451fbaa309216668313e16941d335aee361e2d02053c848fa6b08"} Jun 05 03:27:48.216227 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:48.216199 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" event={"ID":"c5ea08c8-2c06-406c-a739-821a5e438c52","Type":"ContainerStarted","Data":"aa227b77a921c0813d63dd87d8517441a51961c17fc84130567715d507c71563"} Jun 05 03:27:51.235606 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:51.235517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b68b6f647-xx8jc" event={"ID":"4a5882ff-d92c-4b36-bd9a-a8ec838441fd","Type":"ContainerStarted","Data":"dfcac3031919eb7544932d26c1d7a0d61171cac2a75db5f26bd819b344da0585"} Jun 05 03:27:51.236065 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:51.235681 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:51.237120 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:51.237095 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" event={"ID":"c5ea08c8-2c06-406c-a739-821a5e438c52","Type":"ContainerStarted","Data":"36cc0bf304578d833b9e9dcb5bf0e261c3ae21b360ccfaff744703b61dfd4552"} Jun 05 03:27:51.237211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:51.237143 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" Jun 05 03:27:51.251084 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:51.251033 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7b68b6f647-xx8jc" podStartSLOduration=2.185337039 podStartE2EDuration="5.25100275s" totalImagesPullingTime="3.065665711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:27:51.249653883 +0000 UTC m=+560.420163985" watchObservedRunningTime="2026-06-05 03:27:51.25100275 +0000 UTC m=+560.421512853" Jun 05 03:27:51.267296 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:51.267234 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" podStartSLOduration=0.961794118 podStartE2EDuration="4.267215679s" totalImagesPullingTime="3.305421561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:27:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:27:51.263781949 +0000 UTC m=+560.434292051" watchObservedRunningTime="2026-06-05 03:27:51.267215679 +0000 UTC m=+560.437725784" Jun 05 03:27:55.262619 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:55.262582 2552 generic.go:356] "Generic (PLEG): container finished" podID="082c3638-d9de-426c-aefc-78e7ce4c2500" containerID="354ebaf7eb9e25c908c31d77c23a323c870ab848ea7827d3639ac8c01c741697" exitCode=0 Jun 05 03:27:55.263020 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:55.262658 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" event={"ID":"082c3638-d9de-426c-aefc-78e7ce4c2500","Type":"ContainerDied","Data":"354ebaf7eb9e25c908c31d77c23a323c870ab848ea7827d3639ac8c01c741697"} Jun 05 03:27:55.263065 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:55.263046 2552 scope.go:117] "RemoveContainer" containerID="354ebaf7eb9e25c908c31d77c23a323c870ab848ea7827d3639ac8c01c741697" Jun 05 03:27:55.264010 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:55.263982 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:27:55.264062 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:55.264054 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:27:55.264097 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:55.264088 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:27:56.274537 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:56.274491 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" event={"ID":"082c3638-d9de-426c-aefc-78e7ce4c2500","Type":"ContainerStarted","Data":"42cf1869a51da8ab60b4a54d00188bb8f5118b898bc319d4a8f3ba90c3ac62bf"} Jun 05 03:27:56.798462 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:56.798432 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:27:56.798642 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:56.798614 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qp297 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jun 05 03:27:56.798688 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:56.798659 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" podUID="082c3638-d9de-426c-aefc-78e7ce4c2500" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jun 05 03:27:57.247914 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:57.247838 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7b68b6f647-xx8jc" Jun 05 03:27:57.798642 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:57.798607 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qp297 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jun 05 03:27:57.799049 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:57.798661 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" podUID="082c3638-d9de-426c-aefc-78e7ce4c2500" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jun 05 03:27:58.798866 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:58.798834 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qp297 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jun 05 03:27:58.799233 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:58.798919 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" podUID="082c3638-d9de-426c-aefc-78e7ce4c2500" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jun 05 03:27:59.045995 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:59.045963 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:27:59.046163 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:59.046142 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" containerID="cri-o://3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7" gracePeriod=30 Jun 05 03:27:59.798511 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:59.798473 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-qp297 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jun 05 03:27:59.798675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:27:59.798530 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" podUID="082c3638-d9de-426c-aefc-78e7ce4c2500" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jun 05 03:28:00.802534 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:00.802508 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:28:00.802960 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:00.802803 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:28:00.803471 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:00.803454 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-qp297" Jun 05 03:28:01.097895 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.097874 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.256684 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.256652 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsqlb\" (UniqueName: \"kubernetes.io/projected/2ff80e0a-76ae-4887-90b0-291d53ef44f4-kube-api-access-gsqlb\") pod \"2ff80e0a-76ae-4887-90b0-291d53ef44f4\" (UID: \"2ff80e0a-76ae-4887-90b0-291d53ef44f4\") " Jun 05 03:28:01.258754 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.258734 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff80e0a-76ae-4887-90b0-291d53ef44f4-kube-api-access-gsqlb" (OuterVolumeSpecName: "kube-api-access-gsqlb") pod "2ff80e0a-76ae-4887-90b0-291d53ef44f4" (UID: "2ff80e0a-76ae-4887-90b0-291d53ef44f4"). InnerVolumeSpecName "kube-api-access-gsqlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:28:01.311093 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.311069 2552 generic.go:356] "Generic (PLEG): container finished" podID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerID="3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7" exitCode=143 Jun 05 03:28:01.311204 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.311109 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.311204 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.311143 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ff80e0a-76ae-4887-90b0-291d53ef44f4","Type":"ContainerDied","Data":"3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7"} Jun 05 03:28:01.311204 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.311188 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2ff80e0a-76ae-4887-90b0-291d53ef44f4","Type":"ContainerDied","Data":"9b1a17b7c8a9e4fd650302067b21c122eb8e1775fa1a90b0cf7b861f1fc0c837"} Jun 05 03:28:01.311345 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.311207 2552 scope.go:117] "RemoveContainer" containerID="3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7" Jun 05 03:28:01.320813 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.320796 2552 scope.go:117] "RemoveContainer" containerID="3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7" Jun 05 03:28:01.321082 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:28:01.321061 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7\": container with ID starting with 3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7 not found: ID does not exist" containerID="3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7" Jun 05 03:28:01.321131 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.321089 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7"} err="failed to get container status \"3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7\": rpc error: code = NotFound desc = could not find container \"3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7\": container with ID starting with 3a0b2545cd03f82b5bb5e8059b2b225ce48c3e31950108260bd524b83656baa7 not found: ID does not exist" Jun 05 03:28:01.328124 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.328066 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:28:01.331600 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.331580 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:28:01.358208 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.358181 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsqlb\" (UniqueName: \"kubernetes.io/projected/2ff80e0a-76ae-4887-90b0-291d53ef44f4-kube-api-access-gsqlb\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:28:01.359537 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.359520 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:28:01.359933 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.359918 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" Jun 05 03:28:01.359993 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.359935 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" Jun 05 03:28:01.360038 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.360002 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" containerName="keycloak" Jun 05 03:28:01.364506 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.364492 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.366657 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.366638 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 03:28:01.366756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.366638 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 03:28:01.366756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.366704 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 05 03:28:01.366952 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.366938 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 05 03:28:01.367047 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.367032 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-78mpw\"" Jun 05 03:28:01.370704 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.370684 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:28:01.459410 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.459379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a518a344-ce43-4fcc-a100-0e3f44c9c5a7-test-realms\") pod \"maas-keycloak-0\" (UID: \"a518a344-ce43-4fcc-a100-0e3f44c9c5a7\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.459597 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.459418 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv675\" (UniqueName: \"kubernetes.io/projected/a518a344-ce43-4fcc-a100-0e3f44c9c5a7-kube-api-access-wv675\") pod \"maas-keycloak-0\" (UID: \"a518a344-ce43-4fcc-a100-0e3f44c9c5a7\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.560943 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.560912 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a518a344-ce43-4fcc-a100-0e3f44c9c5a7-test-realms\") pod \"maas-keycloak-0\" (UID: \"a518a344-ce43-4fcc-a100-0e3f44c9c5a7\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.561100 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.560956 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv675\" (UniqueName: \"kubernetes.io/projected/a518a344-ce43-4fcc-a100-0e3f44c9c5a7-kube-api-access-wv675\") pod \"maas-keycloak-0\" (UID: \"a518a344-ce43-4fcc-a100-0e3f44c9c5a7\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.561601 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.561583 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a518a344-ce43-4fcc-a100-0e3f44c9c5a7-test-realms\") pod \"maas-keycloak-0\" (UID: \"a518a344-ce43-4fcc-a100-0e3f44c9c5a7\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.569213 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.569192 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv675\" (UniqueName: \"kubernetes.io/projected/a518a344-ce43-4fcc-a100-0e3f44c9c5a7-kube-api-access-wv675\") pod \"maas-keycloak-0\" (UID: \"a518a344-ce43-4fcc-a100-0e3f44c9c5a7\") " pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.675985 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.675894 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:01.805667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:01.805639 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 05 03:28:01.806943 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:28:01.806915 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda518a344_ce43_4fcc_a100_0e3f44c9c5a7.slice/crio-6f5ff7fd2c975269e76fdf168393f31be4544a80962b9b8c47b687e56db4e2ec WatchSource:0}: Error finding container 6f5ff7fd2c975269e76fdf168393f31be4544a80962b9b8c47b687e56db4e2ec: Status 404 returned error can't find the container with id 6f5ff7fd2c975269e76fdf168393f31be4544a80962b9b8c47b687e56db4e2ec Jun 05 03:28:02.245498 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:02.245473 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-gq5zt" Jun 05 03:28:02.327299 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:02.327258 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a518a344-ce43-4fcc-a100-0e3f44c9c5a7","Type":"ContainerStarted","Data":"b3d4bc8ec93b0f3933292ad1a53bcbc83e1dad84b4b1122e7a0fd44d58b40897"} Jun 05 03:28:02.327500 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:02.327365 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a518a344-ce43-4fcc-a100-0e3f44c9c5a7","Type":"ContainerStarted","Data":"6f5ff7fd2c975269e76fdf168393f31be4544a80962b9b8c47b687e56db4e2ec"} Jun 05 03:28:02.345996 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:02.345950 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.943896189 podStartE2EDuration="1.345937259s" totalImagesPullingTime="402.04107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:28:02.34374017 +0000 UTC m=+571.514250267" watchObservedRunningTime="2026-06-05 03:28:02.345937259 +0000 UTC m=+571.516447359" Jun 05 03:28:02.676411 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:02.676373 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:02.678228 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:02.678187 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:03.296461 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:03.296424 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff80e0a-76ae-4887-90b0-291d53ef44f4" path="/var/lib/kubelet/pods/2ff80e0a-76ae-4887-90b0-291d53ef44f4/volumes" Jun 05 03:28:03.676776 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:03.676662 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:04.676824 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:04.676773 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:05.676756 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:05.676702 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:06.677050 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:06.676998 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:07.676512 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:07.676467 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:08.676793 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:08.676745 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:09.677178 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:09.677130 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:10.676414 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:10.676367 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:11.676472 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:11.676428 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:11.676970 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:11.676705 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:12.677359 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:12.677293 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:13.677213 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:13.677163 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:14.676429 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:14.676383 2552 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.54:9000/health/started\": dial tcp 10.134.0.54:9000: connect: connection refused" Jun 05 03:28:15.772521 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:15.772466 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:15.786672 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:15.786630 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a518a344-ce43-4fcc-a100-0e3f44c9c5a7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 03:28:25.779426 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:25.779384 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 05 03:28:37.613513 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:37.613163 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6746dfb985-9t5sj"] Jun 05 03:28:37.613513 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:37.613453 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6746dfb985-9t5sj" podUID="aabd467d-ed52-4ff1-ae78-53858cd4e5dc" containerName="authorino" containerID="cri-o://4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04" gracePeriod=30 Jun 05 03:28:37.886954 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:37.886929 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:28:38.002125 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.002091 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-tls-cert\") pod \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " Jun 05 03:28:38.002415 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.002198 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njzns\" (UniqueName: \"kubernetes.io/projected/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-kube-api-access-njzns\") pod \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\" (UID: \"aabd467d-ed52-4ff1-ae78-53858cd4e5dc\") " Jun 05 03:28:38.005596 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.005563 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-kube-api-access-njzns" (OuterVolumeSpecName: "kube-api-access-njzns") pod "aabd467d-ed52-4ff1-ae78-53858cd4e5dc" (UID: "aabd467d-ed52-4ff1-ae78-53858cd4e5dc"). InnerVolumeSpecName "kube-api-access-njzns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:28:38.013486 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.013461 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "aabd467d-ed52-4ff1-ae78-53858cd4e5dc" (UID: "aabd467d-ed52-4ff1-ae78-53858cd4e5dc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 03:28:38.103297 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.103263 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njzns\" (UniqueName: \"kubernetes.io/projected/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-kube-api-access-njzns\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:28:38.103297 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.103300 2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aabd467d-ed52-4ff1-ae78-53858cd4e5dc-tls-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:28:38.597938 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.597906 2552 generic.go:356] "Generic (PLEG): container finished" podID="aabd467d-ed52-4ff1-ae78-53858cd4e5dc" containerID="4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04" exitCode=0 Jun 05 03:28:38.598114 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.597949 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6746dfb985-9t5sj" Jun 05 03:28:38.598114 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.597979 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6746dfb985-9t5sj" event={"ID":"aabd467d-ed52-4ff1-ae78-53858cd4e5dc","Type":"ContainerDied","Data":"4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04"} Jun 05 03:28:38.598114 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.598008 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6746dfb985-9t5sj" event={"ID":"aabd467d-ed52-4ff1-ae78-53858cd4e5dc","Type":"ContainerDied","Data":"45e8b56f99f197c38580cecb6854dd54cc479103c391bfb68bcbf1cb604b8214"} Jun 05 03:28:38.598114 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.598024 2552 scope.go:117] "RemoveContainer" containerID="4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04" Jun 05 03:28:38.607627 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.607613 2552 scope.go:117] "RemoveContainer" containerID="4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04" Jun 05 03:28:38.607864 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:28:38.607843 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04\": container with ID starting with 4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04 not found: ID does not exist" containerID="4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04" Jun 05 03:28:38.607922 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.607871 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04"} err="failed to get container status \"4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04\": rpc error: code = NotFound desc = could not find container \"4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04\": container with ID starting with 4e757cc1bd3b37a08eed13e79f53cc38416926b9f0cbfe7bf427ce740cf73b04 not found: ID does not exist" Jun 05 03:28:38.618890 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.618857 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6746dfb985-9t5sj"] Jun 05 03:28:38.621628 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:38.621606 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6746dfb985-9t5sj"] Jun 05 03:28:39.292442 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:39.292411 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aabd467d-ed52-4ff1-ae78-53858cd4e5dc" path="/var/lib/kubelet/pods/aabd467d-ed52-4ff1-ae78-53858cd4e5dc/volumes" Jun 05 03:28:42.707351 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.707286 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg"] Jun 05 03:28:42.707878 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.707756 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aabd467d-ed52-4ff1-ae78-53858cd4e5dc" containerName="authorino" Jun 05 03:28:42.707878 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.707773 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aabd467d-ed52-4ff1-ae78-53858cd4e5dc" containerName="authorino" Jun 05 03:28:42.707983 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.707880 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="aabd467d-ed52-4ff1-ae78-53858cd4e5dc" containerName="authorino" Jun 05 03:28:42.712637 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.712615 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.715373 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.715352 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 05 03:28:42.715498 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.715388 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wkhvl\"" Jun 05 03:28:42.715498 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.715412 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 05 03:28:42.715498 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.715388 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 05 03:28:42.720163 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.720144 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg"] Jun 05 03:28:42.842701 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.842669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.842868 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.842759 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjdsd\" (UniqueName: \"kubernetes.io/projected/4294bccb-5ccf-4389-aaa3-b079188bd866-kube-api-access-jjdsd\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.842868 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.842793 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.842868 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.842817 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4294bccb-5ccf-4389-aaa3-b079188bd866-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.842868 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.842840 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.842868 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.842863 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944216 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944187 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjdsd\" (UniqueName: \"kubernetes.io/projected/4294bccb-5ccf-4389-aaa3-b079188bd866-kube-api-access-jjdsd\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944393 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944223 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944393 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944244 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4294bccb-5ccf-4389-aaa3-b079188bd866-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944393 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944265 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944393 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944393 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944335 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944747 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944722 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944823 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944731 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.944925 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.944906 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.946625 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.946603 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4294bccb-5ccf-4389-aaa3-b079188bd866-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.946941 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.946924 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4294bccb-5ccf-4389-aaa3-b079188bd866-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:42.951586 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:42.951561 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjdsd\" (UniqueName: \"kubernetes.io/projected/4294bccb-5ccf-4389-aaa3-b079188bd866-kube-api-access-jjdsd\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg\" (UID: \"4294bccb-5ccf-4389-aaa3-b079188bd866\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:43.025449 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:43.025390 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:28:43.166789 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:43.166762 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg"] Jun 05 03:28:43.167832 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:28:43.167801 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4294bccb_5ccf_4389_aaa3_b079188bd866.slice/crio-35924e9b1512b36ecfa22999f6e149652990e32d0fd08070445c63127ab1ee74 WatchSource:0}: Error finding container 35924e9b1512b36ecfa22999f6e149652990e32d0fd08070445c63127ab1ee74: Status 404 returned error can't find the container with id 35924e9b1512b36ecfa22999f6e149652990e32d0fd08070445c63127ab1ee74 Jun 05 03:28:43.169793 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:43.169771 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 03:28:43.628574 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:43.628531 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" event={"ID":"4294bccb-5ccf-4389-aaa3-b079188bd866","Type":"ContainerStarted","Data":"35924e9b1512b36ecfa22999f6e149652990e32d0fd08070445c63127ab1ee74"} Jun 05 03:28:47.657436 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:28:47.657403 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" event={"ID":"4294bccb-5ccf-4389-aaa3-b079188bd866","Type":"ContainerStarted","Data":"4386eb703f2588187df41a1c4477e153df4945a6eb1de44f32619224bd43ea68"} Jun 05 03:29:29.217820 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.217790 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w"] Jun 05 03:29:29.221872 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.221850 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.224000 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.223981 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 05 03:29:29.234230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.234210 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w"] Jun 05 03:29:29.356015 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.355981 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.356015 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.356020 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.356262 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.356094 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggns2\" (UniqueName: \"kubernetes.io/projected/2b53ee7c-92c2-41f3-9f88-913692b18280-kube-api-access-ggns2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.356353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.356288 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.356539 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.356519 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b53ee7c-92c2-41f3-9f88-913692b18280-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.356648 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.356579 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458057 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458014 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458208 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458071 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b53ee7c-92c2-41f3-9f88-913692b18280-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458208 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458211 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458245 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458270 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggns2\" (UniqueName: \"kubernetes.io/projected/2b53ee7c-92c2-41f3-9f88-913692b18280-kube-api-access-ggns2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458597 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458467 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458597 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458537 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.458597 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.458537 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.460330 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.460292 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b53ee7c-92c2-41f3-9f88-913692b18280-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.460467 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.460449 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b53ee7c-92c2-41f3-9f88-913692b18280-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.465702 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.465684 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggns2\" (UniqueName: \"kubernetes.io/projected/2b53ee7c-92c2-41f3-9f88-913692b18280-kube-api-access-ggns2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w\" (UID: \"2b53ee7c-92c2-41f3-9f88-913692b18280\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.533553 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.533496 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:29:29.668812 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.668788 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w"] Jun 05 03:29:29.670608 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:29:29.670577 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b53ee7c_92c2_41f3_9f88_913692b18280.slice/crio-334e78461251c4cb1502fccfdf7766309198db79e2d555c878f6d6118a547922 WatchSource:0}: Error finding container 334e78461251c4cb1502fccfdf7766309198db79e2d555c878f6d6118a547922: Status 404 returned error can't find the container with id 334e78461251c4cb1502fccfdf7766309198db79e2d555c878f6d6118a547922 Jun 05 03:29:29.901396 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.901360 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" event={"ID":"2b53ee7c-92c2-41f3-9f88-913692b18280","Type":"ContainerStarted","Data":"6ca369eb1322cd39b8ab6359ba3c2b896393219ca74d8984ebfcc364b56b49ea"} Jun 05 03:29:29.901603 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:29.901416 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" event={"ID":"2b53ee7c-92c2-41f3-9f88-913692b18280","Type":"ContainerStarted","Data":"334e78461251c4cb1502fccfdf7766309198db79e2d555c878f6d6118a547922"} Jun 05 03:29:39.960118 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:39.960084 2552 generic.go:356] "Generic (PLEG): container finished" podID="4294bccb-5ccf-4389-aaa3-b079188bd866" containerID="4386eb703f2588187df41a1c4477e153df4945a6eb1de44f32619224bd43ea68" exitCode=0 Jun 05 03:29:39.960532 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:39.960139 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" event={"ID":"4294bccb-5ccf-4389-aaa3-b079188bd866","Type":"ContainerDied","Data":"4386eb703f2588187df41a1c4477e153df4945a6eb1de44f32619224bd43ea68"} Jun 05 03:29:41.974091 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:41.974059 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" event={"ID":"4294bccb-5ccf-4389-aaa3-b079188bd866","Type":"ContainerStarted","Data":"724f66b7d0d25c7af7f9bd6eb8418769c885cc8ac8e572145ac755d4bdcc782f"} Jun 05 03:29:41.992909 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:41.992861 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" podStartSLOduration=2.308519895 podStartE2EDuration="59.992847597s" totalImagesPullingTime="4.89435905s" totalInitContainerRuntime="52.789968652s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:28:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:29:41.989835248 +0000 UTC m=+671.160345362" watchObservedRunningTime="2026-06-05 03:29:41.992847597 +0000 UTC m=+671.163357698" Jun 05 03:29:43.025733 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:43.025702 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:29:43.026203 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:43.026034 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:29:43.038420 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:43.038399 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:29:43.997239 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:29:43.997208 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg" Jun 05 03:30:25.226181 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:25.226149 2552 generic.go:356] "Generic (PLEG): container finished" podID="2b53ee7c-92c2-41f3-9f88-913692b18280" containerID="6ca369eb1322cd39b8ab6359ba3c2b896393219ca74d8984ebfcc364b56b49ea" exitCode=0 Jun 05 03:30:25.226615 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:25.226219 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" event={"ID":"2b53ee7c-92c2-41f3-9f88-913692b18280","Type":"ContainerDied","Data":"6ca369eb1322cd39b8ab6359ba3c2b896393219ca74d8984ebfcc364b56b49ea"} Jun 05 03:30:26.234530 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:26.234496 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" event={"ID":"2b53ee7c-92c2-41f3-9f88-913692b18280","Type":"ContainerStarted","Data":"fe265ad5a9901dc2b84818bb7393afc0fd2ac7020389e5b5b750338e4549be62"} Jun 05 03:30:26.252714 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:26.252668 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" podStartSLOduration=2.582595183 podStartE2EDuration="57.25265542s" totalImagesPullingTime="181.541372ms" totalInitContainerRuntime="54.488518865s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:30:26.250584728 +0000 UTC m=+715.421094828" watchObservedRunningTime="2026-06-05 03:30:26.25265542 +0000 UTC m=+715.423165520" Jun 05 03:30:29.534549 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:29.534523 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:30:29.534922 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:29.534599 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:30:29.546511 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:29.546491 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:30:30.270939 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:30:30.270910 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w" Jun 05 03:32:39.702714 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:39.702671 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d79495cc9-7l5wq"] Jun 05 03:32:39.703227 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:39.702861 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" podUID="82566d7b-e7c9-4ecf-9e12-a568b43e5dd9" containerName="manager" containerID="cri-o://dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5" gracePeriod=30 Jun 05 03:32:39.950095 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:39.950071 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:32:39.959582 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:39.959527 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chcn8\" (UniqueName: \"kubernetes.io/projected/82566d7b-e7c9-4ecf-9e12-a568b43e5dd9-kube-api-access-chcn8\") pod \"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9\" (UID: \"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9\") " Jun 05 03:32:39.961699 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:39.961666 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82566d7b-e7c9-4ecf-9e12-a568b43e5dd9-kube-api-access-chcn8" (OuterVolumeSpecName: "kube-api-access-chcn8") pod "82566d7b-e7c9-4ecf-9e12-a568b43e5dd9" (UID: "82566d7b-e7c9-4ecf-9e12-a568b43e5dd9"). InnerVolumeSpecName "kube-api-access-chcn8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:32:40.022198 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.022171 2552 generic.go:356] "Generic (PLEG): container finished" podID="82566d7b-e7c9-4ecf-9e12-a568b43e5dd9" containerID="dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5" exitCode=0 Jun 05 03:32:40.022365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.022214 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" Jun 05 03:32:40.022365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.022240 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" event={"ID":"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9","Type":"ContainerDied","Data":"dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5"} Jun 05 03:32:40.022365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.022281 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79495cc9-7l5wq" event={"ID":"82566d7b-e7c9-4ecf-9e12-a568b43e5dd9","Type":"ContainerDied","Data":"d59012bcb5524700a9cbc52347439adec077ffd16bc0f3a8d71720619835a27f"} Jun 05 03:32:40.022365 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.022303 2552 scope.go:117] "RemoveContainer" containerID="dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5" Jun 05 03:32:40.031271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.031255 2552 scope.go:117] "RemoveContainer" containerID="dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5" Jun 05 03:32:40.031524 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:32:40.031508 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5\": container with ID starting with dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5 not found: ID does not exist" containerID="dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5" Jun 05 03:32:40.031581 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.031532 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5"} err="failed to get container status \"dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5\": rpc error: code = NotFound desc = could not find container \"dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5\": container with ID starting with dff3bfc662fb9d59cf20f1aaf7ae27c790792c4491a5ad840a715c9415562be5 not found: ID does not exist" Jun 05 03:32:40.042948 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.042929 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d79495cc9-7l5wq"] Jun 05 03:32:40.046188 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.046170 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d79495cc9-7l5wq"] Jun 05 03:32:40.061192 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:40.061169 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chcn8\" (UniqueName: \"kubernetes.io/projected/82566d7b-e7c9-4ecf-9e12-a568b43e5dd9-kube-api-access-chcn8\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:32:41.155579 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.155546 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d79495cc9-6q9qp"] Jun 05 03:32:41.156024 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.155934 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82566d7b-e7c9-4ecf-9e12-a568b43e5dd9" containerName="manager" Jun 05 03:32:41.156024 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.155944 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="82566d7b-e7c9-4ecf-9e12-a568b43e5dd9" containerName="manager" Jun 05 03:32:41.156024 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.156006 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="82566d7b-e7c9-4ecf-9e12-a568b43e5dd9" containerName="manager" Jun 05 03:32:41.160392 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.160375 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79495cc9-6q9qp" Jun 05 03:32:41.162744 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.162511 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5bbd8\"" Jun 05 03:32:41.163195 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.163172 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 05 03:32:41.165770 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.165747 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d79495cc9-6q9qp"] Jun 05 03:32:41.168189 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.168165 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjnv\" (UniqueName: \"kubernetes.io/projected/9dc9015f-3461-4cda-b5c3-066d298f6b11-kube-api-access-2zjnv\") pod \"maas-controller-5d79495cc9-6q9qp\" (UID: \"9dc9015f-3461-4cda-b5c3-066d298f6b11\") " pod="opendatahub/maas-controller-5d79495cc9-6q9qp" Jun 05 03:32:41.273873 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.273844 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjnv\" (UniqueName: \"kubernetes.io/projected/9dc9015f-3461-4cda-b5c3-066d298f6b11-kube-api-access-2zjnv\") pod \"maas-controller-5d79495cc9-6q9qp\" (UID: \"9dc9015f-3461-4cda-b5c3-066d298f6b11\") " pod="opendatahub/maas-controller-5d79495cc9-6q9qp" Jun 05 03:32:41.281174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.281153 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjnv\" (UniqueName: \"kubernetes.io/projected/9dc9015f-3461-4cda-b5c3-066d298f6b11-kube-api-access-2zjnv\") pod \"maas-controller-5d79495cc9-6q9qp\" (UID: \"9dc9015f-3461-4cda-b5c3-066d298f6b11\") " pod="opendatahub/maas-controller-5d79495cc9-6q9qp" Jun 05 03:32:41.293072 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.293049 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82566d7b-e7c9-4ecf-9e12-a568b43e5dd9" path="/var/lib/kubelet/pods/82566d7b-e7c9-4ecf-9e12-a568b43e5dd9/volumes" Jun 05 03:32:41.472516 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.472445 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d79495cc9-6q9qp" Jun 05 03:32:41.607512 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:41.607487 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d79495cc9-6q9qp"] Jun 05 03:32:41.608470 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:32:41.608445 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc9015f_3461_4cda_b5c3_066d298f6b11.slice/crio-06b79ae56cfcfec9bd7fa4fe8a0e41a1d7a3eb4b479d65d566979d0330acd511 WatchSource:0}: Error finding container 06b79ae56cfcfec9bd7fa4fe8a0e41a1d7a3eb4b479d65d566979d0330acd511: Status 404 returned error can't find the container with id 06b79ae56cfcfec9bd7fa4fe8a0e41a1d7a3eb4b479d65d566979d0330acd511 Jun 05 03:32:42.035567 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:42.035529 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79495cc9-6q9qp" event={"ID":"9dc9015f-3461-4cda-b5c3-066d298f6b11","Type":"ContainerStarted","Data":"06b79ae56cfcfec9bd7fa4fe8a0e41a1d7a3eb4b479d65d566979d0330acd511"} Jun 05 03:32:43.043341 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:43.043292 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d79495cc9-6q9qp" event={"ID":"9dc9015f-3461-4cda-b5c3-066d298f6b11","Type":"ContainerStarted","Data":"df8c8109129bf53b34f9e3dee7820e0574ea4c5f25794d86d896ffbf7d1bc5c7"} Jun 05 03:32:43.043728 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:43.043369 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d79495cc9-6q9qp" Jun 05 03:32:43.062537 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:43.062496 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d79495cc9-6q9qp" podStartSLOduration=1.4845467079999999 podStartE2EDuration="2.062481985s" totalImagesPullingTime="577.935277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:32:43.060144747 +0000 UTC m=+852.230654849" watchObservedRunningTime="2026-06-05 03:32:43.062481985 +0000 UTC m=+852.232992123" Jun 05 03:32:54.055445 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:32:54.055413 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d79495cc9-6q9qp" Jun 05 03:42:58.940197 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:42:58.940115 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v"] Jun 05 03:42:58.940785 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:42:58.940335 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" podUID="a2a75cf6-80c9-49cd-bc20-411ae35f20a0" containerName="manager" containerID="cri-o://41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb" gracePeriod=10 Jun 05 03:42:59.881640 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:42:59.881613 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:43:00.009029 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.008946 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-extensions-socket-volume\") pod \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " Jun 05 03:43:00.009029 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.009011 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w77dg\" (UniqueName: \"kubernetes.io/projected/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-kube-api-access-w77dg\") pod \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\" (UID: \"a2a75cf6-80c9-49cd-bc20-411ae35f20a0\") " Jun 05 03:43:00.009418 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.009283 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a2a75cf6-80c9-49cd-bc20-411ae35f20a0" (UID: "a2a75cf6-80c9-49cd-bc20-411ae35f20a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:43:00.010884 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.010864 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-kube-api-access-w77dg" (OuterVolumeSpecName: "kube-api-access-w77dg") pod "a2a75cf6-80c9-49cd-bc20-411ae35f20a0" (UID: "a2a75cf6-80c9-49cd-bc20-411ae35f20a0"). InnerVolumeSpecName "kube-api-access-w77dg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:43:00.110264 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.110226 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-extensions-socket-volume\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:43:00.110264 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.110260 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w77dg\" (UniqueName: \"kubernetes.io/projected/a2a75cf6-80c9-49cd-bc20-411ae35f20a0-kube-api-access-w77dg\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:43:00.661338 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.661268 2552 generic.go:356] "Generic (PLEG): container finished" podID="a2a75cf6-80c9-49cd-bc20-411ae35f20a0" containerID="41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb" exitCode=0 Jun 05 03:43:00.661555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.661355 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" Jun 05 03:43:00.661555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.661354 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" event={"ID":"a2a75cf6-80c9-49cd-bc20-411ae35f20a0","Type":"ContainerDied","Data":"41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb"} Jun 05 03:43:00.661555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.661421 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v" event={"ID":"a2a75cf6-80c9-49cd-bc20-411ae35f20a0","Type":"ContainerDied","Data":"7ac5c435fa5969e91d4abdd1df60a09b86d23b97c26c90e421a6500d721a3e0d"} Jun 05 03:43:00.661555 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.661454 2552 scope.go:117] "RemoveContainer" containerID="41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb" Jun 05 03:43:00.671303 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.671286 2552 scope.go:117] "RemoveContainer" containerID="41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb" Jun 05 03:43:00.671583 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:43:00.671562 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb\": container with ID starting with 41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb not found: ID does not exist" containerID="41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb" Jun 05 03:43:00.671654 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.671590 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb"} err="failed to get container status \"41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb\": rpc error: code = NotFound desc = could not find container \"41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb\": container with ID starting with 41faf0893269bf6a02b220d2eca74707ebc3c420ec3b4d7c5fc7837259a4c3fb not found: ID does not exist" Jun 05 03:43:00.683521 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.683494 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v"] Jun 05 03:43:00.686646 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:00.686624 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5fs8v"] Jun 05 03:43:01.292016 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:43:01.291984 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2a75cf6-80c9-49cd-bc20-411ae35f20a0" path="/var/lib/kubelet/pods/a2a75cf6-80c9-49cd-bc20-411ae35f20a0/volumes" Jun 05 03:44:05.025457 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.025373 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825"] Jun 05 03:44:05.025924 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.025773 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2a75cf6-80c9-49cd-bc20-411ae35f20a0" containerName="manager" Jun 05 03:44:05.025924 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.025783 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2a75cf6-80c9-49cd-bc20-411ae35f20a0" containerName="manager" Jun 05 03:44:05.025924 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.025858 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2a75cf6-80c9-49cd-bc20-411ae35f20a0" containerName="manager" Jun 05 03:44:05.028802 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.028786 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.031105 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.031086 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h2smm\"" Jun 05 03:44:05.038934 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.038907 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825"] Jun 05 03:44:05.120405 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.120381 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/411dfc91-f95a-4d60-88b6-7f840e909c13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6l825\" (UID: \"411dfc91-f95a-4d60-88b6-7f840e909c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.120514 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.120429 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffdt8\" (UniqueName: \"kubernetes.io/projected/411dfc91-f95a-4d60-88b6-7f840e909c13-kube-api-access-ffdt8\") pod \"kuadrant-operator-controller-manager-86878c769f-6l825\" (UID: \"411dfc91-f95a-4d60-88b6-7f840e909c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.221576 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.221550 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/411dfc91-f95a-4d60-88b6-7f840e909c13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6l825\" (UID: \"411dfc91-f95a-4d60-88b6-7f840e909c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.221685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.221593 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffdt8\" (UniqueName: \"kubernetes.io/projected/411dfc91-f95a-4d60-88b6-7f840e909c13-kube-api-access-ffdt8\") pod \"kuadrant-operator-controller-manager-86878c769f-6l825\" (UID: \"411dfc91-f95a-4d60-88b6-7f840e909c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.221953 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.221931 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/411dfc91-f95a-4d60-88b6-7f840e909c13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6l825\" (UID: \"411dfc91-f95a-4d60-88b6-7f840e909c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.230171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.230152 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffdt8\" (UniqueName: \"kubernetes.io/projected/411dfc91-f95a-4d60-88b6-7f840e909c13-kube-api-access-ffdt8\") pod \"kuadrant-operator-controller-manager-86878c769f-6l825\" (UID: \"411dfc91-f95a-4d60-88b6-7f840e909c13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.339675 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.339654 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:05.475425 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:05.475399 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825"] Jun 05 03:44:05.476564 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:44:05.476531 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411dfc91_f95a_4d60_88b6_7f840e909c13.slice/crio-d92b11de2100e5abcebbc3e9d5947522c6953e67ad8da80efdfefc230f159b91 WatchSource:0}: Error finding container d92b11de2100e5abcebbc3e9d5947522c6953e67ad8da80efdfefc230f159b91: Status 404 returned error can't find the container with id d92b11de2100e5abcebbc3e9d5947522c6953e67ad8da80efdfefc230f159b91 Jun 05 03:44:06.057640 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:06.057591 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" event={"ID":"411dfc91-f95a-4d60-88b6-7f840e909c13","Type":"ContainerStarted","Data":"2b48ec1c17a093025f2a023c58c89be586ba0ca12dcff70012d5d8b91e77c4dd"} Jun 05 03:44:06.058056 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:06.057681 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" event={"ID":"411dfc91-f95a-4d60-88b6-7f840e909c13","Type":"ContainerStarted","Data":"d92b11de2100e5abcebbc3e9d5947522c6953e67ad8da80efdfefc230f159b91"} Jun 05 03:44:06.058056 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:06.057709 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:44:06.078002 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:06.077955 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" podStartSLOduration=1.077941769 podStartE2EDuration="1.077941769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:44:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:44:06.075359203 +0000 UTC m=+1535.245869330" watchObservedRunningTime="2026-06-05 03:44:06.077941769 +0000 UTC m=+1535.248451870" Jun 05 03:44:17.066079 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:44:17.066048 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6l825" Jun 05 03:53:56.922803 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:56.922766 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4"] Jun 05 03:53:56.926684 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:56.926667 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:56.929046 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:56.929014 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-287c300b-openshift-default-dockercfg-kv9jg\"" Jun 05 03:53:56.941881 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:56.941856 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4"] Jun 05 03:53:57.094284 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094255 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-podinfo\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094472 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094296 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-token\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094472 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094344 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-socket\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094472 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094420 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-credential-socket\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094472 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094468 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-data\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094698 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094504 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-certs\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094698 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094548 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-envoy\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094698 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istiod-ca-cert\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.094698 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.094604 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfc64\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-kube-api-access-sfc64\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.195585 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-certs\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.195585 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195551 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-envoy\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.195585 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195580 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istiod-ca-cert\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.195788 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfc64\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-kube-api-access-sfc64\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.195836 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195793 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-podinfo\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.195898 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195848 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-token\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.195898 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195887 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-socket\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.196000 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195928 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-certs\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.196000 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.195954 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-credential-socket\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.196106 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.196002 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-data\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.196259 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.196214 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-socket\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.196419 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.196308 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-credential-socket\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.196419 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.196372 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-data\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.196419 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.196385 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istiod-ca-cert\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.198040 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.198016 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-envoy\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.198140 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.198090 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-podinfo\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.203185 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.203163 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-token\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.203699 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.203678 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfc64\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-kube-api-access-sfc64\") pod \"e2e-ait-287c300b-openshift-default-6589749c68-4cjj4\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.237672 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.237650 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:57.379666 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.379641 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4"] Jun 05 03:53:57.380737 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:53:57.380701 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0082c32_c691_4bcd_8ebd_9ede276cf4db.slice/crio-372174a25187e37a3b170939b4129fb01c2bafa6c9fba079e1fde7621c4036aa WatchSource:0}: Error finding container 372174a25187e37a3b170939b4129fb01c2bafa6c9fba079e1fde7621c4036aa: Status 404 returned error can't find the container with id 372174a25187e37a3b170939b4129fb01c2bafa6c9fba079e1fde7621c4036aa Jun 05 03:53:57.383181 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.383146 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:53:57.383264 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.383210 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:53:57.383264 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.383236 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:53:57.496645 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.496613 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" event={"ID":"c0082c32-c691-4bcd-8ebd-9ede276cf4db","Type":"ContainerStarted","Data":"7a70dfcad7619c864dee0ec9aa7ceaaaa618d50796b3218fe8fbb97ea06255dc"} Jun 05 03:53:57.496802 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.496665 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" event={"ID":"c0082c32-c691-4bcd-8ebd-9ede276cf4db","Type":"ContainerStarted","Data":"372174a25187e37a3b170939b4129fb01c2bafa6c9fba079e1fde7621c4036aa"} Jun 05 03:53:57.517432 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:57.517381 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" podStartSLOduration=1.517361822 podStartE2EDuration="1.517361822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:53:57.513584842 +0000 UTC m=+2126.684094944" watchObservedRunningTime="2026-06-05 03:53:57.517361822 +0000 UTC m=+2126.687871924" Jun 05 03:53:58.238682 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:58.238651 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:58.244470 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:58.244446 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:58.502183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:58.502115 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:53:58.503104 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:53:58.503086 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:54:03.400509 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:03.400477 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4"] Jun 05 03:54:03.400952 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:03.400649 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" podUID="c0082c32-c691-4bcd-8ebd-9ede276cf4db" containerName="istio-proxy" containerID="cri-o://7a70dfcad7619c864dee0ec9aa7ceaaaa618d50796b3218fe8fbb97ea06255dc" gracePeriod=30 Jun 05 03:54:08.566414 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.566381 2552 generic.go:356] "Generic (PLEG): container finished" podID="c0082c32-c691-4bcd-8ebd-9ede276cf4db" containerID="7a70dfcad7619c864dee0ec9aa7ceaaaa618d50796b3218fe8fbb97ea06255dc" exitCode=0 Jun 05 03:54:08.566774 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.566460 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" event={"ID":"c0082c32-c691-4bcd-8ebd-9ede276cf4db","Type":"ContainerDied","Data":"7a70dfcad7619c864dee0ec9aa7ceaaaa618d50796b3218fe8fbb97ea06255dc"} Jun 05 03:54:08.656751 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.656723 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:54:08.695861 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.695792 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-podinfo\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.695861 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.695834 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-certs\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.695872 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-credential-socket\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.695896 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-data\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.695923 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-token\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.695945 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-envoy\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.695979 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-socket\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696007 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istiod-ca-cert\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696055 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696041 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfc64\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-kube-api-access-sfc64\") pod \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\" (UID: \"c0082c32-c691-4bcd-8ebd-9ede276cf4db\") " Jun 05 03:54:08.696460 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696195 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:08.696460 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696207 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:08.696460 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696218 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:08.696460 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696369 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:08.696685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696483 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-credential-socket\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.696685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696501 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-data\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.696685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696515 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-socket\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.696685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696530 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-workload-certs\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.696685 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.696552 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:54:08.698426 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.698391 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 03:54:08.698526 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.698476 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:08.698572 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.698540 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-kube-api-access-sfc64" (OuterVolumeSpecName: "kube-api-access-sfc64") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "kube-api-access-sfc64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:08.698572 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.698546 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0082c32-c691-4bcd-8ebd-9ede276cf4db" (UID: "c0082c32-c691-4bcd-8ebd-9ede276cf4db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:08.797064 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.797031 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-token\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.797064 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.797060 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-envoy\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.797064 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.797069 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istiod-ca-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.797277 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.797077 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfc64\" (UniqueName: \"kubernetes.io/projected/c0082c32-c691-4bcd-8ebd-9ede276cf4db-kube-api-access-sfc64\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:08.797277 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:08.797086 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0082c32-c691-4bcd-8ebd-9ede276cf4db-istio-podinfo\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:09.513520 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.513489 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p"] Jun 05 03:54:09.513960 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.513943 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0082c32-c691-4bcd-8ebd-9ede276cf4db" containerName="istio-proxy" Jun 05 03:54:09.514054 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.513962 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0082c32-c691-4bcd-8ebd-9ede276cf4db" containerName="istio-proxy" Jun 05 03:54:09.514111 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.514064 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0082c32-c691-4bcd-8ebd-9ede276cf4db" containerName="istio-proxy" Jun 05 03:54:09.517435 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.517415 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.519804 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.519788 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d3f80c87-openshift-default-dockercfg-f69fq\"" Jun 05 03:54:09.533354 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.533332 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p"] Jun 05 03:54:09.575230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.575126 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" Jun 05 03:54:09.575230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.575160 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4" event={"ID":"c0082c32-c691-4bcd-8ebd-9ede276cf4db","Type":"ContainerDied","Data":"372174a25187e37a3b170939b4129fb01c2bafa6c9fba079e1fde7621c4036aa"} Jun 05 03:54:09.575230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.575213 2552 scope.go:117] "RemoveContainer" containerID="7a70dfcad7619c864dee0ec9aa7ceaaaa618d50796b3218fe8fbb97ea06255dc" Jun 05 03:54:09.595013 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.594990 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4"] Jun 05 03:54:09.600352 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.600327 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-287c300b-openshift-default-6589749c68-4cjj4"] Jun 05 03:54:09.603081 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istiod-ca-cert\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603147 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603100 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-credential-socket\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603147 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603122 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-envoy\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603147 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603137 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-podinfo\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603268 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9kd\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-kube-api-access-jv9kd\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603268 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603190 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-socket\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603268 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603204 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-token\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603268 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603248 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-certs\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.603414 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.603293 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-data\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704029 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704000 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-credential-socket\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704037 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-envoy\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704054 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-podinfo\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704070 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9kd\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-kube-api-access-jv9kd\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704135 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-socket\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704174 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704159 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-token\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704476 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704187 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-certs\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704476 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704233 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-data\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704476 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704297 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istiod-ca-cert\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704597 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704535 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-credential-socket\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704699 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704676 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-socket\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704774 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704753 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-data\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.704836 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704814 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-certs\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.705004 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.704989 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istiod-ca-cert\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.706230 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.706211 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-envoy\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.706545 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.706530 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-podinfo\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.720764 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.720737 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9kd\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-kube-api-access-jv9kd\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.720901 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.720798 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-token\") pod \"e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.827765 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.827699 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:09.962684 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.962662 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p"] Jun 05 03:54:09.963856 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:54:09.963834 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1180e7_b57b_4475_8b85_a8d1077cde2f.slice/crio-8f0ac83a3f5df316e751d9cdb9d6d3c19375190600fe347b47c1a41f659cb38e WatchSource:0}: Error finding container 8f0ac83a3f5df316e751d9cdb9d6d3c19375190600fe347b47c1a41f659cb38e: Status 404 returned error can't find the container with id 8f0ac83a3f5df316e751d9cdb9d6d3c19375190600fe347b47c1a41f659cb38e Jun 05 03:54:09.966047 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.966011 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:54:09.966138 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.966076 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:54:09.966138 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:09.966101 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 05 03:54:10.583451 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:10.583409 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" event={"ID":"aa1180e7-b57b-4475-8b85-a8d1077cde2f","Type":"ContainerStarted","Data":"0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0"} Jun 05 03:54:10.583863 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:10.583474 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" event={"ID":"aa1180e7-b57b-4475-8b85-a8d1077cde2f","Type":"ContainerStarted","Data":"8f0ac83a3f5df316e751d9cdb9d6d3c19375190600fe347b47c1a41f659cb38e"} Jun 05 03:54:10.609589 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:10.609540 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" podStartSLOduration=1.609521869 podStartE2EDuration="1.609521869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 03:54:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:54:10.607226766 +0000 UTC m=+2139.777736878" watchObservedRunningTime="2026-06-05 03:54:10.609521869 +0000 UTC m=+2139.780031969" Jun 05 03:54:10.828443 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:10.828411 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:11.292806 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:11.292762 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0082c32-c691-4bcd-8ebd-9ede276cf4db" path="/var/lib/kubelet/pods/c0082c32-c691-4bcd-8ebd-9ede276cf4db/volumes" Jun 05 03:54:11.833481 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:11.833451 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:12.596056 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:12.596024 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:12.597588 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:12.597562 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:17.023102 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:17.023068 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p"] Jun 05 03:54:17.023531 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:17.023272 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" podUID="aa1180e7-b57b-4475-8b85-a8d1077cde2f" containerName="istio-proxy" containerID="cri-o://0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0" gracePeriod=30 Jun 05 03:54:22.276577 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.276552 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:22.307496 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307468 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-socket\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.307603 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307557 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-token\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.307641 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307599 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-podinfo\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.307641 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307606 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:22.307641 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307628 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-data\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.307784 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307763 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-envoy\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.307832 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307803 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-credential-socket\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.307881 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307850 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istiod-ca-cert\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.307939 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307873 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:22.307997 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.307950 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-certs\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.308053 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308004 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jv9kd\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-kube-api-access-jv9kd\") pod \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\" (UID: \"aa1180e7-b57b-4475-8b85-a8d1077cde2f\") " Jun 05 03:54:22.308137 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308113 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:22.308281 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308259 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:22.308429 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308189 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 03:54:22.308503 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308434 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-data\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.308503 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308457 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-credential-socket\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.308503 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308472 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istiod-ca-cert\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.308503 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308487 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-certs\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.308503 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.308501 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-workload-socket\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.309895 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.309871 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:22.310183 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.310163 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 03:54:22.310415 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.310392 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 03:54:22.310610 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.310593 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-kube-api-access-jv9kd" (OuterVolumeSpecName: "kube-api-access-jv9kd") pod "aa1180e7-b57b-4475-8b85-a8d1077cde2f" (UID: "aa1180e7-b57b-4475-8b85-a8d1077cde2f"). InnerVolumeSpecName "kube-api-access-jv9kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 03:54:22.409051 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.409024 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-token\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.409051 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.409047 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-podinfo\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.409201 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.409056 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa1180e7-b57b-4475-8b85-a8d1077cde2f-istio-envoy\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.409201 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.409065 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jv9kd\" (UniqueName: \"kubernetes.io/projected/aa1180e7-b57b-4475-8b85-a8d1077cde2f-kube-api-access-jv9kd\") on node \"ip-10-0-141-163.ec2.internal\" DevicePath \"\"" Jun 05 03:54:22.658624 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.658542 2552 generic.go:356] "Generic (PLEG): container finished" podID="aa1180e7-b57b-4475-8b85-a8d1077cde2f" containerID="0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0" exitCode=0 Jun 05 03:54:22.658624 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.658592 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" Jun 05 03:54:22.658778 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.658625 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" event={"ID":"aa1180e7-b57b-4475-8b85-a8d1077cde2f","Type":"ContainerDied","Data":"0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0"} Jun 05 03:54:22.658778 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.658680 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p" event={"ID":"aa1180e7-b57b-4475-8b85-a8d1077cde2f","Type":"ContainerDied","Data":"8f0ac83a3f5df316e751d9cdb9d6d3c19375190600fe347b47c1a41f659cb38e"} Jun 05 03:54:22.658778 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.658701 2552 scope.go:117] "RemoveContainer" containerID="0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0" Jun 05 03:54:22.669168 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.669149 2552 scope.go:117] "RemoveContainer" containerID="0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0" Jun 05 03:54:22.669539 ip-10-0-141-163 kubenswrapper[2552]: E0605 03:54:22.669502 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0\": container with ID starting with 0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0 not found: ID does not exist" containerID="0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0" Jun 05 03:54:22.669637 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.669551 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0"} err="failed to get container status \"0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0\": rpc error: code = NotFound desc = could not find container \"0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0\": container with ID starting with 0b5abf6ca8e78e454c4e6f76b9b8c09cf1295b77b137204d71e7382ac8c3aae0 not found: ID does not exist" Jun 05 03:54:22.680616 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.680584 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p"] Jun 05 03:54:22.683440 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:22.683418 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d3f80c87-openshift-default-7f9f8f7cb8-2g84p"] Jun 05 03:54:23.291444 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:23.291416 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa1180e7-b57b-4475-8b85-a8d1077cde2f" path="/var/lib/kubelet/pods/aa1180e7-b57b-4475-8b85-a8d1077cde2f/volumes" Jun 05 03:54:35.055862 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:35.055829 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-68fd4ddf97-grh4k_62b78551-8f23-46ec-87ca-414cc5ec46fa/nginx/0.log" Jun 05 03:54:35.290271 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:35.290238 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p5x2f_4f9c839b-8ff7-4ee0-ae36-54602d7865c7/manager/0.log" Jun 05 03:54:35.406337 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:35.406248 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b68b6f647-xx8jc_4a5882ff-d92c-4b36-bd9a-a8ec838441fd/maas-api/0.log" Jun 05 03:54:35.634945 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:35.634917 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d79495cc9-6q9qp_9dc9015f-3461-4cda-b5c3-066d298f6b11/manager/0.log" Jun 05 03:54:36.105733 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:36.105706 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdb887f5b-7m6zc_868f2bcb-d394-42fd-af82-280991960096/copy-manifests/0.log" Jun 05 03:54:36.118418 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:36.118393 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdb887f5b-7m6zc_868f2bcb-d394-42fd-af82-280991960096/manager/0.log" Jun 05 03:54:37.139449 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.139419 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn_5bd48e5b-82b3-47fa-aa4e-f9947a45e17f/pull/0.log" Jun 05 03:54:37.145579 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.145553 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn_5bd48e5b-82b3-47fa-aa4e-f9947a45e17f/extract/0.log" Jun 05 03:54:37.151401 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.151383 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn_5bd48e5b-82b3-47fa-aa4e-f9947a45e17f/util/0.log" Jun 05 03:54:37.265058 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.265039 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg_423a5171-328d-42ca-83cc-36e9361f9aba/pull/0.log" Jun 05 03:54:37.271226 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.271208 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg_423a5171-328d-42ca-83cc-36e9361f9aba/extract/0.log" Jun 05 03:54:37.276448 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.276430 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg_423a5171-328d-42ca-83cc-36e9361f9aba/util/0.log" Jun 05 03:54:37.388160 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.388138 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766_b80807d1-729a-4609-9544-0ac91c43a7bf/util/0.log" Jun 05 03:54:37.394302 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.394248 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766_b80807d1-729a-4609-9544-0ac91c43a7bf/pull/0.log" Jun 05 03:54:37.400297 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.400279 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766_b80807d1-729a-4609-9544-0ac91c43a7bf/extract/0.log" Jun 05 03:54:37.518784 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.518755 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5_9139143a-6bd3-49cc-ab04-de0d6f9156eb/util/0.log" Jun 05 03:54:37.524637 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.524617 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5_9139143a-6bd3-49cc-ab04-de0d6f9156eb/pull/0.log" Jun 05 03:54:37.530229 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.530211 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5_9139143a-6bd3-49cc-ab04-de0d6f9156eb/extract/0.log" Jun 05 03:54:37.890702 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:37.890673 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mxljj_5a779663-70fd-4b67-863c-ae365c39e780/manager/0.log" Jun 05 03:54:38.124974 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:38.124941 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pn22d_95474b49-17df-4ec2-8ea9-e48a9f88cb4b/registry-server/0.log" Jun 05 03:54:38.252986 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:38.252912 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6l825_411dfc91-f95a-4d60-88b6-7f840e909c13/manager/0.log" Jun 05 03:54:38.484738 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:38.484709 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fz2vw_9bc84a97-fa92-42b3-80ff-bc9d5e908a4f/manager/0.log" Jun 05 03:54:38.833641 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:38.833617 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sld7m_93bcf597-62fa-4ece-a90d-dba258ba1bae/istio-proxy/0.log" Jun 05 03:54:39.290726 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:39.290635 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/1.log" Jun 05 03:54:39.408560 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:39.408531 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gq5zt_c5ea08c8-2c06-406c-a739-821a5e438c52/payload-pre-processing/0.log" Jun 05 03:54:39.998072 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:39.998041 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg_4294bccb-5ccf-4389-aaa3-b079188bd866/storage-initializer/0.log" Jun 05 03:54:40.004533 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:40.004505 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2zdcg_4294bccb-5ccf-4389-aaa3-b079188bd866/main/0.log" Jun 05 03:54:40.350633 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:40.350605 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w_2b53ee7c-92c2-41f3-9f88-913692b18280/storage-initializer/0.log" Jun 05 03:54:40.357153 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:40.357128 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbbq4w_2b53ee7c-92c2-41f3-9f88-913692b18280/main/0.log" Jun 05 03:54:47.613804 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:47.613771 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n4pkr_0daf59cc-ca3b-4fb3-9ed1-a9a5c00e7a77/global-pull-secret-syncer/0.log" Jun 05 03:54:47.696412 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:47.696379 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8bdvk_3b036654-91b4-402c-ab0f-0c27ef5e6c70/konnectivity-agent/0.log" Jun 05 03:54:47.802794 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:47.802767 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-163.ec2.internal_49c44bd4a09b4e406135cc261d566b38/haproxy/0.log" Jun 05 03:54:52.444587 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.444539 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn_5bd48e5b-82b3-47fa-aa4e-f9947a45e17f/extract/0.log" Jun 05 03:54:52.468963 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.468938 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn_5bd48e5b-82b3-47fa-aa4e-f9947a45e17f/util/0.log" Jun 05 03:54:52.489631 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.489595 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nxhtn_5bd48e5b-82b3-47fa-aa4e-f9947a45e17f/pull/0.log" Jun 05 03:54:52.518401 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.518378 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg_423a5171-328d-42ca-83cc-36e9361f9aba/extract/0.log" Jun 05 03:54:52.542693 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.542675 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg_423a5171-328d-42ca-83cc-36e9361f9aba/util/0.log" Jun 05 03:54:52.564211 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.564194 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dg6kg_423a5171-328d-42ca-83cc-36e9361f9aba/pull/0.log" Jun 05 03:54:52.590813 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.590796 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766_b80807d1-729a-4609-9544-0ac91c43a7bf/extract/0.log" Jun 05 03:54:52.612554 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.612527 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766_b80807d1-729a-4609-9544-0ac91c43a7bf/util/0.log" Jun 05 03:54:52.634668 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.634651 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lz766_b80807d1-729a-4609-9544-0ac91c43a7bf/pull/0.log" Jun 05 03:54:52.662900 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.662883 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5_9139143a-6bd3-49cc-ab04-de0d6f9156eb/extract/0.log" Jun 05 03:54:52.683966 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.683943 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5_9139143a-6bd3-49cc-ab04-de0d6f9156eb/util/0.log" Jun 05 03:54:52.704494 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:52.704440 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1fm2v5_9139143a-6bd3-49cc-ab04-de0d6f9156eb/pull/0.log" Jun 05 03:54:53.083744 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:53.083717 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mxljj_5a779663-70fd-4b67-863c-ae365c39e780/manager/0.log" Jun 05 03:54:53.154879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:53.154855 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pn22d_95474b49-17df-4ec2-8ea9-e48a9f88cb4b/registry-server/0.log" Jun 05 03:54:53.214768 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:53.214742 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6l825_411dfc91-f95a-4d60-88b6-7f840e909c13/manager/0.log" Jun 05 03:54:53.315584 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:53.315558 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fz2vw_9bc84a97-fa92-42b3-80ff-bc9d5e908a4f/manager/0.log" Jun 05 03:54:54.903514 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:54.903465 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0a403f3-8b04-4256-a23a-f0130cdb9511/alertmanager/0.log" Jun 05 03:54:54.929806 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:54.929785 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0a403f3-8b04-4256-a23a-f0130cdb9511/config-reloader/0.log" Jun 05 03:54:54.955706 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:54.955682 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0a403f3-8b04-4256-a23a-f0130cdb9511/kube-rbac-proxy-web/0.log" Jun 05 03:54:54.978599 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:54.978581 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0a403f3-8b04-4256-a23a-f0130cdb9511/kube-rbac-proxy/0.log" Jun 05 03:54:55.001171 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.001153 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0a403f3-8b04-4256-a23a-f0130cdb9511/kube-rbac-proxy-metric/0.log" Jun 05 03:54:55.023927 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.023910 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0a403f3-8b04-4256-a23a-f0130cdb9511/prom-label-proxy/0.log" Jun 05 03:54:55.047226 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.047205 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0a403f3-8b04-4256-a23a-f0130cdb9511/init-config-reloader/0.log" Jun 05 03:54:55.236403 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.236336 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8mjw5_0d89656e-2a40-45f7-9cf8-c8cd35cd5a61/node-exporter/0.log" Jun 05 03:54:55.259092 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.259074 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8mjw5_0d89656e-2a40-45f7-9cf8-c8cd35cd5a61/kube-rbac-proxy/0.log" Jun 05 03:54:55.285918 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.285899 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8mjw5_0d89656e-2a40-45f7-9cf8-c8cd35cd5a61/init-textfile/0.log" Jun 05 03:54:55.466400 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.466372 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bpzkd_6a6cbe97-b455-4589-b424-e62d8bb044bd/kube-rbac-proxy-main/0.log" Jun 05 03:54:55.489850 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.489775 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bpzkd_6a6cbe97-b455-4589-b424-e62d8bb044bd/kube-rbac-proxy-self/0.log" Jun 05 03:54:55.510375 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.510340 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-bpzkd_6a6cbe97-b455-4589-b424-e62d8bb044bd/openshift-state-metrics/0.log" Jun 05 03:54:55.750481 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.750401 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-hpk95_90719c70-bf9a-4f3c-9cf0-b589bdb1266f/prometheus-operator/0.log" Jun 05 03:54:55.772473 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.772448 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-hpk95_90719c70-bf9a-4f3c-9cf0-b589bdb1266f/kube-rbac-proxy/0.log" Jun 05 03:54:55.943290 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.943268 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b76c5dbb-tw7hj_c01e6ead-3baf-4566-ac81-cc2f012488d2/thanos-query/0.log" Jun 05 03:54:55.974510 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.974485 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b76c5dbb-tw7hj_c01e6ead-3baf-4566-ac81-cc2f012488d2/kube-rbac-proxy-web/0.log" Jun 05 03:54:55.997432 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:55.997411 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b76c5dbb-tw7hj_c01e6ead-3baf-4566-ac81-cc2f012488d2/kube-rbac-proxy/0.log" Jun 05 03:54:56.017712 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:56.017656 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b76c5dbb-tw7hj_c01e6ead-3baf-4566-ac81-cc2f012488d2/prom-label-proxy/0.log" Jun 05 03:54:56.037994 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:56.037972 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b76c5dbb-tw7hj_c01e6ead-3baf-4566-ac81-cc2f012488d2/kube-rbac-proxy-rules/0.log" Jun 05 03:54:56.058061 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:56.058046 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54b76c5dbb-tw7hj_c01e6ead-3baf-4566-ac81-cc2f012488d2/kube-rbac-proxy-metrics/0.log" Jun 05 03:54:58.733180 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:54:58.733149 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-544668dffc-sfdnm_3d652103-a8e7-477a-94df-4bcf68954557/console/0.log" Jun 05 03:55:00.149079 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.149049 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s"] Jun 05 03:55:00.149663 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.149643 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1180e7-b57b-4475-8b85-a8d1077cde2f" containerName="istio-proxy" Jun 05 03:55:00.149755 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.149666 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1180e7-b57b-4475-8b85-a8d1077cde2f" containerName="istio-proxy" Jun 05 03:55:00.149818 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.149761 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1180e7-b57b-4475-8b85-a8d1077cde2f" containerName="istio-proxy" Jun 05 03:55:00.152961 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.152942 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.155217 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.155193 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82kgb\"/\"kube-root-ca.crt\"" Jun 05 03:55:00.155353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.155231 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-82kgb\"/\"openshift-service-ca.crt\"" Jun 05 03:55:00.155353 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.155297 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-82kgb\"/\"default-dockercfg-f6vpn\"" Jun 05 03:55:00.161458 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.161438 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s"] Jun 05 03:55:00.320129 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.320096 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpnvg\" (UniqueName: \"kubernetes.io/projected/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-kube-api-access-vpnvg\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.320267 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.320144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-podres\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.320267 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.320212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-lib-modules\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.320267 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.320233 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-proc\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.320267 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.320249 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-sys\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421439 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421374 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpnvg\" (UniqueName: \"kubernetes.io/projected/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-kube-api-access-vpnvg\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421439 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421418 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-podres\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421599 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421468 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-lib-modules\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421599 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-proc\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421603 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-sys\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421650 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-sys\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421657 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-proc\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421607 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-lib-modules\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.421723 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.421603 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-podres\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.428406 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.428383 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpnvg\" (UniqueName: \"kubernetes.io/projected/a6d31e19-27f7-49e4-a28c-022d7e88a2b9-kube-api-access-vpnvg\") pod \"perf-node-gather-daemonset-xk92s\" (UID: \"a6d31e19-27f7-49e4-a28c-022d7e88a2b9\") " pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.464447 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.464425 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.596454 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.596427 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s"] Jun 05 03:55:00.598265 ip-10-0-141-163 kubenswrapper[2552]: W0605 03:55:00.598238 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda6d31e19_27f7_49e4_a28c_022d7e88a2b9.slice/crio-63fbcaa7464ca0bfa99ed2600ca257b4406a942c173ca787d9e7aba23bea490f WatchSource:0}: Error finding container 63fbcaa7464ca0bfa99ed2600ca257b4406a942c173ca787d9e7aba23bea490f: Status 404 returned error can't find the container with id 63fbcaa7464ca0bfa99ed2600ca257b4406a942c173ca787d9e7aba23bea490f Jun 05 03:55:00.874490 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.874458 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" event={"ID":"a6d31e19-27f7-49e4-a28c-022d7e88a2b9","Type":"ContainerStarted","Data":"922b1cd7a303e9743db9b1ebf55054ce8da23395466090bc4e2e0ae914294d85"} Jun 05 03:55:00.874667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.874514 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" event={"ID":"a6d31e19-27f7-49e4-a28c-022d7e88a2b9","Type":"ContainerStarted","Data":"63fbcaa7464ca0bfa99ed2600ca257b4406a942c173ca787d9e7aba23bea490f"} Jun 05 03:55:00.874667 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.874551 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:00.890670 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.890625 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" podStartSLOduration=0.890611505 podStartE2EDuration="890.611505ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 03:55:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 03:55:00.889299362 +0000 UTC m=+2190.059809464" watchObservedRunningTime="2026-06-05 03:55:00.890611505 +0000 UTC m=+2190.061121606" Jun 05 03:55:00.907337 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.907298 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sb46z_c571c7cb-5e74-4511-86e6-494207456f3c/dns/0.log" Jun 05 03:55:00.927760 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:00.927740 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sb46z_c571c7cb-5e74-4511-86e6-494207456f3c/kube-rbac-proxy/0.log" Jun 05 03:55:01.000725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:01.000699 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x285n_fbbe0096-2d99-46fc-9b90-d702bee8c185/dns-node-resolver/0.log" Jun 05 03:55:01.619725 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:01.619698 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q4x7f_25b7fbf3-2c49-4b88-ab8d-6bdfd1b998b1/node-ca/0.log" Jun 05 03:55:02.623602 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:02.623574 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sld7m_93bcf597-62fa-4ece-a90d-dba258ba1bae/istio-proxy/0.log" Jun 05 03:55:02.796483 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:02.796456 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/0.log" Jun 05 03:55:02.827169 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:02.827141 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/1.log" Jun 05 03:55:02.872037 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:02.872014 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gq5zt_c5ea08c8-2c06-406c-a739-821a5e438c52/payload-pre-processing/0.log" Jun 05 03:55:03.549364 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:03.549310 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9tqh4_0697d96e-0986-45af-89ba-0a3879c0dfa7/serve-healthcheck-canary/0.log" Jun 05 03:55:04.292104 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:04.292076 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pf895_b3cc98d1-3d2c-4323-8360-190a5bbe012d/kube-rbac-proxy/0.log" Jun 05 03:55:04.312545 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:04.312525 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pf895_b3cc98d1-3d2c-4323-8360-190a5bbe012d/exporter/0.log" Jun 05 03:55:04.332717 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:04.332690 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pf895_b3cc98d1-3d2c-4323-8360-190a5bbe012d/extractor/0.log" Jun 05 03:55:06.540208 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:06.540178 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-68fd4ddf97-grh4k_62b78551-8f23-46ec-87ca-414cc5ec46fa/nginx/0.log" Jun 05 03:55:06.640446 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:06.640419 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-p5x2f_4f9c839b-8ff7-4ee0-ae36-54602d7865c7/manager/0.log" Jun 05 03:55:06.673452 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:06.673428 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b68b6f647-xx8jc_4a5882ff-d92c-4b36-bd9a-a8ec838441fd/maas-api/0.log" Jun 05 03:55:06.761307 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:06.761282 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d79495cc9-6q9qp_9dc9015f-3461-4cda-b5c3-066d298f6b11/manager/0.log" Jun 05 03:55:06.889309 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:06.889288 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-82kgb/perf-node-gather-daemonset-xk92s" Jun 05 03:55:06.995958 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:06.995933 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdb887f5b-7m6zc_868f2bcb-d394-42fd-af82-280991960096/manager/0.log" Jun 05 03:55:07.012024 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:07.012002 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bdb887f5b-7m6zc_868f2bcb-d394-42fd-af82-280991960096/copy-manifests/0.log" Jun 05 03:55:08.624562 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:08.624535 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67bbfff89b-r5rws_83fca9d2-cf9b-400a-b8a6-434831c6027c/manager/0.log" Jun 05 03:55:08.674130 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:08.674102 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hrsn6_7463ed7c-401a-4573-abb7-2ddb5dbd284f/openshift-lws-operator/0.log" Jun 05 03:55:12.889586 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:12.889559 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sld7m_93bcf597-62fa-4ece-a90d-dba258ba1bae/istio-proxy/0.log" Jun 05 03:55:13.016311 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:13.016280 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/0.log" Jun 05 03:55:13.048677 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:13.048654 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/1.log" Jun 05 03:55:13.081227 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:13.081199 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gq5zt_c5ea08c8-2c06-406c-a739-821a5e438c52/payload-pre-processing/0.log" Jun 05 03:55:14.311842 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:14.311817 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sld7m_93bcf597-62fa-4ece-a90d-dba258ba1bae/istio-proxy/0.log" Jun 05 03:55:14.443165 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:14.443137 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/0.log" Jun 05 03:55:14.480727 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:14.480703 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/1.log" Jun 05 03:55:14.516624 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:14.516596 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gq5zt_c5ea08c8-2c06-406c-a739-821a5e438c52/payload-pre-processing/0.log" Jun 05 03:55:16.062799 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.062772 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhhpl_dca91cdc-0ecd-49e0-925d-b3df21b832f6/kube-multus-additional-cni-plugins/0.log" Jun 05 03:55:16.082883 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.082850 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhhpl_dca91cdc-0ecd-49e0-925d-b3df21b832f6/egress-router-binary-copy/0.log" Jun 05 03:55:16.106168 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.106148 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhhpl_dca91cdc-0ecd-49e0-925d-b3df21b832f6/cni-plugins/0.log" Jun 05 03:55:16.125801 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.125778 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhhpl_dca91cdc-0ecd-49e0-925d-b3df21b832f6/bond-cni-plugin/0.log" Jun 05 03:55:16.148658 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.148640 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhhpl_dca91cdc-0ecd-49e0-925d-b3df21b832f6/routeoverride-cni/0.log" Jun 05 03:55:16.168828 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.168807 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhhpl_dca91cdc-0ecd-49e0-925d-b3df21b832f6/whereabouts-cni-bincopy/0.log" Jun 05 03:55:16.188879 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.188862 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mhhpl_dca91cdc-0ecd-49e0-925d-b3df21b832f6/whereabouts-cni/0.log" Jun 05 03:55:16.196742 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.196725 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795sld7m_93bcf597-62fa-4ece-a90d-dba258ba1bae/istio-proxy/0.log" Jun 05 03:55:16.317286 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.317214 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/0.log" Jun 05 03:55:16.347814 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.347793 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-qp297_082c3638-d9de-426c-aefc-78e7ce4c2500/istio-proxy/1.log" Jun 05 03:55:16.383988 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.383962 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-gq5zt_c5ea08c8-2c06-406c-a739-821a5e438c52/payload-pre-processing/0.log" Jun 05 03:55:16.411475 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.411446 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j99r4_4e1347c5-0af5-4ba9-b3f2-85751ab6b9fc/kube-multus/0.log" Jun 05 03:55:16.547998 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.547974 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vxwwt_080e95bc-53d2-476e-bd90-1f99cb0e5d09/network-metrics-daemon/0.log" Jun 05 03:55:16.567505 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:16.567447 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vxwwt_080e95bc-53d2-476e-bd90-1f99cb0e5d09/kube-rbac-proxy/0.log" Jun 05 03:55:17.747902 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:17.747871 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lqh2n_834d365e-26ff-4455-b7b6-7200e03cb122/ovn-controller/0.log" Jun 05 03:55:17.767443 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:17.767420 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lqh2n_834d365e-26ff-4455-b7b6-7200e03cb122/ovn-acl-logging/0.log" Jun 05 03:55:17.791694 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:17.791675 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lqh2n_834d365e-26ff-4455-b7b6-7200e03cb122/kube-rbac-proxy-node/0.log" Jun 05 03:55:17.811561 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:17.811541 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lqh2n_834d365e-26ff-4455-b7b6-7200e03cb122/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 03:55:17.832031 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:17.832012 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lqh2n_834d365e-26ff-4455-b7b6-7200e03cb122/northd/0.log" Jun 05 03:55:17.853898 ip-10-0-141-163 kubenswrapper[2552]: I0605 03:55:17.853878 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lqh2n_834d365e-26ff-4455-b7b6-7200e03cb122/nbdb/0.log"