Jun 03 08:44:27.096755 ip-10-0-138-22 systemd[1]: Starting Kubernetes Kubelet... Jun 03 08:44:27.585595 ip-10-0-138-22 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 08:44:27.585595 ip-10-0-138-22 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 08:44:27.585595 ip-10-0-138-22 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 08:44:27.585595 ip-10-0-138-22 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 08:44:27.585595 ip-10-0-138-22 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 08:44:27.587363 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.587279 2561 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 08:44:27.592303 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592287 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:44:27.592303 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592304 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592308 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592312 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592315 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592318 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592321 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592324 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592326 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592329 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592331 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592334 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592337 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592339 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592342 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592344 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592347 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592350 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592352 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592355 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592357 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:44:27.592389 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592360 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592362 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592364 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592367 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592370 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592372 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592386 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592396 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592400 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592402 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592405 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592407 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592410 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592412 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592415 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592417 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592420 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592422 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592425 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592427 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:44:27.592858 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592429 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592432 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592434 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592437 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592440 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592444 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592447 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592451 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592455 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592458 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592460 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592463 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592466 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592468 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592472 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592475 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592477 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592480 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592482 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:44:27.593385 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592485 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592488 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592490 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592493 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592495 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592498 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592500 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592503 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592505 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592508 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592511 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592513 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592517 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592521 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592525 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592527 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592530 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592532 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592535 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:44:27.593859 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592538 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592540 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592543 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592546 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592548 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592552 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592554 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592927 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592933 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592936 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592939 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592941 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592944 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592947 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592949 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592952 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592954 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592957 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592960 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592962 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:44:27.594309 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592964 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592967 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592969 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592972 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592974 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592977 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592981 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592986 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592989 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592992 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592995 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.592997 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593000 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593003 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593006 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593011 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593015 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593018 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593020 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:44:27.594797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593023 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593026 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593029 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593031 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593034 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593036 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593039 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593041 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593044 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593046 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593049 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593051 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593053 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593056 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593058 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593061 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593063 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593066 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593068 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593071 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:44:27.595263 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593073 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593076 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593079 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593081 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593084 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593086 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593089 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593092 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593097 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593099 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593102 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593104 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593107 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593109 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593112 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593114 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593117 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593119 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593122 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593124 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:44:27.595766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593127 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593129 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593131 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593134 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593136 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593138 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593141 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593143 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593146 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593148 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593150 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593153 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593155 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593158 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593228 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593235 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593242 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593246 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593250 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593253 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593258 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 08:44:27.596264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593262 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593265 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593268 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593272 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593280 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593283 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593286 2561 flags.go:64] FLAG: --cgroup-root="" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593289 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593292 2561 flags.go:64] FLAG: --client-ca-file="" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593295 2561 flags.go:64] FLAG: --cloud-config="" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593298 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593301 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593305 2561 flags.go:64] FLAG: --cluster-domain="" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593307 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593310 2561 flags.go:64] FLAG: --config-dir="" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593313 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593317 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593320 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593323 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593326 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593329 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593332 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593335 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593338 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593341 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 08:44:27.596785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593344 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593356 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593359 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593362 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593365 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593368 2561 flags.go:64] FLAG: --enable-server="true" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593371 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593394 2561 flags.go:64] FLAG: --event-burst="100" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593397 2561 flags.go:64] FLAG: --event-qps="50" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593400 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593403 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593415 2561 flags.go:64] FLAG: --eviction-hard="" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593420 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593423 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593426 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593429 2561 flags.go:64] FLAG: --eviction-soft="" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593431 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593434 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593437 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593440 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593443 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593445 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593448 2561 flags.go:64] FLAG: --feature-gates="" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593452 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593455 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 08:44:27.597412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593458 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593461 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593464 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593467 2561 flags.go:64] FLAG: --help="false" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593470 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-138-22.ec2.internal" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593473 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593476 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593479 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593482 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593491 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593494 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593497 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593500 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593503 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593506 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593509 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593512 2561 flags.go:64] FLAG: --kube-reserved="" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593515 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593519 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593522 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593524 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593527 2561 flags.go:64] FLAG: --lock-file="" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593530 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593533 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 08:44:27.598038 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593535 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593541 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593544 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593546 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593549 2561 flags.go:64] FLAG: --logging-format="text" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593552 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593555 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593558 2561 flags.go:64] FLAG: --manifest-url="" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593560 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593565 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593567 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593571 2561 flags.go:64] FLAG: --max-pods="110" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593574 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593577 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593580 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593582 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593585 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593588 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593592 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593599 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593604 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593607 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593609 2561 flags.go:64] FLAG: --pod-cidr="" Jun 03 08:44:27.598625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593612 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593618 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593621 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593625 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593628 2561 flags.go:64] FLAG: --port="10250" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593631 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593634 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060d5ba53ef1894e2" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593637 2561 flags.go:64] FLAG: --qos-reserved="" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593640 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593643 2561 flags.go:64] FLAG: --register-node="true" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593646 2561 flags.go:64] FLAG: --register-schedulable="true" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593648 2561 flags.go:64] FLAG: --register-with-taints="" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593652 2561 flags.go:64] FLAG: --registry-burst="10" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593655 2561 flags.go:64] FLAG: --registry-qps="5" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593658 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593660 2561 flags.go:64] FLAG: --reserved-memory="" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593664 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593667 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593670 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593672 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593675 2561 flags.go:64] FLAG: --runonce="false" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593678 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593681 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593684 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593687 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593689 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 08:44:27.599192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593692 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593695 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593699 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593702 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593706 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593709 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593712 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593715 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593717 2561 flags.go:64] FLAG: --system-cgroups="" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593721 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593726 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593729 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593732 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593738 2561 flags.go:64] FLAG: --tls-min-version="" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593741 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593743 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593746 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593749 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593752 2561 flags.go:64] FLAG: --v="2" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593756 2561 flags.go:64] FLAG: --version="false" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593760 2561 flags.go:64] FLAG: --vmodule="" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593764 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.593767 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593861 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:44:27.599846 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593865 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593868 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593871 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593874 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593877 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593879 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593882 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593885 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593887 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593891 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593895 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593898 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593902 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593905 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593907 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593910 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593913 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593916 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593919 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593921 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:44:27.600440 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593924 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593926 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593929 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593931 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593933 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593936 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593939 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593941 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593943 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593946 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593948 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593951 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593953 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593956 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593958 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593960 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593963 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593965 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593968 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:44:27.600969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593970 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593972 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593975 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593977 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593980 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593984 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593987 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593989 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593992 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593994 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.593998 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594000 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594003 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594005 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594008 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594010 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594013 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594015 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594019 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594023 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:44:27.601459 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594025 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594028 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594031 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594034 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594037 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594039 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594042 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594044 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594046 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594049 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594051 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594054 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594056 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594059 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594061 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594064 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594066 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594070 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594073 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594075 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:44:27.601958 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594078 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594080 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594084 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594086 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594089 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.594091 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.594096 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.600653 2561 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.600669 2561 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600726 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600731 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600734 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600737 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600740 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600742 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600745 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:44:27.602465 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600747 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600750 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600753 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600755 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600758 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600761 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600763 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600766 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600768 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600771 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600773 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600776 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600778 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600781 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600784 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600786 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600789 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600792 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600794 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600797 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:44:27.602862 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600799 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600802 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600804 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600807 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600810 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600813 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600816 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600818 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600821 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600823 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600826 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600828 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600833 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600837 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600840 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600843 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600847 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600850 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600853 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:44:27.603345 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600856 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600860 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600863 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600865 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600868 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600871 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600873 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600876 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600879 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600882 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600884 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600887 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600889 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600892 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600894 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600897 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600899 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600902 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600905 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600908 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:44:27.603829 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600910 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600912 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600915 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600918 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600920 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600922 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600925 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600928 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600930 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600932 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600935 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600937 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600940 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600942 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600944 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600947 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600949 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600952 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600954 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:44:27.604305 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.600957 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.600962 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601056 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601061 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601063 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601066 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601069 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601072 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601076 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601079 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601083 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601086 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601089 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601092 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601094 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 08:44:27.604814 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601096 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601099 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601101 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601104 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601106 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601109 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601111 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601113 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601116 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601118 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601120 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601123 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601125 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601127 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601130 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601132 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601135 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601137 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601139 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 08:44:27.605259 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601142 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601144 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601147 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601149 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601152 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601154 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601157 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601159 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601162 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601165 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601168 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601170 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601173 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601175 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601177 2561 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601180 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601182 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601184 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601187 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 08:44:27.605752 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601189 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601192 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601196 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601198 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601201 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601204 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601206 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601209 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601211 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601213 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601216 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601218 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601221 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601223 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601226 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601229 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601231 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601233 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601236 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601238 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 08:44:27.606219 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601240 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601243 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601246 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601249 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601251 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601253 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601256 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601258 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601261 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601263 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601266 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601268 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601271 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601273 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:27.601276 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.601281 2561 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 08:44:27.606719 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.602052 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 08:44:27.607110 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.605626 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 08:44:27.608443 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.608430 2561 server.go:1019] "Starting client certificate rotation" Jun 03 08:44:27.608559 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.608542 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 08:44:27.608589 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.608580 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 08:44:27.636690 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.636670 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 08:44:27.639710 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.639692 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 08:44:27.652356 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.652329 2561 log.go:25] "Validated CRI v1 runtime API" Jun 03 08:44:27.658444 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.658419 2561 log.go:25] "Validated CRI v1 image API" Jun 03 08:44:27.659668 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.659649 2561 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 08:44:27.665000 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.664981 2561 fs.go:135] Filesystem UUIDs: map[4928d27a-5eba-4cd9-bfda-d4b88a6ee0b9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ae27e73a-aac7-461f-a9ef-6ac0bc6fec58:/dev/nvme0n1p3] Jun 03 08:44:27.665085 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.665000 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 08:44:27.667635 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.667615 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 08:44:27.669214 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.669107 2561 manager.go:217] Machine: {Timestamp:2026-06-03 08:44:27.668618874 +0000 UTC m=+0.446114503 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100175 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f7aa73adfd878527a05157124b92 SystemUUID:ec28f7aa-73ad-fd87-8527-a05157124b92 BootID:e4382052-9d13-49f6-9d38-4400db8dfc2a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c4:a6:14:c1:d3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c4:a6:14:c1:d3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:97:fe:0a:ca:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 08:44:27.669976 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.669965 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 08:44:27.670088 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.670076 2561 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 08:44:27.671356 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.671334 2561 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 08:44:27.671499 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.671357 2561 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 08:44:27.671546 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.671509 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 08:44:27.671546 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.671517 2561 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 08:44:27.671546 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.671525 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 08:44:27.672497 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.672477 2561 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 08:44:27.673292 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.673283 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 03 08:44:27.673432 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.673423 2561 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 08:44:27.678329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.678319 2561 kubelet.go:491] "Attempting to sync node with API server" Jun 03 08:44:27.678363 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.678337 2561 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 08:44:27.678363 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.678349 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 08:44:27.678363 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.678360 2561 kubelet.go:397] "Adding apiserver pod source" Jun 03 08:44:27.678487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.678368 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 08:44:27.681704 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.681689 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 08:44:27.681778 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.681710 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 08:44:27.687606 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.687584 2561 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 08:44:27.689676 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.689657 2561 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 08:44:27.691712 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691696 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691716 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691722 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691728 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691736 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691742 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691748 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691753 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.691749 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.691748 2561 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 08:44:27.691786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691759 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 08:44:27.692058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691802 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 08:44:27.692058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691812 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 08:44:27.692058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.691818 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 08:44:27.692755 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.692745 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 08:44:27.692792 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.692756 2561 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 08:44:27.694539 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.694521 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7q2rs" Jun 03 08:44:27.695810 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.695797 2561 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 08:44:27.695850 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.695835 2561 server.go:1295] "Started kubelet" Jun 03 08:44:27.696189 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.696158 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 08:44:27.696243 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.696163 2561 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 08:44:27.696243 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.696210 2561 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 08:44:27.696581 ip-10-0-138-22 systemd[1]: Started Kubernetes Kubelet. Jun 03 08:44:27.697554 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.697471 2561 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 08:44:27.698861 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.698847 2561 server.go:317] "Adding debug handlers to kubelet server" Jun 03 08:44:27.700533 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.700517 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7q2rs" Jun 03 08:44:27.704155 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.704134 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 08:44:27.704247 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.704188 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 08:44:27.704308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.704293 2561 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 08:44:27.704308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.704306 2561 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 08:44:27.704454 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.704438 2561 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 08:44:27.704559 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.704507 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 03 08:44:27.704559 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.704516 2561 reconciler.go:26] "Reconciler: start to sync state" Jun 03 08:44:27.705151 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.705129 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:27.708133 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708113 2561 factory.go:55] Registering systemd factory Jun 03 08:44:27.708133 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708134 2561 factory.go:223] Registration of the systemd container factory successfully Jun 03 08:44:27.708490 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708471 2561 factory.go:153] Registering CRI-O factory Jun 03 08:44:27.708490 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708491 2561 factory.go:223] Registration of the crio container factory successfully Jun 03 08:44:27.708799 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708531 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 08:44:27.708799 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708560 2561 factory.go:103] Registering Raw factory Jun 03 08:44:27.708799 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708572 2561 manager.go:1196] Started watching for new ooms in manager Jun 03 08:44:27.708949 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.708912 2561 manager.go:319] Starting recovery of all containers Jun 03 08:44:27.711053 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.711033 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:44:27.716867 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.716707 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-22.ec2.internal\" not found" node="ip-10-0-138-22.ec2.internal" Jun 03 08:44:27.717547 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.717526 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-22.ec2.internal" not found Jun 03 08:44:27.720369 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.720351 2561 manager.go:324] Recovery completed Jun 03 08:44:27.724921 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.724908 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:44:27.726626 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.726608 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:44:27.726709 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.726639 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:44:27.726709 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.726653 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:44:27.727124 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.727108 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 08:44:27.727166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.727124 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 08:44:27.727166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.727141 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 03 08:44:27.729548 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.729536 2561 policy_none.go:49] "None policy: Start" Jun 03 08:44:27.729602 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.729553 2561 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 08:44:27.729602 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.729563 2561 state_mem.go:35] "Initializing new in-memory state store" Jun 03 08:44:27.732661 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.732645 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-22.ec2.internal" not found Jun 03 08:44:27.773839 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.773580 2561 manager.go:341] "Starting Device Plugin manager" Jun 03 08:44:27.773839 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.773610 2561 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 08:44:27.773839 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.773620 2561 server.go:85] "Starting device plugin registration server" Jun 03 08:44:27.773839 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.773838 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 08:44:27.774072 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.773852 2561 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 08:44:27.774072 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.773927 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 08:44:27.774072 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.774038 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 08:44:27.774072 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.774048 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 08:44:27.774442 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.774424 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 08:44:27.774539 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.774457 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:27.792064 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.792044 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-138-22.ec2.internal" not found Jun 03 08:44:27.830871 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.830846 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 08:44:27.832173 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.832157 2561 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 08:44:27.832252 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.832190 2561 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 08:44:27.832252 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.832209 2561 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 08:44:27.832252 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.832218 2561 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 08:44:27.832449 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.832259 2561 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 08:44:27.838083 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.838039 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:44:27.874725 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.874707 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:44:27.875716 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.875696 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:44:27.875796 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.875726 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:44:27.875796 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.875736 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:44:27.875796 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.875762 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-22.ec2.internal" Jun 03 08:44:27.887746 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.887730 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-22.ec2.internal" Jun 03 08:44:27.887792 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.887750 2561 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-22.ec2.internal\": node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:27.906256 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.906236 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:27.933357 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.933314 2561 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal"] Jun 03 08:44:27.933438 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.933417 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:44:27.934172 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.934156 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:44:27.934237 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.934181 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:44:27.934237 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.934192 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:44:27.935359 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.935348 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:44:27.935557 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.935542 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:27.935607 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.935572 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:44:27.936059 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.936022 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:44:27.936059 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.936050 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:44:27.936059 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.936025 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:44:27.936059 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.936062 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:44:27.936288 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.936078 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:44:27.936288 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.936090 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:44:27.937319 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.937306 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jun 03 08:44:27.937403 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.937329 2561 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 08:44:27.938020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.938006 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientMemory" Jun 03 08:44:27.938092 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.938030 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 08:44:27.938092 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:27.938040 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeHasSufficientPID" Jun 03 08:44:27.965935 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.965913 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-22.ec2.internal\" not found" node="ip-10-0-138-22.ec2.internal" Jun 03 08:44:27.970246 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:27.970230 2561 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-22.ec2.internal\" not found" node="ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.005643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.005596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab349e23911c616e8ef6603638c00ac8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"ab349e23911c616e8ef6603638c00ac8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.005643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.005618 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab349e23911c616e8ef6603638c00ac8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"ab349e23911c616e8ef6603638c00ac8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.005757 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.005653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59c1ea0db4c1eed4c8a1ee0ed3fb18d2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-22.ec2.internal\" (UID: \"59c1ea0db4c1eed4c8a1ee0ed3fb18d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.006625 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.006610 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.106691 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.106630 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab349e23911c616e8ef6603638c00ac8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"ab349e23911c616e8ef6603638c00ac8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.106691 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.106656 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab349e23911c616e8ef6603638c00ac8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"ab349e23911c616e8ef6603638c00ac8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.106691 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.106674 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59c1ea0db4c1eed4c8a1ee0ed3fb18d2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-22.ec2.internal\" (UID: \"59c1ea0db4c1eed4c8a1ee0ed3fb18d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.106863 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.106699 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59c1ea0db4c1eed4c8a1ee0ed3fb18d2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-22.ec2.internal\" (UID: \"59c1ea0db4c1eed4c8a1ee0ed3fb18d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.106863 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.106715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab349e23911c616e8ef6603638c00ac8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"ab349e23911c616e8ef6603638c00ac8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.106863 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.106728 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.106863 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.106753 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab349e23911c616e8ef6603638c00ac8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal\" (UID: \"ab349e23911c616e8ef6603638c00ac8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.207262 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.207221 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.268450 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.268423 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.273113 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.273084 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.307960 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.307933 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.408341 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.408269 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.508701 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.508660 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.606082 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.606057 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 08:44:28.606628 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.606192 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 08:44:28.606628 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.606224 2561 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 08:44:28.609208 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.609178 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.702828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.702791 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 08:39:27 +0000 UTC" deadline="2027-12-09 11:02:00.818651088 +0000 UTC" Jun 03 08:44:28.702828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.702826 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13298h17m32.115828573s" Jun 03 08:44:28.704970 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.704947 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 08:44:28.710226 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.710203 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.728974 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.728952 2561 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 08:44:28.752419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.752395 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qbf4s" Jun 03 08:44:28.759834 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.759817 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qbf4s" Jun 03 08:44:28.780583 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:28.780552 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c1ea0db4c1eed4c8a1ee0ed3fb18d2.slice/crio-3281f1315640cef77a9f30d048209bf1eb64b4dd7f514e5ca8b08979a838fa51 WatchSource:0}: Error finding container 3281f1315640cef77a9f30d048209bf1eb64b4dd7f514e5ca8b08979a838fa51: Status 404 returned error can't find the container with id 3281f1315640cef77a9f30d048209bf1eb64b4dd7f514e5ca8b08979a838fa51 Jun 03 08:44:28.780777 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:28.780756 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab349e23911c616e8ef6603638c00ac8.slice/crio-cff1b9fda7e7e9f31cbc6f19650d41e13b9c3314e39951baf816f95ab4674f37 WatchSource:0}: Error finding container cff1b9fda7e7e9f31cbc6f19650d41e13b9c3314e39951baf816f95ab4674f37: Status 404 returned error can't find the container with id cff1b9fda7e7e9f31cbc6f19650d41e13b9c3314e39951baf816f95ab4674f37 Jun 03 08:44:28.784125 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.784104 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 08:44:28.811132 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:28.811107 2561 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-22.ec2.internal\" not found" Jun 03 08:44:28.831798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.831778 2561 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:44:28.835471 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.835431 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" event={"ID":"59c1ea0db4c1eed4c8a1ee0ed3fb18d2","Type":"ContainerStarted","Data":"3281f1315640cef77a9f30d048209bf1eb64b4dd7f514e5ca8b08979a838fa51"} Jun 03 08:44:28.836414 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.836373 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" event={"ID":"ab349e23911c616e8ef6603638c00ac8","Type":"ContainerStarted","Data":"cff1b9fda7e7e9f31cbc6f19650d41e13b9c3314e39951baf816f95ab4674f37"} Jun 03 08:44:28.904608 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.904584 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.913237 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.913224 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 08:44:28.915395 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.915371 2561 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" Jun 03 08:44:28.917078 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.917063 2561 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:44:28.926336 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:28.926293 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 08:44:29.435206 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.435177 2561 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:44:29.680678 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.680396 2561 apiserver.go:52] "Watching apiserver" Jun 03 08:44:29.691106 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.691037 2561 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 08:44:29.692347 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.692256 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-6mkrs","openshift-network-operator/iptables-alerter-7nq7b","openshift-ovn-kubernetes/ovnkube-node-9qbwn","kube-system/konnectivity-agent-mfh47","kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd","openshift-cluster-node-tuning-operator/tuned-f568s","openshift-dns/node-resolver-s5l7r","openshift-image-registry/node-ca-5zl66","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal","openshift-multus/multus-n27pg","openshift-multus/multus-additional-cni-plugins-msk8b","openshift-multus/network-metrics-daemon-q9mnc"] Jun 03 08:44:29.693882 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.693861 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.694861 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.694840 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:29.694958 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.694935 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:29.696897 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.696866 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 08:44:29.696897 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.696887 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8vs97\"" Jun 03 08:44:29.697044 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.696896 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 08:44:29.697044 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.696881 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 08:44:29.699944 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.699925 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.701526 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.701507 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:29.702589 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.702229 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 08:44:29.702589 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.702324 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:44:29.702589 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.702447 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dqxtx\"" Jun 03 08:44:29.703495 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.703473 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:29.703578 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.703536 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:29.704316 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.703916 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 08:44:29.704316 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.704033 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p2pfc\"" Jun 03 08:44:29.704316 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.704132 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 08:44:29.705458 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.704596 2561 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 08:44:29.705458 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.704818 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.705458 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.704945 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.706285 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.706265 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.707106 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.707086 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 08:44:29.707283 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.707267 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 08:44:29.708010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.707553 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.708010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.707610 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nxm65\"" Jun 03 08:44:29.708890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.708263 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sxjkc\"" Jun 03 08:44:29.708890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.708412 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 08:44:29.708890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.708519 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 08:44:29.708890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.708573 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 08:44:29.708890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.708581 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 08:44:29.708890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.708524 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 08:44:29.709541 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.709289 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 08:44:29.710031 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.710010 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 08:44:29.710125 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.710081 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wgxqz\"" Jun 03 08:44:29.710335 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.710318 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 08:44:29.710556 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.710538 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 08:44:29.710828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.710810 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 08:44:29.711262 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.711244 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9gbck\"" Jun 03 08:44:29.711344 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.711300 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 08:44:29.711797 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.711449 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 08:44:29.711797 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.711674 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 08:44:29.713902 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.713884 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.713991 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.713954 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.716226 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-socket-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.716696 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716672 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-systemd\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.716696 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716687 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 08:44:29.716831 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-lib-modules\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.716831 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-run\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.716831 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716767 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:29.716831 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj7ts\" (UniqueName: \"kubernetes.io/projected/4da9b4af-64c3-4b9e-9260-3470d57d256f-kube-api-access-rj7ts\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.717030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716832 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71bfcc55-0169-4fb1-b546-4839143aa713-hosts-file\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.717030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716561 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 08:44:29.717030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/883f2d62-d81c-4308-808a-28ce50f3e7aa-host\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.717030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysctl-d\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysctl-conf\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716946 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-host\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-device-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716510 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717037 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-tmp\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-registration-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99pl8\" (UniqueName: \"kubernetes.io/projected/71bfcc55-0169-4fb1-b546-4839143aa713-kube-api-access-99pl8\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-etc-selinux\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716524 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/883f2d62-d81c-4308-808a-28ce50f3e7aa-serviceca\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.717351 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a46fbf0-b72f-4030-a103-04e9de0650c8-agent-certs\") pod \"konnectivity-agent-mfh47\" (UID: \"4a46fbf0-b72f-4030-a103-04e9de0650c8\") " pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716618 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716636 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-smxbr\"" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717514 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysconfig\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.716621 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-69j89\"" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-kubernetes\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717616 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-tuned\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xvkz\" (UniqueName: \"kubernetes.io/projected/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-kube-api-access-5xvkz\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a46fbf0-b72f-4030-a103-04e9de0650c8-konnectivity-ca\") pod \"konnectivity-agent-mfh47\" (UID: \"4a46fbf0-b72f-4030-a103-04e9de0650c8\") " pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:29.717788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.717734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkn6x\" (UniqueName: \"kubernetes.io/projected/d130f311-edd0-4255-869f-453deb319458-kube-api-access-dkn6x\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:29.718476 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.718439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-sys-fs\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.718572 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.718500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bn99\" (UniqueName: \"kubernetes.io/projected/883f2d62-d81c-4308-808a-28ce50f3e7aa-kube-api-access-7bn99\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.718572 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.718536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-sys\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.718572 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.718566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-var-lib-kubelet\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.718755 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.718590 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71bfcc55-0169-4fb1-b546-4839143aa713-tmp-dir\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.718755 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.718620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-modprobe-d\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.718755 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.718648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:29.760564 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.760535 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 08:39:28 +0000 UTC" deadline="2028-01-20 07:14:14.438134731 +0000 UTC" Jun 03 08:44:29.760564 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.760560 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14302h29m44.677577717s" Jun 03 08:44:29.805425 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.805403 2561 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 08:44:29.819682 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819655 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-lib-modules\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.819771 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-cni-netd\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.819771 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovnkube-script-lib\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.819771 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-socket-dir-parent\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.819771 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819758 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-tmp\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819778 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-ovn\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819825 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-run\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819844 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-lib-modules\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819850 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819892 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rj7ts\" (UniqueName: \"kubernetes.io/projected/4da9b4af-64c3-4b9e-9260-3470d57d256f-kube-api-access-rj7ts\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819915 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/883f2d62-d81c-4308-808a-28ce50f3e7aa-host\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.819937 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819940 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysctl-conf\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.819973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.819964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-cni-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.820010 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:30.319977592 +0000 UTC m=+3.097473221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpzpn\" (UniqueName: \"kubernetes.io/projected/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-kube-api-access-fpzpn\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-multus-certs\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-etc-kubernetes\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cnibin\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820129 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw4f5\" (UniqueName: \"kubernetes.io/projected/c978da19-b009-4f1b-ad94-7a52c0580235-kube-api-access-kw4f5\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820111 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bbfaf1b-c060-48b7-8458-203eb93931a7-cni-binary-copy\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820239 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-run\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/883f2d62-d81c-4308-808a-28ce50f3e7aa-host\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820322 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c978da19-b009-4f1b-ad94-7a52c0580235-host-slash\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.820364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820350 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-kubelet\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820420 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysctl-conf\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820435 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820463 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-tuned\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-systemd\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-os-release\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820571 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-sys-fs\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820599 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bn99\" (UniqueName: \"kubernetes.io/projected/883f2d62-d81c-4308-808a-28ce50f3e7aa-kube-api-access-7bn99\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820624 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-cni-bin\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820661 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-sys-fs\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-system-cni-dir\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820759 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71bfcc55-0169-4fb1-b546-4839143aa713-tmp-dir\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820813 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:29.821052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820942 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-log-socket\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.820980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-hostroot\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71bfcc55-0169-4fb1-b546-4839143aa713-tmp-dir\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcmhx\" (UniqueName: \"kubernetes.io/projected/2595419f-cc17-491b-b4da-f0b2fb8e46cd-kube-api-access-pcmhx\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821105 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-socket-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821131 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-etc-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821147 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9px6t\" (UniqueName: \"kubernetes.io/projected/3bbfaf1b-c060-48b7-8458-203eb93931a7-kube-api-access-9px6t\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821184 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71bfcc55-0169-4fb1-b546-4839143aa713-hosts-file\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821208 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysctl-d\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821222 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-socket-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/71bfcc55-0169-4fb1-b546-4839143aa713-hosts-file\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821232 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-host\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821282 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-host\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821312 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-device-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysctl-d\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-cnibin\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.821807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821356 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-device-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-kubelet\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821423 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-registration-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821446 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99pl8\" (UniqueName: \"kubernetes.io/projected/71bfcc55-0169-4fb1-b546-4839143aa713-kube-api-access-99pl8\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821493 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-registration-dir\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821526 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-slash\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821547 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-k8s-cni-cncf-io\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821566 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-netns\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821584 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-cni-bin\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821609 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-cni-multus\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821653 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-conf-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821683 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-etc-selinux\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821712 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/883f2d62-d81c-4308-808a-28ce50f3e7aa-serviceca\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821732 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a46fbf0-b72f-4030-a103-04e9de0650c8-agent-certs\") pod \"konnectivity-agent-mfh47\" (UID: \"4a46fbf0-b72f-4030-a103-04e9de0650c8\") " pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821763 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4da9b4af-64c3-4b9e-9260-3470d57d256f-etc-selinux\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-var-lib-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-env-overrides\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.822442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-daemon-config\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c978da19-b009-4f1b-ad94-7a52c0580235-iptables-alerter-script\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821937 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysconfig\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821966 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-kubernetes\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.821991 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xvkz\" (UniqueName: \"kubernetes.io/projected/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-kube-api-access-5xvkz\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822033 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a46fbf0-b72f-4030-a103-04e9de0650c8-konnectivity-ca\") pod \"konnectivity-agent-mfh47\" (UID: \"4a46fbf0-b72f-4030-a103-04e9de0650c8\") " pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovnkube-config\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822082 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-kubernetes\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovn-node-metrics-cert\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822164 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-os-release\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822170 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/883f2d62-d81c-4308-808a-28ce50f3e7aa-serviceca\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822196 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkn6x\" (UniqueName: \"kubernetes.io/projected/d130f311-edd0-4255-869f-453deb319458-kube-api-access-dkn6x\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822221 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-sys\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822247 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-var-lib-kubelet\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-systemd-units\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-run-netns\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822325 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-sys\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823022 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-system-cni-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822345 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-var-lib-kubelet\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822358 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-modprobe-d\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-sysconfig\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-node-log\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822471 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-modprobe-d\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822473 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-systemd\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822511 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-systemd\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.822671 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4a46fbf0-b72f-4030-a103-04e9de0650c8-konnectivity-ca\") pod \"konnectivity-agent-mfh47\" (UID: \"4a46fbf0-b72f-4030-a103-04e9de0650c8\") " pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:29.823627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.823614 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-etc-tuned\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.823998 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.823659 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-tmp\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.826146 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.826115 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4a46fbf0-b72f-4030-a103-04e9de0650c8-agent-certs\") pod \"konnectivity-agent-mfh47\" (UID: \"4a46fbf0-b72f-4030-a103-04e9de0650c8\") " pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:29.827956 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.827933 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:44:29.828044 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.827962 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:44:29.828044 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.827977 2561 projected.go:194] Error preparing data for projected volume kube-api-access-79gkk for pod openshift-network-diagnostics/network-check-target-6mkrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:29.828144 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:29.828051 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk podName:584fc893-2faa-4a49-9b00-9d79d9feb24e nodeName:}" failed. No retries permitted until 2026-06-03 08:44:30.328025327 +0000 UTC m=+3.105520960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-79gkk" (UniqueName: "kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk") pod "network-check-target-6mkrs" (UID: "584fc893-2faa-4a49-9b00-9d79d9feb24e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:29.829762 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.829743 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj7ts\" (UniqueName: \"kubernetes.io/projected/4da9b4af-64c3-4b9e-9260-3470d57d256f-kube-api-access-rj7ts\") pod \"aws-ebs-csi-driver-node-njnmd\" (UID: \"4da9b4af-64c3-4b9e-9260-3470d57d256f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:29.829951 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.829925 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkn6x\" (UniqueName: \"kubernetes.io/projected/d130f311-edd0-4255-869f-453deb319458-kube-api-access-dkn6x\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:29.830465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.830443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bn99\" (UniqueName: \"kubernetes.io/projected/883f2d62-d81c-4308-808a-28ce50f3e7aa-kube-api-access-7bn99\") pod \"node-ca-5zl66\" (UID: \"883f2d62-d81c-4308-808a-28ce50f3e7aa\") " pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:29.830547 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.830443 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99pl8\" (UniqueName: \"kubernetes.io/projected/71bfcc55-0169-4fb1-b546-4839143aa713-kube-api-access-99pl8\") pod \"node-resolver-s5l7r\" (UID: \"71bfcc55-0169-4fb1-b546-4839143aa713\") " pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:29.831095 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.831075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xvkz\" (UniqueName: \"kubernetes.io/projected/e1bdb7b7-8768-495d-b06e-f9a66b08cfb7-kube-api-access-5xvkz\") pod \"tuned-f568s\" (UID: \"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7\") " pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:29.923796 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923757 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-log-socket\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.923796 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923806 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-hostroot\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923842 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcmhx\" (UniqueName: \"kubernetes.io/projected/2595419f-cc17-491b-b4da-f0b2fb8e46cd-kube-api-access-pcmhx\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923870 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-etc-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923874 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-log-socket\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923899 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923929 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-hostroot\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923948 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-etc-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923951 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923971 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9px6t\" (UniqueName: \"kubernetes.io/projected/3bbfaf1b-c060-48b7-8458-203eb93931a7-kube-api-access-9px6t\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.923999 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-cnibin\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924024 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924023 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-kubelet\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924049 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-slash\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924072 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-k8s-cni-cncf-io\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924100 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-cnibin\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924112 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-kubelet\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-k8s-cni-cncf-io\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924137 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-netns\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924147 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-slash\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924164 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-cni-bin\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-netns\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924190 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-cni-multus\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924214 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-conf-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924242 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-var-lib-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-cni-bin\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924261 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-var-lib-cni-multus\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924267 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-env-overrides\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-var-lib-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924308 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-daemon-config\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.924506 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924311 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-conf-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924347 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c978da19-b009-4f1b-ad94-7a52c0580235-iptables-alerter-script\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924400 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovnkube-config\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924425 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovn-node-metrics-cert\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924451 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-os-release\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924479 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-systemd-units\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924503 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-run-netns\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924526 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-system-cni-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924549 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-node-log\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924574 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-cni-netd\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924600 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovnkube-script-lib\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924638 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-socket-dir-parent\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924666 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-ovn\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924711 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-cni-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924739 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fpzpn\" (UniqueName: \"kubernetes.io/projected/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-kube-api-access-fpzpn\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924764 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-multus-certs\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924790 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-etc-kubernetes\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.925329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924814 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cnibin\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924839 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924867 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kw4f5\" (UniqueName: \"kubernetes.io/projected/c978da19-b009-4f1b-ad94-7a52c0580235-kube-api-access-kw4f5\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-run-netns\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924896 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924924 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-daemon-config\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c978da19-b009-4f1b-ad94-7a52c0580235-iptables-alerter-script\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924931 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bbfaf1b-c060-48b7-8458-203eb93931a7-cni-binary-copy\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924982 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-node-log\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924949 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-system-cni-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925078 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovnkube-config\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-os-release\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cnibin\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-systemd-units\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-cni-dir\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925357 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-cni-netd\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925440 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-host-run-multus-certs\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bbfaf1b-c060-48b7-8458-203eb93931a7-cni-binary-copy\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-ovn\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovnkube-script-lib\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925500 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-etc-kubernetes\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925506 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924838 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-env-overrides\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.924982 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925556 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-multus-socket-dir-parent\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925558 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c978da19-b009-4f1b-ad94-7a52c0580235-host-slash\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925588 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c978da19-b009-4f1b-ad94-7a52c0580235-host-slash\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925593 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-kubelet\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925621 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925646 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-systemd\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925673 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-os-release\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-kubelet\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925698 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925725 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.926830 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925740 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-systemd\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925748 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-cni-bin\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925749 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bbfaf1b-c060-48b7-8458-203eb93931a7-os-release\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-run-openvswitch\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925795 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-host-cni-bin\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925800 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925814 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-system-cni-dir\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925848 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cni-binary-copy\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.925867 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2595419f-cc17-491b-b4da-f0b2fb8e46cd-system-cni-dir\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.926178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2595419f-cc17-491b-b4da-f0b2fb8e46cd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.927616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.927583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-ovn-node-metrics-cert\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.933956 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.933932 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpzpn\" (UniqueName: \"kubernetes.io/projected/a2e9e692-0e48-4cb3-8feb-82903feb8c8d-kube-api-access-fpzpn\") pod \"ovnkube-node-9qbwn\" (UID: \"a2e9e692-0e48-4cb3-8feb-82903feb8c8d\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:29.934094 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.933955 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcmhx\" (UniqueName: \"kubernetes.io/projected/2595419f-cc17-491b-b4da-f0b2fb8e46cd-kube-api-access-pcmhx\") pod \"multus-additional-cni-plugins-msk8b\" (UID: \"2595419f-cc17-491b-b4da-f0b2fb8e46cd\") " pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:29.934151 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.934120 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw4f5\" (UniqueName: \"kubernetes.io/projected/c978da19-b009-4f1b-ad94-7a52c0580235-kube-api-access-kw4f5\") pod \"iptables-alerter-7nq7b\" (UID: \"c978da19-b009-4f1b-ad94-7a52c0580235\") " pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:29.934185 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:29.934144 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9px6t\" (UniqueName: \"kubernetes.io/projected/3bbfaf1b-c060-48b7-8458-203eb93931a7-kube-api-access-9px6t\") pod \"multus-n27pg\" (UID: \"3bbfaf1b-c060-48b7-8458-203eb93931a7\") " pod="openshift-multus/multus-n27pg" Jun 03 08:44:30.005117 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.005014 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5zl66" Jun 03 08:44:30.014093 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.014061 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-f568s" Jun 03 08:44:30.025788 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.025763 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:30.031172 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.031154 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" Jun 03 08:44:30.036717 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.036700 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s5l7r" Jun 03 08:44:30.043282 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.043265 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:30.048891 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.048874 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n27pg" Jun 03 08:44:30.058450 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.058432 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7nq7b" Jun 03 08:44:30.062958 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.062943 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-msk8b" Jun 03 08:44:30.328189 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.328157 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:30.328366 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.328228 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:30.328366 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:30.328340 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:44:30.328366 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:30.328360 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:44:30.328538 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:30.328370 2561 projected.go:194] Error preparing data for projected volume kube-api-access-79gkk for pod openshift-network-diagnostics/network-check-target-6mkrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:30.328538 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:30.328344 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:30.328538 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:30.328443 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk podName:584fc893-2faa-4a49-9b00-9d79d9feb24e nodeName:}" failed. No retries permitted until 2026-06-03 08:44:31.328424493 +0000 UTC m=+4.105920129 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-79gkk" (UniqueName: "kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk") pod "network-check-target-6mkrs" (UID: "584fc893-2faa-4a49-9b00-9d79d9feb24e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:30.328538 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:30.328465 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:31.32845386 +0000 UTC m=+4.105949476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:30.499236 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.499205 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883f2d62_d81c_4308_808a_28ce50f3e7aa.slice/crio-a3cf59cd3d3044bbe3bfdfc9f0dcdc0cf46cbfe24c2a4217aa1f21253521889c WatchSource:0}: Error finding container a3cf59cd3d3044bbe3bfdfc9f0dcdc0cf46cbfe24c2a4217aa1f21253521889c: Status 404 returned error can't find the container with id a3cf59cd3d3044bbe3bfdfc9f0dcdc0cf46cbfe24c2a4217aa1f21253521889c Jun 03 08:44:30.501093 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.500932 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1bdb7b7_8768_495d_b06e_f9a66b08cfb7.slice/crio-f2671a309b2ccb3b750d0414fe7696677687c771b70e8079afc49dc297ad8767 WatchSource:0}: Error finding container f2671a309b2ccb3b750d0414fe7696677687c771b70e8079afc49dc297ad8767: Status 404 returned error can't find the container with id f2671a309b2ccb3b750d0414fe7696677687c771b70e8079afc49dc297ad8767 Jun 03 08:44:30.501691 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.501666 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e9e692_0e48_4cb3_8feb_82903feb8c8d.slice/crio-95b4209f7f556e49e65285bbe96203de14eb955d44fbef3600b379a8b3ffd851 WatchSource:0}: Error finding container 95b4209f7f556e49e65285bbe96203de14eb955d44fbef3600b379a8b3ffd851: Status 404 returned error can't find the container with id 95b4209f7f556e49e65285bbe96203de14eb955d44fbef3600b379a8b3ffd851 Jun 03 08:44:30.506471 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.504417 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a46fbf0_b72f_4030_a103_04e9de0650c8.slice/crio-e3a482768fdb336b18f79b1b0b671dc0daccf7c092020ac95fb7f8704f68719f WatchSource:0}: Error finding container e3a482768fdb336b18f79b1b0b671dc0daccf7c092020ac95fb7f8704f68719f: Status 404 returned error can't find the container with id e3a482768fdb336b18f79b1b0b671dc0daccf7c092020ac95fb7f8704f68719f Jun 03 08:44:30.506471 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.505735 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da9b4af_64c3_4b9e_9260_3470d57d256f.slice/crio-f6b5a31844b85f90b6e830da717b0b7b697d8828f9dd8b03c34a791424da9dab WatchSource:0}: Error finding container f6b5a31844b85f90b6e830da717b0b7b697d8828f9dd8b03c34a791424da9dab: Status 404 returned error can't find the container with id f6b5a31844b85f90b6e830da717b0b7b697d8828f9dd8b03c34a791424da9dab Jun 03 08:44:30.507013 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.506990 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc978da19_b009_4f1b_ad94_7a52c0580235.slice/crio-eb39e66b9279698ce90c9c148f17cc2debb8a6f47d24e4b23f65bc2673841ffe WatchSource:0}: Error finding container eb39e66b9279698ce90c9c148f17cc2debb8a6f47d24e4b23f65bc2673841ffe: Status 404 returned error can't find the container with id eb39e66b9279698ce90c9c148f17cc2debb8a6f47d24e4b23f65bc2673841ffe Jun 03 08:44:30.507676 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.507653 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbfaf1b_c060_48b7_8458_203eb93931a7.slice/crio-ad8bb323aa29a344b4364b6661ddfc48aa20d6bf5f6a44d1bdf98133467fd39d WatchSource:0}: Error finding container ad8bb323aa29a344b4364b6661ddfc48aa20d6bf5f6a44d1bdf98133467fd39d: Status 404 returned error can't find the container with id ad8bb323aa29a344b4364b6661ddfc48aa20d6bf5f6a44d1bdf98133467fd39d Jun 03 08:44:30.509835 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.509785 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bfcc55_0169_4fb1_b546_4839143aa713.slice/crio-fbcfedb577bbda98cf53485579821c3a716208a642c1978893b3b4f4f6d36754 WatchSource:0}: Error finding container fbcfedb577bbda98cf53485579821c3a716208a642c1978893b3b4f4f6d36754: Status 404 returned error can't find the container with id fbcfedb577bbda98cf53485579821c3a716208a642c1978893b3b4f4f6d36754 Jun 03 08:44:30.510900 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:44:30.510880 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2595419f_cc17_491b_b4da_f0b2fb8e46cd.slice/crio-2635b6053fe53ab98923095a7684e8de6ee012d48fe1b085feaa407ce8a58503 WatchSource:0}: Error finding container 2635b6053fe53ab98923095a7684e8de6ee012d48fe1b085feaa407ce8a58503: Status 404 returned error can't find the container with id 2635b6053fe53ab98923095a7684e8de6ee012d48fe1b085feaa407ce8a58503 Jun 03 08:44:30.761019 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.760982 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 08:39:28 +0000 UTC" deadline="2027-11-28 21:07:48.105434897 +0000 UTC" Jun 03 08:44:30.761309 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.761018 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13044h23m17.344419947s" Jun 03 08:44:30.833063 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.833041 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:30.833161 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:30.833143 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:30.839807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.839783 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7nq7b" event={"ID":"c978da19-b009-4f1b-ad94-7a52c0580235","Type":"ContainerStarted","Data":"eb39e66b9279698ce90c9c148f17cc2debb8a6f47d24e4b23f65bc2673841ffe"} Jun 03 08:44:30.840732 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.840711 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mfh47" event={"ID":"4a46fbf0-b72f-4030-a103-04e9de0650c8","Type":"ContainerStarted","Data":"e3a482768fdb336b18f79b1b0b671dc0daccf7c092020ac95fb7f8704f68719f"} Jun 03 08:44:30.842153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.842126 2561 generic.go:358] "Generic (PLEG): container finished" podID="ab349e23911c616e8ef6603638c00ac8" containerID="c3c7a8e8a6059464d817bcc4a50485f9813cef36cdf97027f8dd324b1322a247" exitCode=0 Jun 03 08:44:30.842250 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.842163 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" event={"ID":"ab349e23911c616e8ef6603638c00ac8","Type":"ContainerDied","Data":"c3c7a8e8a6059464d817bcc4a50485f9813cef36cdf97027f8dd324b1322a247"} Jun 03 08:44:30.844906 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.844879 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerStarted","Data":"2635b6053fe53ab98923095a7684e8de6ee012d48fe1b085feaa407ce8a58503"} Jun 03 08:44:30.846265 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.846245 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n27pg" event={"ID":"3bbfaf1b-c060-48b7-8458-203eb93931a7","Type":"ContainerStarted","Data":"ad8bb323aa29a344b4364b6661ddfc48aa20d6bf5f6a44d1bdf98133467fd39d"} Jun 03 08:44:30.847271 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.847252 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" event={"ID":"4da9b4af-64c3-4b9e-9260-3470d57d256f","Type":"ContainerStarted","Data":"f6b5a31844b85f90b6e830da717b0b7b697d8828f9dd8b03c34a791424da9dab"} Jun 03 08:44:30.848188 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.848166 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"95b4209f7f556e49e65285bbe96203de14eb955d44fbef3600b379a8b3ffd851"} Jun 03 08:44:30.849134 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.849113 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f568s" event={"ID":"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7","Type":"ContainerStarted","Data":"f2671a309b2ccb3b750d0414fe7696677687c771b70e8079afc49dc297ad8767"} Jun 03 08:44:30.850240 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.850222 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5zl66" event={"ID":"883f2d62-d81c-4308-808a-28ce50f3e7aa","Type":"ContainerStarted","Data":"a3cf59cd3d3044bbe3bfdfc9f0dcdc0cf46cbfe24c2a4217aa1f21253521889c"} Jun 03 08:44:30.851901 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.851871 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" event={"ID":"59c1ea0db4c1eed4c8a1ee0ed3fb18d2","Type":"ContainerStarted","Data":"ba9be21a1dd803fe7cb320d71364c18db5adf1a2815947ab46ba0cab31e119d7"} Jun 03 08:44:30.853175 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.853155 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s5l7r" event={"ID":"71bfcc55-0169-4fb1-b546-4839143aa713","Type":"ContainerStarted","Data":"fbcfedb577bbda98cf53485579821c3a716208a642c1978893b3b4f4f6d36754"} Jun 03 08:44:30.872613 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:30.872526 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-22.ec2.internal" podStartSLOduration=2.872508255 podStartE2EDuration="2.872508255s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:44:30.872278192 +0000 UTC m=+3.649773831" watchObservedRunningTime="2026-06-03 08:44:30.872508255 +0000 UTC m=+3.650003895" Jun 03 08:44:31.335356 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:31.335307 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:31.335526 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:31.335417 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:31.335590 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:31.335573 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:44:31.335633 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:31.335596 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:44:31.335633 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:31.335608 2561 projected.go:194] Error preparing data for projected volume kube-api-access-79gkk for pod openshift-network-diagnostics/network-check-target-6mkrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:31.335748 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:31.335680 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk podName:584fc893-2faa-4a49-9b00-9d79d9feb24e nodeName:}" failed. No retries permitted until 2026-06-03 08:44:33.335661773 +0000 UTC m=+6.113157392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-79gkk" (UniqueName: "kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk") pod "network-check-target-6mkrs" (UID: "584fc893-2faa-4a49-9b00-9d79d9feb24e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:31.336124 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:31.336101 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:31.336235 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:31.336163 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:33.336146508 +0000 UTC m=+6.113642129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:31.833569 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:31.833538 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:31.834018 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:31.833667 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:31.890369 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:31.890335 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" event={"ID":"ab349e23911c616e8ef6603638c00ac8","Type":"ContainerStarted","Data":"97f8e1847c28293a8dad8fff4e1994a154dccd9be8848e8ee3fa04f98f0ad7a4"} Jun 03 08:44:32.832915 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:32.832872 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:32.833093 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:32.833028 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:33.361842 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:33.361934 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:33.362058 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:33.362116 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:37.362096778 +0000 UTC m=+10.139592397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:33.362598 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:33.362615 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:33.362628 2561 projected.go:194] Error preparing data for projected volume kube-api-access-79gkk for pod openshift-network-diagnostics/network-check-target-6mkrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:33.362705 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:33.362672 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk podName:584fc893-2faa-4a49-9b00-9d79d9feb24e nodeName:}" failed. No retries permitted until 2026-06-03 08:44:37.362657261 +0000 UTC m=+10.140152884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-79gkk" (UniqueName: "kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk") pod "network-check-target-6mkrs" (UID: "584fc893-2faa-4a49-9b00-9d79d9feb24e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:33.844093 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:33.843553 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:33.844093 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:33.843723 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:34.832620 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:34.832584 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:34.833022 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:34.832742 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:35.833504 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:35.833448 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:35.833863 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:35.833653 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:36.833355 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:36.832829 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:36.833355 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:36.833008 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:37.396127 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:37.396226 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:37.396320 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:37.396331 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:37.396350 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:37.396364 2561 projected.go:194] Error preparing data for projected volume kube-api-access-79gkk for pod openshift-network-diagnostics/network-check-target-6mkrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:37.396415 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:44:45.396399183 +0000 UTC m=+18.173894815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:37.396770 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:37.396436 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk podName:584fc893-2faa-4a49-9b00-9d79d9feb24e nodeName:}" failed. No retries permitted until 2026-06-03 08:44:45.39642657 +0000 UTC m=+18.173922186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-79gkk" (UniqueName: "kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk") pod "network-check-target-6mkrs" (UID: "584fc893-2faa-4a49-9b00-9d79d9feb24e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:37.836544 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:37.836510 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:37.837019 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:37.836632 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:38.832960 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:38.832466 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:38.832960 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:38.832615 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:39.836205 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:39.836176 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:39.836754 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:39.836291 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:40.832860 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:40.832824 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:40.833038 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:40.832948 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:41.832906 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:41.832871 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:41.833427 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:41.832987 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:42.833365 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:42.833327 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:42.833827 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:42.833492 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:43.832779 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:43.832742 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:43.832934 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:43.832869 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:44.832744 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:44.832707 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:44.833157 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:44.832843 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:45.457418 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:45.457366 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:45.457581 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:45.457453 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:45.457581 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:45.457541 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:45.457667 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:45.457592 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:44:45.457667 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:45.457608 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:01.457592902 +0000 UTC m=+34.235088521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:44:45.457667 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:45.457609 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:44:45.457667 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:45.457623 2561 projected.go:194] Error preparing data for projected volume kube-api-access-79gkk for pod openshift-network-diagnostics/network-check-target-6mkrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:45.457667 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:45.457659 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk podName:584fc893-2faa-4a49-9b00-9d79d9feb24e nodeName:}" failed. No retries permitted until 2026-06-03 08:45:01.457647999 +0000 UTC m=+34.235143615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-79gkk" (UniqueName: "kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk") pod "network-check-target-6mkrs" (UID: "584fc893-2faa-4a49-9b00-9d79d9feb24e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:44:45.835148 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:45.832938 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:45.835148 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:45.833066 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:46.833424 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:46.833387 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:46.833599 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:46.833519 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:47.833576 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:47.833550 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:47.833992 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:47.833637 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:48.833372 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:48.833339 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:48.833498 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:48.833453 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:49.833673 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.833372 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:49.834583 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:49.833748 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:49.925259 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.925223 2561 generic.go:358] "Generic (PLEG): container finished" podID="2595419f-cc17-491b-b4da-f0b2fb8e46cd" containerID="807463e56875ca05a07515c61651879956585c7cfe58a824908c2b59730d0fe2" exitCode=0 Jun 03 08:44:49.925442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.925255 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerDied","Data":"807463e56875ca05a07515c61651879956585c7cfe58a824908c2b59730d0fe2"} Jun 03 08:44:49.926805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.926762 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n27pg" event={"ID":"3bbfaf1b-c060-48b7-8458-203eb93931a7","Type":"ContainerStarted","Data":"4b5b382868c65bf7df423b6708a0620ccc8efcc183d8dcb7791ca3d3d8d62144"} Jun 03 08:44:49.928293 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.928265 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" event={"ID":"4da9b4af-64c3-4b9e-9260-3470d57d256f","Type":"ContainerStarted","Data":"ac317bc194fd3126f967c592c71c7f2caaed0a167274df261513229c3a5d3ea6"} Jun 03 08:44:49.930855 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.930841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:44:49.931188 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.931162 2561 generic.go:358] "Generic (PLEG): container finished" podID="a2e9e692-0e48-4cb3-8feb-82903feb8c8d" containerID="f57930a627f3c448cbe50dc87e425cc6b40e30083dfa6982433b02dfb980dbed" exitCode=1 Jun 03 08:44:49.931260 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.931224 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"6d477ed981c86da8b53fdef0daa57d6375a732ebc5e7ffbfcd2f373dd5e87526"} Jun 03 08:44:49.931260 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.931249 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"a0558f25b0e709fb10b8436645ff7a60927ade843819f0a2a3e0e7bb866b8368"} Jun 03 08:44:49.931359 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.931273 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"1641c382709a3bd139842d868251bf6aa28101af8166e27abaa5ff9baa53658e"} Jun 03 08:44:49.931359 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.931285 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerDied","Data":"f57930a627f3c448cbe50dc87e425cc6b40e30083dfa6982433b02dfb980dbed"} Jun 03 08:44:49.931359 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.931299 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"bd43bfbecd48d9046d2aea937ef579faea949bccb1fb5a1ceb9167b04973c590"} Jun 03 08:44:49.933170 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.933133 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-f568s" event={"ID":"e1bdb7b7-8768-495d-b06e-f9a66b08cfb7","Type":"ContainerStarted","Data":"409e9caf39e29062cfc97c05a523e95273006fa0ca012f3de469dc7b8ecb4183"} Jun 03 08:44:49.938490 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.938468 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5zl66" event={"ID":"883f2d62-d81c-4308-808a-28ce50f3e7aa","Type":"ContainerStarted","Data":"f51f6309b378860b8376677854e5b5dbf56c724f7cecc0b9fb1036d5e84f1b3a"} Jun 03 08:44:49.939812 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.939791 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s5l7r" event={"ID":"71bfcc55-0169-4fb1-b546-4839143aa713","Type":"ContainerStarted","Data":"c38ee67166f135d2214d031012a15baebcaacd1252e4067238621f73bd26cc7e"} Jun 03 08:44:49.941033 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.941013 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mfh47" event={"ID":"4a46fbf0-b72f-4030-a103-04e9de0650c8","Type":"ContainerStarted","Data":"cc20ad9496ce47ca1c5da1786740000e8b03c880cf7ec894d798ccb09663c325"} Jun 03 08:44:49.947662 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.947620 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-22.ec2.internal" podStartSLOduration=21.947588106 podStartE2EDuration="21.947588106s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:44:31.909532475 +0000 UTC m=+4.687028113" watchObservedRunningTime="2026-06-03 08:44:49.947588106 +0000 UTC m=+22.725083727" Jun 03 08:44:49.961266 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.961232 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5zl66" podStartSLOduration=4.445370338 podStartE2EDuration="22.961219559s" podCreationTimestamp="2026-06-03 08:44:27 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.501454461 +0000 UTC m=+3.278950090" lastFinishedPulling="2026-06-03 08:44:49.017303692 +0000 UTC m=+21.794799311" observedRunningTime="2026-06-03 08:44:49.961138985 +0000 UTC m=+22.738634624" watchObservedRunningTime="2026-06-03 08:44:49.961219559 +0000 UTC m=+22.738715198" Jun 03 08:44:49.976505 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.976220 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-s5l7r" podStartSLOduration=3.549109404 podStartE2EDuration="21.976210034s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.512321613 +0000 UTC m=+3.289817230" lastFinishedPulling="2026-06-03 08:44:48.939422229 +0000 UTC m=+21.716917860" observedRunningTime="2026-06-03 08:44:49.975657088 +0000 UTC m=+22.753152727" watchObservedRunningTime="2026-06-03 08:44:49.976210034 +0000 UTC m=+22.753705673" Jun 03 08:44:49.994143 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:49.994060 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-f568s" podStartSLOduration=3.511901865 podStartE2EDuration="21.994050379s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.503538708 +0000 UTC m=+3.281034335" lastFinishedPulling="2026-06-03 08:44:48.985687224 +0000 UTC m=+21.763182849" observedRunningTime="2026-06-03 08:44:49.993935002 +0000 UTC m=+22.771430639" watchObservedRunningTime="2026-06-03 08:44:49.994050379 +0000 UTC m=+22.771546016" Jun 03 08:44:50.008993 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.008959 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mfh47" podStartSLOduration=3.575911041 podStartE2EDuration="22.008948276s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.506262226 +0000 UTC m=+3.283757845" lastFinishedPulling="2026-06-03 08:44:48.939299461 +0000 UTC m=+21.716795080" observedRunningTime="2026-06-03 08:44:50.008676509 +0000 UTC m=+22.786172147" watchObservedRunningTime="2026-06-03 08:44:50.008948276 +0000 UTC m=+22.786443914" Jun 03 08:44:50.047812 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.047769 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-n27pg" podStartSLOduration=3.539578835 podStartE2EDuration="22.047753848s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.509472903 +0000 UTC m=+3.286968519" lastFinishedPulling="2026-06-03 08:44:49.017647901 +0000 UTC m=+21.795143532" observedRunningTime="2026-06-03 08:44:50.04709124 +0000 UTC m=+22.824586878" watchObservedRunningTime="2026-06-03 08:44:50.047753848 +0000 UTC m=+22.825249500" Jun 03 08:44:50.192895 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.192874 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 08:44:50.787622 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.787511 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T08:44:50.192890198Z","UUID":"c583183f-963e-49e3-ae90-415cd0f3138b","Handler":null,"Name":"","Endpoint":""} Jun 03 08:44:50.790658 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.789960 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 08:44:50.790808 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.790679 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 08:44:50.832756 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.832730 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:50.832914 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:50.832831 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:50.944864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.944825 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" event={"ID":"4da9b4af-64c3-4b9e-9260-3470d57d256f","Type":"ContainerStarted","Data":"ae31a7de11ffe2081037080eaf393404b73f1c02657ef8167c50f36d224bfafe"} Jun 03 08:44:50.947585 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.947560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:44:50.948063 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.948033 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"1af6bd1b16bd3b413205512a6935f1775c7914a970f8efba39d2ada500346a85"} Jun 03 08:44:50.949445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.949419 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7nq7b" event={"ID":"c978da19-b009-4f1b-ad94-7a52c0580235","Type":"ContainerStarted","Data":"2e27b4507a4ed6cda07e3abf309aa743b31d64502328c28503a0224f75ca7d60"} Jun 03 08:44:50.964465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:50.964419 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7nq7b" podStartSLOduration=4.450917748 podStartE2EDuration="22.964403888s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.50853676 +0000 UTC m=+3.286032379" lastFinishedPulling="2026-06-03 08:44:49.022022902 +0000 UTC m=+21.799518519" observedRunningTime="2026-06-03 08:44:50.963829197 +0000 UTC m=+23.741324836" watchObservedRunningTime="2026-06-03 08:44:50.964403888 +0000 UTC m=+23.741899527" Jun 03 08:44:51.833118 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:51.832947 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:51.833307 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:51.833185 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:51.952917 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:51.952883 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" event={"ID":"4da9b4af-64c3-4b9e-9260-3470d57d256f","Type":"ContainerStarted","Data":"ff849840edc163e1738834ebc18f8b560ea3e18e7f20489861615bc0ba0c2cdc"} Jun 03 08:44:52.832703 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:52.832662 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:52.832887 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:52.832808 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:52.960736 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:52.960708 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:44:52.961282 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:52.961076 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"c5914dc12628aa3cfdd2b7676bf45d1786afd4043e6a589aeff4f00ec95e2698"} Jun 03 08:44:53.095432 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:53.095336 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:53.096011 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:53.095988 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:53.114040 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:53.113992 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-njnmd" podStartSLOduration=4.175854536 podStartE2EDuration="25.113979635s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.507444754 +0000 UTC m=+3.284940373" lastFinishedPulling="2026-06-03 08:44:51.445569855 +0000 UTC m=+24.223065472" observedRunningTime="2026-06-03 08:44:51.970290628 +0000 UTC m=+24.747786267" watchObservedRunningTime="2026-06-03 08:44:53.113979635 +0000 UTC m=+25.891475324" Jun 03 08:44:53.832610 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:53.832578 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:53.832779 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:53.832702 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:53.963735 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:53.963706 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:53.964992 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:53.964969 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mfh47" Jun 03 08:44:54.832884 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:54.832848 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:54.833084 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:54.832998 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:55.833412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.833164 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:55.833776 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:55.833515 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:55.970804 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.970782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:44:55.971178 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.971157 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"8431e9b8ec026679d5cdd12b19dcdd6d95ff4e4d05ea7f07c2e9b8216ec2ddcb"} Jun 03 08:44:55.971501 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.971480 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:55.971585 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.971513 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:55.971668 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.971653 2561 scope.go:117] "RemoveContainer" containerID="f57930a627f3c448cbe50dc87e425cc6b40e30083dfa6982433b02dfb980dbed" Jun 03 08:44:55.973078 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.973051 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerStarted","Data":"50f9dfda3af1b195acf3882427824008444aaff5906e406505aa5d7fb10893e6"} Jun 03 08:44:55.988326 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:55.988304 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:56.833212 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:56.833173 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:56.833372 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:56.833324 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:56.977083 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:56.977050 2561 generic.go:358] "Generic (PLEG): container finished" podID="2595419f-cc17-491b-b4da-f0b2fb8e46cd" containerID="50f9dfda3af1b195acf3882427824008444aaff5906e406505aa5d7fb10893e6" exitCode=0 Jun 03 08:44:56.977616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:56.977130 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerDied","Data":"50f9dfda3af1b195acf3882427824008444aaff5906e406505aa5d7fb10893e6"} Jun 03 08:44:56.980864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:56.980846 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:44:56.981193 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:56.981169 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" event={"ID":"a2e9e692-0e48-4cb3-8feb-82903feb8c8d","Type":"ContainerStarted","Data":"2a143c90579d10b10ecaf91e056dba1917b80efbd97598f5058d7bf63e9d90c7"} Jun 03 08:44:56.981586 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:56.981567 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:56.997130 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:56.997104 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:44:57.027899 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:57.027857 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" podStartSLOduration=10.500278808000001 podStartE2EDuration="29.02784318s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.503899505 +0000 UTC m=+3.281395123" lastFinishedPulling="2026-06-03 08:44:49.031463878 +0000 UTC m=+21.808959495" observedRunningTime="2026-06-03 08:44:57.026277332 +0000 UTC m=+29.803772984" watchObservedRunningTime="2026-06-03 08:44:57.02784318 +0000 UTC m=+29.805338864" Jun 03 08:44:57.558147 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:57.557945 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6mkrs"] Jun 03 08:44:57.558333 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:57.558239 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:57.558439 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:57.558330 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:44:57.558729 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:57.558704 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9mnc"] Jun 03 08:44:57.558989 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:57.558833 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:57.558989 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:57.558950 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:58.832566 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:58.832537 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:44:58.833119 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:58.832651 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:44:58.985853 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:58.985774 2561 generic.go:358] "Generic (PLEG): container finished" podID="2595419f-cc17-491b-b4da-f0b2fb8e46cd" containerID="e83d5c531354574cf2ca42f4314a5968344cf4d17dc1d365739253e6183e70fb" exitCode=0 Jun 03 08:44:58.985976 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:58.985846 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerDied","Data":"e83d5c531354574cf2ca42f4314a5968344cf4d17dc1d365739253e6183e70fb"} Jun 03 08:44:59.832701 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:44:59.832669 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:44:59.833027 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:44:59.832768 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:45:00.832619 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:00.832588 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:45:00.832793 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:00.832694 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:45:00.991691 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:00.991648 2561 generic.go:358] "Generic (PLEG): container finished" podID="2595419f-cc17-491b-b4da-f0b2fb8e46cd" containerID="bdc6be8d68f593a7071a9d447c17e99bc03530622610597c498acd1fbd97119d" exitCode=0 Jun 03 08:45:00.991849 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:00.991725 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerDied","Data":"bdc6be8d68f593a7071a9d447c17e99bc03530622610597c498acd1fbd97119d"} Jun 03 08:45:01.478395 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:01.478337 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:45:01.478678 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:01.478423 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:45:01.478678 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:01.478475 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:45:01.478678 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:01.478541 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:45:33.478526491 +0000 UTC m=+66.256022113 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 08:45:01.478678 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:01.478561 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 08:45:01.478678 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:01.478578 2561 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 08:45:01.478678 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:01.478591 2561 projected.go:194] Error preparing data for projected volume kube-api-access-79gkk for pod openshift-network-diagnostics/network-check-target-6mkrs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:45:01.478678 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:01.478647 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk podName:584fc893-2faa-4a49-9b00-9d79d9feb24e nodeName:}" failed. No retries permitted until 2026-06-03 08:45:33.478629376 +0000 UTC m=+66.256124993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-79gkk" (UniqueName: "kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk") pod "network-check-target-6mkrs" (UID: "584fc893-2faa-4a49-9b00-9d79d9feb24e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 08:45:01.832942 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:01.832912 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:45:01.833307 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:01.833046 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6mkrs" podUID="584fc893-2faa-4a49-9b00-9d79d9feb24e" Jun 03 08:45:02.094026 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.093987 2561 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-22.ec2.internal" event="NodeReady" Jun 03 08:45:02.094210 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.094129 2561 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 08:45:02.139586 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.139555 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zwpb7"] Jun 03 08:45:02.154160 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.154111 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4469f"] Jun 03 08:45:02.154368 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.154290 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.166020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.165995 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zwpb7"] Jun 03 08:45:02.166020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.166021 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4469f"] Jun 03 08:45:02.166201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.166103 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:02.174810 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.174793 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jkth\"" Jun 03 08:45:02.175326 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.175311 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 08:45:02.175808 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.175788 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 08:45:02.175938 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.175925 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 08:45:02.176202 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.176186 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 08:45:02.176252 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.176203 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qg6q\"" Jun 03 08:45:02.176318 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.176303 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 08:45:02.283426 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.283391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.283617 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.283436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9285be91-f419-4043-89c1-b29c044bc09a-config-volume\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.283617 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.283500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rbsg\" (UniqueName: \"kubernetes.io/projected/9285be91-f419-4043-89c1-b29c044bc09a-kube-api-access-2rbsg\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.283617 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.283525 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh587\" (UniqueName: \"kubernetes.io/projected/26932fb2-d30f-4b60-8195-f92cd29aea4d-kube-api-access-xh587\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:02.283617 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.283553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9285be91-f419-4043-89c1-b29c044bc09a-tmp-dir\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.283617 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.283570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:02.384636 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.384546 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.384636 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.384586 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9285be91-f419-4043-89c1-b29c044bc09a-config-volume\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.384636 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.384626 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2rbsg\" (UniqueName: \"kubernetes.io/projected/9285be91-f419-4043-89c1-b29c044bc09a-kube-api-access-2rbsg\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.384903 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.384649 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xh587\" (UniqueName: \"kubernetes.io/projected/26932fb2-d30f-4b60-8195-f92cd29aea4d-kube-api-access-xh587\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:02.384903 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.384667 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9285be91-f419-4043-89c1-b29c044bc09a-tmp-dir\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.384903 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.384691 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:02.384903 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.384712 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:45:02.384903 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.384777 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:45:02.884752059 +0000 UTC m=+35.662247675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:45:02.384903 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.384777 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:45:02.384903 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.384806 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:45:02.884800445 +0000 UTC m=+35.662296060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:45:02.385327 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.385227 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9285be91-f419-4043-89c1-b29c044bc09a-tmp-dir\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.385519 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.385495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9285be91-f419-4043-89c1-b29c044bc09a-config-volume\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.395731 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.395587 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rbsg\" (UniqueName: \"kubernetes.io/projected/9285be91-f419-4043-89c1-b29c044bc09a-kube-api-access-2rbsg\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.395854 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.395653 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh587\" (UniqueName: \"kubernetes.io/projected/26932fb2-d30f-4b60-8195-f92cd29aea4d-kube-api-access-xh587\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:02.832626 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.832596 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:45:02.835935 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.835908 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 08:45:02.836269 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.835908 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llh4q\"" Jun 03 08:45:02.888126 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.888089 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:02.888287 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:02.888170 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:02.888287 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.888251 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:45:02.888287 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.888273 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:45:02.888466 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.888317 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:45:03.888297295 +0000 UTC m=+36.665792914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:45:02.888466 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:02.888337 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:45:03.888327671 +0000 UTC m=+36.665823286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:45:03.833020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:03.832985 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:45:03.836308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:03.836284 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 08:45:03.836757 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:03.836350 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 08:45:03.837390 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:03.837354 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nhrw\"" Jun 03 08:45:03.896502 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:03.896470 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:03.896626 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:03.896543 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:03.896626 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:03.896616 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:45:03.896745 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:03.896670 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:45:03.896745 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:03.896692 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:45:05.896671129 +0000 UTC m=+38.674166745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:45:03.896745 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:03.896717 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:45:05.896701103 +0000 UTC m=+38.674196722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:45:05.910973 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:05.910931 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:05.911447 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:05.911018 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:05.911447 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:05.911099 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:45:05.911447 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:05.911161 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:45:09.911145227 +0000 UTC m=+42.688640843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:45:05.911447 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:05.911196 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:45:05.911447 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:05.911269 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:45:09.911250825 +0000 UTC m=+42.688746444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:45:08.005891 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:08.005857 2561 generic.go:358] "Generic (PLEG): container finished" podID="2595419f-cc17-491b-b4da-f0b2fb8e46cd" containerID="5e8b032c08f079b24d07155835c403204007eb18c055a87a4b667774326be795" exitCode=0 Jun 03 08:45:08.006249 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:08.005932 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerDied","Data":"5e8b032c08f079b24d07155835c403204007eb18c055a87a4b667774326be795"} Jun 03 08:45:09.010130 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:09.010097 2561 generic.go:358] "Generic (PLEG): container finished" podID="2595419f-cc17-491b-b4da-f0b2fb8e46cd" containerID="4b518e64e20bd39e2ed82bd5154236162e2023ab05f557af94c0162add1f3698" exitCode=0 Jun 03 08:45:09.010511 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:09.010163 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerDied","Data":"4b518e64e20bd39e2ed82bd5154236162e2023ab05f557af94c0162add1f3698"} Jun 03 08:45:09.940057 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:09.940004 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:09.940364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:09.940081 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:09.940364 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:09.940176 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:45:09.940364 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:09.940189 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:45:09.940364 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:09.940246 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:45:17.940230461 +0000 UTC m=+50.717726077 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:45:09.940364 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:09.940259 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:45:17.940253123 +0000 UTC m=+50.717748739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:45:10.014798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:10.014763 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-msk8b" event={"ID":"2595419f-cc17-491b-b4da-f0b2fb8e46cd","Type":"ContainerStarted","Data":"87e8f0613994a8721741d8d6bdb03bff2c9621e0b5d59cbdbd417078f9727f6b"} Jun 03 08:45:10.039702 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:10.039657 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-msk8b" podStartSLOduration=5.047218178 podStartE2EDuration="42.039642569s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:44:30.512149121 +0000 UTC m=+3.289644740" lastFinishedPulling="2026-06-03 08:45:07.504573511 +0000 UTC m=+40.282069131" observedRunningTime="2026-06-03 08:45:10.037921363 +0000 UTC m=+42.815417000" watchObservedRunningTime="2026-06-03 08:45:10.039642569 +0000 UTC m=+42.817138207" Jun 03 08:45:17.995188 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:17.995146 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:17.995716 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:17.995217 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:17.995716 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:17.995311 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:45:17.995716 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:17.995331 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:45:17.995716 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:17.995404 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:45:33.99537002 +0000 UTC m=+66.772865649 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:45:17.995716 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:17.995419 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:45:33.995413578 +0000 UTC m=+66.772909199 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:45:28.999606 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:28.997250 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qbwn" Jun 03 08:45:33.501254 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.501219 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:45:33.501692 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.501280 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:45:33.504474 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.504443 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 08:45:33.504474 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.504446 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 08:45:33.511838 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:33.511824 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 08:45:33.511897 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:33.511876 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:46:37.511859717 +0000 UTC m=+130.289355332 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : secret "metrics-daemon-secret" not found Jun 03 08:45:33.514214 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.514200 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 08:45:33.525054 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.525030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79gkk\" (UniqueName: \"kubernetes.io/projected/584fc893-2faa-4a49-9b00-9d79d9feb24e-kube-api-access-79gkk\") pod \"network-check-target-6mkrs\" (UID: \"584fc893-2faa-4a49-9b00-9d79d9feb24e\") " pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:45:33.545408 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.545370 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2nhrw\"" Jun 03 08:45:33.553473 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.553456 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:45:33.681862 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:33.681835 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6mkrs"] Jun 03 08:45:33.685203 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:45:33.685177 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod584fc893_2faa_4a49_9b00_9d79d9feb24e.slice/crio-18a8fcf9ba39a76e0f05148d3f12f74ae9cde7eeae72204e8ff0bceae5c3da03 WatchSource:0}: Error finding container 18a8fcf9ba39a76e0f05148d3f12f74ae9cde7eeae72204e8ff0bceae5c3da03: Status 404 returned error can't find the container with id 18a8fcf9ba39a76e0f05148d3f12f74ae9cde7eeae72204e8ff0bceae5c3da03 Jun 03 08:45:34.005310 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:34.005273 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:45:34.005541 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:34.005324 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:45:34.005541 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:34.005452 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:45:34.005541 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:34.005458 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:45:34.005541 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:34.005513 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:46:06.00549965 +0000 UTC m=+98.782995266 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:45:34.005541 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:45:34.005536 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:46:06.005518119 +0000 UTC m=+98.783013740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:45:34.061940 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:34.061887 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6mkrs" event={"ID":"584fc893-2faa-4a49-9b00-9d79d9feb24e","Type":"ContainerStarted","Data":"18a8fcf9ba39a76e0f05148d3f12f74ae9cde7eeae72204e8ff0bceae5c3da03"} Jun 03 08:45:37.068941 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:37.068906 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6mkrs" event={"ID":"584fc893-2faa-4a49-9b00-9d79d9feb24e","Type":"ContainerStarted","Data":"010326642ae7e6417d4f6f7cb8bf02987676e437040151762d89091df4a5bf06"} Jun 03 08:45:37.069415 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:37.069052 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:45:37.087062 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:45:37.087017 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6mkrs" podStartSLOduration=66.297841364 podStartE2EDuration="1m9.087004005s" podCreationTimestamp="2026-06-03 08:44:28 +0000 UTC" firstStartedPulling="2026-06-03 08:45:33.686950484 +0000 UTC m=+66.464446100" lastFinishedPulling="2026-06-03 08:45:36.476113126 +0000 UTC m=+69.253608741" observedRunningTime="2026-06-03 08:45:37.086352531 +0000 UTC m=+69.863848169" watchObservedRunningTime="2026-06-03 08:45:37.087004005 +0000 UTC m=+69.864499644" Jun 03 08:46:06.021123 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:06.020991 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:46:06.021123 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:06.021044 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:46:06.021636 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:06.021149 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 08:46:06.021636 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:06.021153 2561 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 08:46:06.021636 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:06.021207 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls podName:9285be91-f419-4043-89c1-b29c044bc09a nodeName:}" failed. No retries permitted until 2026-06-03 08:47:10.021189326 +0000 UTC m=+162.798684944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls") pod "dns-default-zwpb7" (UID: "9285be91-f419-4043-89c1-b29c044bc09a") : secret "dns-default-metrics-tls" not found Jun 03 08:46:06.021636 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:06.021221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert podName:26932fb2-d30f-4b60-8195-f92cd29aea4d nodeName:}" failed. No retries permitted until 2026-06-03 08:47:10.021214289 +0000 UTC m=+162.798709905 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert") pod "ingress-canary-4469f" (UID: "26932fb2-d30f-4b60-8195-f92cd29aea4d") : secret "canary-serving-cert" not found Jun 03 08:46:08.073543 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:08.073510 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6mkrs" Jun 03 08:46:34.730507 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.730474 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn"] Jun 03 08:46:34.733322 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.733307 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:34.736489 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.736464 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:46:34.736597 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.736541 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 08:46:34.737969 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.737938 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 08:46:34.738066 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.737988 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-scglt\"" Jun 03 08:46:34.742013 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.741993 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn"] Jun 03 08:46:34.814615 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.814589 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:34.814730 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.814633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds2zv\" (UniqueName: \"kubernetes.io/projected/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-kube-api-access-ds2zv\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:34.835287 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.835263 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt"] Jun 03 08:46:34.837198 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.837185 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" Jun 03 08:46:34.838887 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.838867 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-fflk7"] Jun 03 08:46:34.840455 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.840439 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:46:34.840455 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.840440 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2stqx\"" Jun 03 08:46:34.840727 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.840706 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:34.840836 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.840706 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 08:46:34.842940 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.842922 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2fhnj"] Jun 03 08:46:34.844959 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.844947 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:34.846909 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.846891 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 08:46:34.847115 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.847103 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 08:46:34.847371 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.847356 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ww4hk\"" Jun 03 08:46:34.847439 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.847391 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:46:34.847776 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.847759 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 08:46:34.847854 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.847776 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 08:46:34.847854 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.847764 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 08:46:34.851210 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.851112 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 08:46:34.851425 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.851366 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wv26z\"" Jun 03 08:46:34.851510 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.851426 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 08:46:34.853632 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.853613 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt"] Jun 03 08:46:34.860712 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.860684 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 08:46:34.861512 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.861493 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 08:46:34.862588 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.862556 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2fhnj"] Jun 03 08:46:34.867540 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.867523 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-fflk7"] Jun 03 08:46:34.915674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.915650 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:34.915767 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.915685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tc6q\" (UniqueName: \"kubernetes.io/projected/c0aad718-1000-4ab8-9e27-f7d088e3be32-kube-api-access-5tc6q\") pod \"volume-data-source-validator-7598fd5bd-zbwmt\" (UID: \"c0aad718-1000-4ab8-9e27-f7d088e3be32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" Jun 03 08:46:34.915811 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:34.915781 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:46:34.915847 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.915813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6770ff4a-0374-417d-924c-c0ab14114b3b-snapshots\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:34.915882 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:34.915846 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls podName:6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:35.415826514 +0000 UTC m=+128.193322145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rjwmn" (UID: "6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf") : secret "samples-operator-tls" not found Jun 03 08:46:34.915953 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.915935 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ds2zv\" (UniqueName: \"kubernetes.io/projected/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-kube-api-access-ds2zv\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:34.915988 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.915971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6770ff4a-0374-417d-924c-c0ab14114b3b-tmp\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:34.916029 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.915996 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59zm\" (UniqueName: \"kubernetes.io/projected/6770ff4a-0374-417d-924c-c0ab14114b3b-kube-api-access-r59zm\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:34.916029 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.916021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a921e6ac-45f3-4eda-bdd2-2303eb26b521-serving-cert\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:34.916092 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.916064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6770ff4a-0374-417d-924c-c0ab14114b3b-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:34.916092 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.916086 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6770ff4a-0374-417d-924c-c0ab14114b3b-service-ca-bundle\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:34.916155 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.916101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a921e6ac-45f3-4eda-bdd2-2303eb26b521-trusted-ca\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:34.916155 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.916119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6770ff4a-0374-417d-924c-c0ab14114b3b-serving-cert\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:34.916155 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.916139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzrcc\" (UniqueName: \"kubernetes.io/projected/a921e6ac-45f3-4eda-bdd2-2303eb26b521-kube-api-access-mzrcc\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:34.916251 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.916209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a921e6ac-45f3-4eda-bdd2-2303eb26b521-config\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:34.925050 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.925025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds2zv\" (UniqueName: \"kubernetes.io/projected/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-kube-api-access-ds2zv\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:34.941278 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.941258 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-nxhht"] Jun 03 08:46:34.943842 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.943829 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:34.948406 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.948372 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 08:46:34.948655 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.948635 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:46:34.948753 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.948669 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fns88\"" Jun 03 08:46:34.948936 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.948910 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 08:46:34.949627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.949546 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 08:46:34.960514 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:34.960491 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-nxhht"] Jun 03 08:46:35.017227 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017162 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a921e6ac-45f3-4eda-bdd2-2303eb26b521-config\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.017227 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a80bacf4-4c98-4d4a-af07-e79651cf8875-config\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017243 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tc6q\" (UniqueName: \"kubernetes.io/projected/c0aad718-1000-4ab8-9e27-f7d088e3be32-kube-api-access-5tc6q\") pod \"volume-data-source-validator-7598fd5bd-zbwmt\" (UID: \"c0aad718-1000-4ab8-9e27-f7d088e3be32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a80bacf4-4c98-4d4a-af07-e79651cf8875-serving-cert\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017292 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6770ff4a-0374-417d-924c-c0ab14114b3b-snapshots\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017311 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6770ff4a-0374-417d-924c-c0ab14114b3b-tmp\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017334 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r59zm\" (UniqueName: \"kubernetes.io/projected/6770ff4a-0374-417d-924c-c0ab14114b3b-kube-api-access-r59zm\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017357 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a921e6ac-45f3-4eda-bdd2-2303eb26b521-serving-cert\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017415 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6770ff4a-0374-417d-924c-c0ab14114b3b-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.017445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017446 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6770ff4a-0374-417d-924c-c0ab14114b3b-service-ca-bundle\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.017851 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017467 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a921e6ac-45f3-4eda-bdd2-2303eb26b521-trusted-ca\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.017851 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017491 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6770ff4a-0374-417d-924c-c0ab14114b3b-serving-cert\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.017851 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017511 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mzrcc\" (UniqueName: \"kubernetes.io/projected/a921e6ac-45f3-4eda-bdd2-2303eb26b521-kube-api-access-mzrcc\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.017851 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.017536 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn6jm\" (UniqueName: \"kubernetes.io/projected/a80bacf4-4c98-4d4a-af07-e79651cf8875-kube-api-access-cn6jm\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.018043 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.018024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6770ff4a-0374-417d-924c-c0ab14114b3b-snapshots\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.018095 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.018049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6770ff4a-0374-417d-924c-c0ab14114b3b-service-ca-bundle\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.018095 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.018064 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a921e6ac-45f3-4eda-bdd2-2303eb26b521-config\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.018234 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.018214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6770ff4a-0374-417d-924c-c0ab14114b3b-tmp\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.018310 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.018292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a921e6ac-45f3-4eda-bdd2-2303eb26b521-trusted-ca\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.018646 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.018626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6770ff4a-0374-417d-924c-c0ab14114b3b-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.020026 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.020001 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a921e6ac-45f3-4eda-bdd2-2303eb26b521-serving-cert\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.020173 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.020158 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6770ff4a-0374-417d-924c-c0ab14114b3b-serving-cert\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.031347 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.031326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tc6q\" (UniqueName: \"kubernetes.io/projected/c0aad718-1000-4ab8-9e27-f7d088e3be32-kube-api-access-5tc6q\") pod \"volume-data-source-validator-7598fd5bd-zbwmt\" (UID: \"c0aad718-1000-4ab8-9e27-f7d088e3be32\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" Jun 03 08:46:35.032359 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.032335 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59zm\" (UniqueName: \"kubernetes.io/projected/6770ff4a-0374-417d-924c-c0ab14114b3b-kube-api-access-r59zm\") pod \"insights-operator-788bf58df5-2fhnj\" (UID: \"6770ff4a-0374-417d-924c-c0ab14114b3b\") " pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.034253 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.034235 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzrcc\" (UniqueName: \"kubernetes.io/projected/a921e6ac-45f3-4eda-bdd2-2303eb26b521-kube-api-access-mzrcc\") pod \"console-operator-86d7c6cc77-fflk7\" (UID: \"a921e6ac-45f3-4eda-bdd2-2303eb26b521\") " pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.118893 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.118852 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a80bacf4-4c98-4d4a-af07-e79651cf8875-serving-cert\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.119071 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.118921 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cn6jm\" (UniqueName: \"kubernetes.io/projected/a80bacf4-4c98-4d4a-af07-e79651cf8875-kube-api-access-cn6jm\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.119071 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.118944 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a80bacf4-4c98-4d4a-af07-e79651cf8875-config\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.119433 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.119402 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a80bacf4-4c98-4d4a-af07-e79651cf8875-config\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.121230 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.121208 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a80bacf4-4c98-4d4a-af07-e79651cf8875-serving-cert\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.126864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.126846 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn6jm\" (UniqueName: \"kubernetes.io/projected/a80bacf4-4c98-4d4a-af07-e79651cf8875-kube-api-access-cn6jm\") pod \"service-ca-operator-69877444c-nxhht\" (UID: \"a80bacf4-4c98-4d4a-af07-e79651cf8875\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.146947 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.146927 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" Jun 03 08:46:35.154658 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.154634 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:35.161578 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.161557 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-2fhnj" Jun 03 08:46:35.252070 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.252046 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" Jun 03 08:46:35.297166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.297090 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-fflk7"] Jun 03 08:46:35.300969 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:46:35.300941 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda921e6ac_45f3_4eda_bdd2_2303eb26b521.slice/crio-9e2a0b30a2c48ee2e979c52ce0dd8d1f0503fb57e76063a0db47b7dd6cbd02bb WatchSource:0}: Error finding container 9e2a0b30a2c48ee2e979c52ce0dd8d1f0503fb57e76063a0db47b7dd6cbd02bb: Status 404 returned error can't find the container with id 9e2a0b30a2c48ee2e979c52ce0dd8d1f0503fb57e76063a0db47b7dd6cbd02bb Jun 03 08:46:35.378144 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.378112 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-nxhht"] Jun 03 08:46:35.380950 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:46:35.380910 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80bacf4_4c98_4d4a_af07_e79651cf8875.slice/crio-1ae55f58d3b54430f16f06258f4bde2fa1995677993c5344c70fd1f980eaf739 WatchSource:0}: Error finding container 1ae55f58d3b54430f16f06258f4bde2fa1995677993c5344c70fd1f980eaf739: Status 404 returned error can't find the container with id 1ae55f58d3b54430f16f06258f4bde2fa1995677993c5344c70fd1f980eaf739 Jun 03 08:46:35.420970 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.420945 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:35.421065 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:35.421042 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:46:35.421099 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:35.421092 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls podName:6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:36.421076796 +0000 UTC m=+129.198572412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rjwmn" (UID: "6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf") : secret "samples-operator-tls" not found Jun 03 08:46:35.516040 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.516012 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-2fhnj"] Jun 03 08:46:35.518642 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:46:35.518605 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6770ff4a_0374_417d_924c_c0ab14114b3b.slice/crio-3a4b2071e02272a35697363fd286d69c464d74855a448e2ed0a75defd1a62102 WatchSource:0}: Error finding container 3a4b2071e02272a35697363fd286d69c464d74855a448e2ed0a75defd1a62102: Status 404 returned error can't find the container with id 3a4b2071e02272a35697363fd286d69c464d74855a448e2ed0a75defd1a62102 Jun 03 08:46:35.521505 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:35.521483 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt"] Jun 03 08:46:35.524435 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:46:35.524414 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0aad718_1000_4ab8_9e27_f7d088e3be32.slice/crio-f0fb58a24c91a9983f62431d6d16285e6544c66357af8ae1ca80021c618959ff WatchSource:0}: Error finding container f0fb58a24c91a9983f62431d6d16285e6544c66357af8ae1ca80021c618959ff: Status 404 returned error can't find the container with id f0fb58a24c91a9983f62431d6d16285e6544c66357af8ae1ca80021c618959ff Jun 03 08:46:36.179433 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:36.179391 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2fhnj" event={"ID":"6770ff4a-0374-417d-924c-c0ab14114b3b","Type":"ContainerStarted","Data":"3a4b2071e02272a35697363fd286d69c464d74855a448e2ed0a75defd1a62102"} Jun 03 08:46:36.180718 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:36.180690 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" event={"ID":"a80bacf4-4c98-4d4a-af07-e79651cf8875","Type":"ContainerStarted","Data":"1ae55f58d3b54430f16f06258f4bde2fa1995677993c5344c70fd1f980eaf739"} Jun 03 08:46:36.182131 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:36.182106 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" event={"ID":"c0aad718-1000-4ab8-9e27-f7d088e3be32","Type":"ContainerStarted","Data":"f0fb58a24c91a9983f62431d6d16285e6544c66357af8ae1ca80021c618959ff"} Jun 03 08:46:36.183793 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:36.183750 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" event={"ID":"a921e6ac-45f3-4eda-bdd2-2303eb26b521","Type":"ContainerStarted","Data":"9e2a0b30a2c48ee2e979c52ce0dd8d1f0503fb57e76063a0db47b7dd6cbd02bb"} Jun 03 08:46:36.429564 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:36.428867 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:36.429564 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:36.429049 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:46:36.429564 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:36.429123 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls podName:6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:38.429102579 +0000 UTC m=+131.206598201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rjwmn" (UID: "6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf") : secret "samples-operator-tls" not found Jun 03 08:46:37.537571 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:37.537530 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:46:37.537953 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:37.537684 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 08:46:37.537953 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:37.537747 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs podName:d130f311-edd0-4255-869f-453deb319458 nodeName:}" failed. No retries permitted until 2026-06-03 08:48:39.537732285 +0000 UTC m=+252.315227901 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs") pod "network-metrics-daemon-q9mnc" (UID: "d130f311-edd0-4255-869f-453deb319458") : secret "metrics-daemon-secret" not found Jun 03 08:46:38.445597 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.445556 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:38.445765 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:38.445725 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:46:38.445823 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:38.445802 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls podName:6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:42.445781082 +0000 UTC m=+135.223276699 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rjwmn" (UID: "6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf") : secret "samples-operator-tls" not found Jun 03 08:46:38.531534 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.531507 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4"] Jun 03 08:46:38.534441 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.534423 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" Jun 03 08:46:38.538272 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.538244 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nf446\"" Jun 03 08:46:38.539397 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.539363 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 08:46:38.539536 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.539400 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 08:46:38.545411 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.545372 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4"] Jun 03 08:46:38.647550 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.647523 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pczd\" (UniqueName: \"kubernetes.io/projected/7bca4d87-88ea-4acd-8a96-224acf268936-kube-api-access-6pczd\") pod \"migrator-96c6f749-ctmp4\" (UID: \"7bca4d87-88ea-4acd-8a96-224acf268936\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" Jun 03 08:46:38.748182 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.748151 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pczd\" (UniqueName: \"kubernetes.io/projected/7bca4d87-88ea-4acd-8a96-224acf268936-kube-api-access-6pczd\") pod \"migrator-96c6f749-ctmp4\" (UID: \"7bca4d87-88ea-4acd-8a96-224acf268936\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" Jun 03 08:46:38.758009 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.757986 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pczd\" (UniqueName: \"kubernetes.io/projected/7bca4d87-88ea-4acd-8a96-224acf268936-kube-api-access-6pczd\") pod \"migrator-96c6f749-ctmp4\" (UID: \"7bca4d87-88ea-4acd-8a96-224acf268936\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" Jun 03 08:46:38.843577 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.843522 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" Jun 03 08:46:38.974672 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:38.974561 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4"] Jun 03 08:46:38.978410 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:46:38.978342 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bca4d87_88ea_4acd_8a96_224acf268936.slice/crio-17e444a98d415c2365b659c7d94104f03d7902c8e269f5c3a040b412d9a60a61 WatchSource:0}: Error finding container 17e444a98d415c2365b659c7d94104f03d7902c8e269f5c3a040b412d9a60a61: Status 404 returned error can't find the container with id 17e444a98d415c2365b659c7d94104f03d7902c8e269f5c3a040b412d9a60a61 Jun 03 08:46:39.191352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.191308 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2fhnj" event={"ID":"6770ff4a-0374-417d-924c-c0ab14114b3b","Type":"ContainerStarted","Data":"3dff51f2b694336a88fe161a9fc8f595219fadab219398acece08fc86790d60f"} Jun 03 08:46:39.192734 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.192703 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" event={"ID":"a80bacf4-4c98-4d4a-af07-e79651cf8875","Type":"ContainerStarted","Data":"0d211ff66cc987df35be20b77d1e5aacf8483d29c76b1188d34701a20f8f18e6"} Jun 03 08:46:39.194054 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.194030 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" event={"ID":"c0aad718-1000-4ab8-9e27-f7d088e3be32","Type":"ContainerStarted","Data":"ed306425ded12591aead713b666fdd1d8519fb8043ffda17ae921c05d6e86a1a"} Jun 03 08:46:39.195119 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.195094 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" event={"ID":"7bca4d87-88ea-4acd-8a96-224acf268936","Type":"ContainerStarted","Data":"17e444a98d415c2365b659c7d94104f03d7902c8e269f5c3a040b412d9a60a61"} Jun 03 08:46:39.196651 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.196630 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/0.log" Jun 03 08:46:39.196736 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.196671 2561 generic.go:358] "Generic (PLEG): container finished" podID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" containerID="834f21825f9bcc382c7e8013258ff942c9a7984983108085b7c12a04cb4afe67" exitCode=255 Jun 03 08:46:39.196736 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.196705 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" event={"ID":"a921e6ac-45f3-4eda-bdd2-2303eb26b521","Type":"ContainerDied","Data":"834f21825f9bcc382c7e8013258ff942c9a7984983108085b7c12a04cb4afe67"} Jun 03 08:46:39.196890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.196876 2561 scope.go:117] "RemoveContainer" containerID="834f21825f9bcc382c7e8013258ff942c9a7984983108085b7c12a04cb4afe67" Jun 03 08:46:39.208401 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.208349 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-2fhnj" podStartSLOduration=2.165808769 podStartE2EDuration="5.208337913s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="2026-06-03 08:46:35.520459482 +0000 UTC m=+128.297955099" lastFinishedPulling="2026-06-03 08:46:38.562988627 +0000 UTC m=+131.340484243" observedRunningTime="2026-06-03 08:46:39.207809807 +0000 UTC m=+131.985305445" watchObservedRunningTime="2026-06-03 08:46:39.208337913 +0000 UTC m=+131.985833552" Jun 03 08:46:39.248174 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.248120 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-zbwmt" podStartSLOduration=2.217796599 podStartE2EDuration="5.248101241s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="2026-06-03 08:46:35.526442939 +0000 UTC m=+128.303938555" lastFinishedPulling="2026-06-03 08:46:38.556747573 +0000 UTC m=+131.334243197" observedRunningTime="2026-06-03 08:46:39.247523052 +0000 UTC m=+132.025018692" watchObservedRunningTime="2026-06-03 08:46:39.248101241 +0000 UTC m=+132.025596880" Jun 03 08:46:39.266811 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:39.266616 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" podStartSLOduration=2.088362608 podStartE2EDuration="5.266600876s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="2026-06-03 08:46:35.382802343 +0000 UTC m=+128.160297959" lastFinishedPulling="2026-06-03 08:46:38.561040609 +0000 UTC m=+131.338536227" observedRunningTime="2026-06-03 08:46:39.266427913 +0000 UTC m=+132.043923547" watchObservedRunningTime="2026-06-03 08:46:39.266600876 +0000 UTC m=+132.044096515" Jun 03 08:46:40.200909 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:40.200885 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/1.log" Jun 03 08:46:40.201336 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:40.201311 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/0.log" Jun 03 08:46:40.201407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:40.201357 2561 generic.go:358] "Generic (PLEG): container finished" podID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" containerID="a87be29fa324aa670e583d8a71978f7cf4e047a410645b12706374e02f0b429a" exitCode=255 Jun 03 08:46:40.201472 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:40.201409 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" event={"ID":"a921e6ac-45f3-4eda-bdd2-2303eb26b521","Type":"ContainerDied","Data":"a87be29fa324aa670e583d8a71978f7cf4e047a410645b12706374e02f0b429a"} Jun 03 08:46:40.201472 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:40.201460 2561 scope.go:117] "RemoveContainer" containerID="834f21825f9bcc382c7e8013258ff942c9a7984983108085b7c12a04cb4afe67" Jun 03 08:46:40.201737 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:40.201715 2561 scope.go:117] "RemoveContainer" containerID="a87be29fa324aa670e583d8a71978f7cf4e047a410645b12706374e02f0b429a" Jun 03 08:46:40.201973 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:40.201939 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fflk7_openshift-console-operator(a921e6ac-45f3-4eda-bdd2-2303eb26b521)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" podUID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" Jun 03 08:46:41.205598 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.205560 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" event={"ID":"7bca4d87-88ea-4acd-8a96-224acf268936","Type":"ContainerStarted","Data":"4dd4481df30cd83735ab1c964325b23cd68c4a55c78ee9c1f0ddff42eceb39e4"} Jun 03 08:46:41.205598 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.205597 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" event={"ID":"7bca4d87-88ea-4acd-8a96-224acf268936","Type":"ContainerStarted","Data":"5c543a488b5cadc88a36b0e2d0257562322c6f3cfc9aa8d9bcd441fbbe2ef5a2"} Jun 03 08:46:41.206824 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.206802 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/1.log" Jun 03 08:46:41.207097 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.207082 2561 scope.go:117] "RemoveContainer" containerID="a87be29fa324aa670e583d8a71978f7cf4e047a410645b12706374e02f0b429a" Jun 03 08:46:41.207237 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:41.207221 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fflk7_openshift-console-operator(a921e6ac-45f3-4eda-bdd2-2303eb26b521)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" podUID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" Jun 03 08:46:41.224852 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.224815 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-ctmp4" podStartSLOduration=2.03702698 podStartE2EDuration="3.224803386s" podCreationTimestamp="2026-06-03 08:46:38 +0000 UTC" firstStartedPulling="2026-06-03 08:46:38.98025403 +0000 UTC m=+131.757749645" lastFinishedPulling="2026-06-03 08:46:40.168030418 +0000 UTC m=+132.945526051" observedRunningTime="2026-06-03 08:46:41.224170509 +0000 UTC m=+134.001666147" watchObservedRunningTime="2026-06-03 08:46:41.224803386 +0000 UTC m=+134.002299066" Jun 03 08:46:41.976916 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.976886 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-dpqnc"] Jun 03 08:46:41.979994 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.979979 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:41.982886 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.982865 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 08:46:41.983006 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.982870 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-b9z7r\"" Jun 03 08:46:41.984039 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.984023 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 08:46:41.984121 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.984037 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 08:46:41.984121 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.984072 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 08:46:41.986426 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:41.986403 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-dpqnc"] Jun 03 08:46:42.073772 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.073743 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvqgc\" (UniqueName: \"kubernetes.io/projected/4f6bc114-b6b8-4441-92b4-4257ec23b02c-kube-api-access-kvqgc\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.073937 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.073800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f6bc114-b6b8-4441-92b4-4257ec23b02c-signing-key\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.073937 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.073851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f6bc114-b6b8-4441-92b4-4257ec23b02c-signing-cabundle\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.174299 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.174259 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f6bc114-b6b8-4441-92b4-4257ec23b02c-signing-key\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.174464 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.174320 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f6bc114-b6b8-4441-92b4-4257ec23b02c-signing-cabundle\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.174464 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.174370 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kvqgc\" (UniqueName: \"kubernetes.io/projected/4f6bc114-b6b8-4441-92b4-4257ec23b02c-kube-api-access-kvqgc\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.175000 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.174946 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f6bc114-b6b8-4441-92b4-4257ec23b02c-signing-cabundle\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.176808 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.176787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f6bc114-b6b8-4441-92b4-4257ec23b02c-signing-key\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.183058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.183038 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvqgc\" (UniqueName: \"kubernetes.io/projected/4f6bc114-b6b8-4441-92b4-4257ec23b02c-kube-api-access-kvqgc\") pod \"service-ca-685df94d57-dpqnc\" (UID: \"4f6bc114-b6b8-4441-92b4-4257ec23b02c\") " pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.288963 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.288887 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-dpqnc" Jun 03 08:46:42.412471 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.412440 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-dpqnc"] Jun 03 08:46:42.415303 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:46:42.415267 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f6bc114_b6b8_4441_92b4_4257ec23b02c.slice/crio-3c62107ee64ec002aa98f976ed3c319dfeec9a3683943c657165e963ec26c874 WatchSource:0}: Error finding container 3c62107ee64ec002aa98f976ed3c319dfeec9a3683943c657165e963ec26c874: Status 404 returned error can't find the container with id 3c62107ee64ec002aa98f976ed3c319dfeec9a3683943c657165e963ec26c874 Jun 03 08:46:42.477071 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:42.477047 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:42.477197 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:42.477179 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 08:46:42.477260 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:42.477251 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls podName:6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf nodeName:}" failed. No retries permitted until 2026-06-03 08:46:50.477235244 +0000 UTC m=+143.254730860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-rjwmn" (UID: "6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf") : secret "samples-operator-tls" not found Jun 03 08:46:43.213740 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:43.213702 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-dpqnc" event={"ID":"4f6bc114-b6b8-4441-92b4-4257ec23b02c","Type":"ContainerStarted","Data":"522335936fe8e0e96b61d07eff4471d5041a2a9cf3c9279c03ba665f9ba75523"} Jun 03 08:46:43.213740 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:43.213745 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-dpqnc" event={"ID":"4f6bc114-b6b8-4441-92b4-4257ec23b02c","Type":"ContainerStarted","Data":"3c62107ee64ec002aa98f976ed3c319dfeec9a3683943c657165e963ec26c874"} Jun 03 08:46:43.236757 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:43.236697 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-dpqnc" podStartSLOduration=2.236656866 podStartE2EDuration="2.236656866s" podCreationTimestamp="2026-06-03 08:46:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:46:43.236083457 +0000 UTC m=+136.013579107" watchObservedRunningTime="2026-06-03 08:46:43.236656866 +0000 UTC m=+136.014152503" Jun 03 08:46:43.310352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:43.310321 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s5l7r_71bfcc55-0169-4fb1-b546-4839143aa713/dns-node-resolver/0.log" Jun 03 08:46:43.916822 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:43.916795 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5zl66_883f2d62-d81c-4308-808a-28ce50f3e7aa/node-ca/0.log" Jun 03 08:46:45.155649 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:45.155617 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:45.155649 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:45.155653 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:46:45.156040 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:45.155968 2561 scope.go:117] "RemoveContainer" containerID="a87be29fa324aa670e583d8a71978f7cf4e047a410645b12706374e02f0b429a" Jun 03 08:46:45.156139 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:45.156121 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fflk7_openshift-console-operator(a921e6ac-45f3-4eda-bdd2-2303eb26b521)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" podUID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" Jun 03 08:46:45.310128 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:45.310098 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-ctmp4_7bca4d87-88ea-4acd-8a96-224acf268936/migrator/0.log" Jun 03 08:46:45.509864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:45.509781 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-ctmp4_7bca4d87-88ea-4acd-8a96-224acf268936/graceful-termination/0.log" Jun 03 08:46:50.538746 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:50.538704 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:50.541366 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:50.541332 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-rjwmn\" (UID: \"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:50.641387 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:50.641339 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" Jun 03 08:46:50.773176 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:50.773146 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn"] Jun 03 08:46:51.235839 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:51.235801 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" event={"ID":"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf","Type":"ContainerStarted","Data":"6a895bfbca5739a7ba85cf8b6d20ab6cec2f3e21cfeaa28ff7fec4b53b628bc4"} Jun 03 08:46:53.242812 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:53.242774 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" event={"ID":"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf","Type":"ContainerStarted","Data":"16f29bec22d9c8eebb0e998a588e99efe286fe451b340fecfb84b41046c0309b"} Jun 03 08:46:53.242812 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:53.242813 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" event={"ID":"6a2f6e6a-e3bf-46f2-b102-1b6a94a882bf","Type":"ContainerStarted","Data":"cb6441b2c305e75e03b29785911ea8db25e2c0b1f8e9f186428f1fe3f39dc2a6"} Jun 03 08:46:53.259967 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:53.259917 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-rjwmn" podStartSLOduration=17.602635117 podStartE2EDuration="19.259904767s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="2026-06-03 08:46:50.812926726 +0000 UTC m=+143.590422345" lastFinishedPulling="2026-06-03 08:46:52.470196376 +0000 UTC m=+145.247691995" observedRunningTime="2026-06-03 08:46:53.259206648 +0000 UTC m=+146.036702283" watchObservedRunningTime="2026-06-03 08:46:53.259904767 +0000 UTC m=+146.037400404" Jun 03 08:46:55.833352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:55.833320 2561 scope.go:117] "RemoveContainer" containerID="a87be29fa324aa670e583d8a71978f7cf4e047a410645b12706374e02f0b429a" Jun 03 08:46:56.251966 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:56.251892 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:46:56.252204 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:56.252191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/1.log" Jun 03 08:46:56.252245 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:56.252227 2561 generic.go:358] "Generic (PLEG): container finished" podID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" containerID="6e31b08d2c33208ccd3b9a8c879483c71eb69cd737223015c29ba238fd9adf16" exitCode=255 Jun 03 08:46:56.252282 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:56.252257 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" event={"ID":"a921e6ac-45f3-4eda-bdd2-2303eb26b521","Type":"ContainerDied","Data":"6e31b08d2c33208ccd3b9a8c879483c71eb69cd737223015c29ba238fd9adf16"} Jun 03 08:46:56.252324 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:56.252291 2561 scope.go:117] "RemoveContainer" containerID="a87be29fa324aa670e583d8a71978f7cf4e047a410645b12706374e02f0b429a" Jun 03 08:46:56.252646 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:56.252624 2561 scope.go:117] "RemoveContainer" containerID="6e31b08d2c33208ccd3b9a8c879483c71eb69cd737223015c29ba238fd9adf16" Jun 03 08:46:56.252824 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:46:56.252803 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fflk7_openshift-console-operator(a921e6ac-45f3-4eda-bdd2-2303eb26b521)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" podUID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" Jun 03 08:46:57.258461 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:46:57.258433 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:47:04.790801 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.790763 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78878d788c-2c8rf"] Jun 03 08:47:04.794412 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.794394 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.797582 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.797562 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 08:47:04.798248 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.798232 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 08:47:04.798566 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.798549 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 08:47:04.799244 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.799229 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2xqvt\"" Jun 03 08:47:04.804263 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.804240 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 08:47:04.810828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.810804 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78878d788c-2c8rf"] Jun 03 08:47:04.830474 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.830452 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h4v6l"] Jun 03 08:47:04.832416 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.832400 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:04.843307 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.843289 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 08:47:04.843420 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.843340 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 08:47:04.843844 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.843824 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hqsvn\"" Jun 03 08:47:04.860448 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.860428 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h4v6l"] Jun 03 08:47:04.939631 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8329638-ae1d-422e-a3c2-3c3dd311d788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:04.939803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939645 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fecc3687-291a-43b4-ba39-f28b948012a5-registry-certificates\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.939803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fecc3687-291a-43b4-ba39-f28b948012a5-trusted-ca\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.939803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8329638-ae1d-422e-a3c2-3c3dd311d788-data-volume\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:04.939803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939751 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-bound-sa-token\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.939803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fecc3687-291a-43b4-ba39-f28b948012a5-ca-trust-extracted\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.940009 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8329638-ae1d-422e-a3c2-3c3dd311d788-crio-socket\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:04.940009 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939922 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8329638-ae1d-422e-a3c2-3c3dd311d788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:04.940009 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.939960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fecc3687-291a-43b4-ba39-f28b948012a5-installation-pull-secrets\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.940097 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.940010 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-registry-tls\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.940097 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.940058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fecc3687-291a-43b4-ba39-f28b948012a5-image-registry-private-configuration\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:04.940097 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.940085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2zmb\" (UniqueName: \"kubernetes.io/projected/c8329638-ae1d-422e-a3c2-3c3dd311d788-kube-api-access-k2zmb\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:04.940181 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:04.940110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdn8k\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-kube-api-access-pdn8k\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.040726 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.040694 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-bound-sa-token\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.040915 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.040736 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fecc3687-291a-43b4-ba39-f28b948012a5-ca-trust-extracted\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.040915 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.040805 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8329638-ae1d-422e-a3c2-3c3dd311d788-crio-socket\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.040915 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.040853 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8329638-ae1d-422e-a3c2-3c3dd311d788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.040915 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.040888 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fecc3687-291a-43b4-ba39-f28b948012a5-installation-pull-secrets\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.041180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.040912 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c8329638-ae1d-422e-a3c2-3c3dd311d788-crio-socket\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.041180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.040940 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-registry-tls\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.041180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fecc3687-291a-43b4-ba39-f28b948012a5-ca-trust-extracted\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.041180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041034 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fecc3687-291a-43b4-ba39-f28b948012a5-image-registry-private-configuration\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.041180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041081 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k2zmb\" (UniqueName: \"kubernetes.io/projected/c8329638-ae1d-422e-a3c2-3c3dd311d788-kube-api-access-k2zmb\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.041180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041109 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdn8k\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-kube-api-access-pdn8k\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.041180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041148 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8329638-ae1d-422e-a3c2-3c3dd311d788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.041563 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041196 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fecc3687-291a-43b4-ba39-f28b948012a5-registry-certificates\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.041563 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041224 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fecc3687-291a-43b4-ba39-f28b948012a5-trusted-ca\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.041563 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041250 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8329638-ae1d-422e-a3c2-3c3dd311d788-data-volume\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.041714 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c8329638-ae1d-422e-a3c2-3c3dd311d788-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.041819 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.041797 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8329638-ae1d-422e-a3c2-3c3dd311d788-data-volume\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.042580 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.042467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fecc3687-291a-43b4-ba39-f28b948012a5-registry-certificates\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.042901 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.042881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fecc3687-291a-43b4-ba39-f28b948012a5-trusted-ca\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.043836 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.043804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fecc3687-291a-43b4-ba39-f28b948012a5-installation-pull-secrets\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.043936 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.043881 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fecc3687-291a-43b4-ba39-f28b948012a5-image-registry-private-configuration\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.044032 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.044007 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c8329638-ae1d-422e-a3c2-3c3dd311d788-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.044307 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.044287 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-registry-tls\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.048817 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.048796 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-bound-sa-token\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.049068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.049051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdn8k\" (UniqueName: \"kubernetes.io/projected/fecc3687-291a-43b4-ba39-f28b948012a5-kube-api-access-pdn8k\") pod \"image-registry-78878d788c-2c8rf\" (UID: \"fecc3687-291a-43b4-ba39-f28b948012a5\") " pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.049303 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.049287 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2zmb\" (UniqueName: \"kubernetes.io/projected/c8329638-ae1d-422e-a3c2-3c3dd311d788-kube-api-access-k2zmb\") pod \"insights-runtime-extractor-h4v6l\" (UID: \"c8329638-ae1d-422e-a3c2-3c3dd311d788\") " pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.103470 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.103441 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:05.141062 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.141036 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h4v6l" Jun 03 08:47:05.154969 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.154938 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:47:05.155139 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.154976 2561 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:47:05.155296 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.155284 2561 scope.go:117] "RemoveContainer" containerID="6e31b08d2c33208ccd3b9a8c879483c71eb69cd737223015c29ba238fd9adf16" Jun 03 08:47:05.155522 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:05.155497 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-fflk7_openshift-console-operator(a921e6ac-45f3-4eda-bdd2-2303eb26b521)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" podUID="a921e6ac-45f3-4eda-bdd2-2303eb26b521" Jun 03 08:47:05.168104 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:05.168037 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zwpb7" podUID="9285be91-f419-4043-89c1-b29c044bc09a" Jun 03 08:47:05.173502 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:05.173456 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-4469f" podUID="26932fb2-d30f-4b60-8195-f92cd29aea4d" Jun 03 08:47:05.237860 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.237828 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78878d788c-2c8rf"] Jun 03 08:47:05.240835 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:05.240807 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecc3687_291a_43b4_ba39_f28b948012a5.slice/crio-93fb201b16157559c4c04370163b79111eaa30f60c8d6e1473217305096a299f WatchSource:0}: Error finding container 93fb201b16157559c4c04370163b79111eaa30f60c8d6e1473217305096a299f: Status 404 returned error can't find the container with id 93fb201b16157559c4c04370163b79111eaa30f60c8d6e1473217305096a299f Jun 03 08:47:05.278989 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.278961 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h4v6l"] Jun 03 08:47:05.279933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.279908 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" event={"ID":"fecc3687-291a-43b4-ba39-f28b948012a5","Type":"ContainerStarted","Data":"93fb201b16157559c4c04370163b79111eaa30f60c8d6e1473217305096a299f"} Jun 03 08:47:05.280016 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:05.279965 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zwpb7" Jun 03 08:47:05.285295 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:05.285274 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8329638_ae1d_422e_a3c2_3c3dd311d788.slice/crio-7586ce47f975bf69c99ffd1dc69e66b0f028d167c67ad6d6599e42d7f2ef08b3 WatchSource:0}: Error finding container 7586ce47f975bf69c99ffd1dc69e66b0f028d167c67ad6d6599e42d7f2ef08b3: Status 404 returned error can't find the container with id 7586ce47f975bf69c99ffd1dc69e66b0f028d167c67ad6d6599e42d7f2ef08b3 Jun 03 08:47:05.842608 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:05.842572 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-q9mnc" podUID="d130f311-edd0-4255-869f-453deb319458" Jun 03 08:47:06.284516 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:06.284477 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" event={"ID":"fecc3687-291a-43b4-ba39-f28b948012a5","Type":"ContainerStarted","Data":"dcab5462e4562b72efce509fc7151dd14f2a03f0b599f944903b94f50b60ee84"} Jun 03 08:47:06.284810 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:06.284612 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:06.286071 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:06.286046 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4v6l" event={"ID":"c8329638-ae1d-422e-a3c2-3c3dd311d788","Type":"ContainerStarted","Data":"074f2743b8131725615dcc41d9e3bcd4c6668e71ce84ec55b4bdf8d0e99c4843"} Jun 03 08:47:06.286071 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:06.286071 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4v6l" event={"ID":"c8329638-ae1d-422e-a3c2-3c3dd311d788","Type":"ContainerStarted","Data":"face8ecebdfe03773caa609f9c89a09caf0fdd75188375324b2cdac03be9a55f"} Jun 03 08:47:06.286220 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:06.286081 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4v6l" event={"ID":"c8329638-ae1d-422e-a3c2-3c3dd311d788","Type":"ContainerStarted","Data":"7586ce47f975bf69c99ffd1dc69e66b0f028d167c67ad6d6599e42d7f2ef08b3"} Jun 03 08:47:06.307437 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:06.307403 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" podStartSLOduration=2.307391528 podStartE2EDuration="2.307391528s" podCreationTimestamp="2026-06-03 08:47:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:47:06.305727196 +0000 UTC m=+159.083222845" watchObservedRunningTime="2026-06-03 08:47:06.307391528 +0000 UTC m=+159.084887156" Jun 03 08:47:08.294003 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:08.293875 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h4v6l" event={"ID":"c8329638-ae1d-422e-a3c2-3c3dd311d788","Type":"ContainerStarted","Data":"d063c5cc6412143c65eafcf573aa559936e176f183f312b6892523c2264f70a4"} Jun 03 08:47:08.313448 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:08.313402 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h4v6l" podStartSLOduration=1.6788291260000001 podStartE2EDuration="4.313371032s" podCreationTimestamp="2026-06-03 08:47:04 +0000 UTC" firstStartedPulling="2026-06-03 08:47:05.337932268 +0000 UTC m=+158.115427884" lastFinishedPulling="2026-06-03 08:47:07.972474169 +0000 UTC m=+160.749969790" observedRunningTime="2026-06-03 08:47:08.312705327 +0000 UTC m=+161.090200965" watchObservedRunningTime="2026-06-03 08:47:08.313371032 +0000 UTC m=+161.090866669" Jun 03 08:47:10.079007 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:10.078970 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:47:10.079007 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:10.079011 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:47:10.081315 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:10.081289 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9285be91-f419-4043-89c1-b29c044bc09a-metrics-tls\") pod \"dns-default-zwpb7\" (UID: \"9285be91-f419-4043-89c1-b29c044bc09a\") " pod="openshift-dns/dns-default-zwpb7" Jun 03 08:47:10.081489 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:10.081458 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/26932fb2-d30f-4b60-8195-f92cd29aea4d-cert\") pod \"ingress-canary-4469f\" (UID: \"26932fb2-d30f-4b60-8195-f92cd29aea4d\") " pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:47:10.383529 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:10.383458 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jkth\"" Jun 03 08:47:10.391715 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:10.391700 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zwpb7" Jun 03 08:47:10.514113 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:10.514081 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zwpb7"] Jun 03 08:47:10.517044 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:10.517019 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9285be91_f419_4043_89c1_b29c044bc09a.slice/crio-dfe55c9ce0176f0ef22225f131f779cad6c8a2d8a294714ed4a759aa1ee73105 WatchSource:0}: Error finding container dfe55c9ce0176f0ef22225f131f779cad6c8a2d8a294714ed4a759aa1ee73105: Status 404 returned error can't find the container with id dfe55c9ce0176f0ef22225f131f779cad6c8a2d8a294714ed4a759aa1ee73105 Jun 03 08:47:11.305155 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:11.305114 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zwpb7" event={"ID":"9285be91-f419-4043-89c1-b29c044bc09a","Type":"ContainerStarted","Data":"dfe55c9ce0176f0ef22225f131f779cad6c8a2d8a294714ed4a759aa1ee73105"} Jun 03 08:47:12.312844 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:12.312807 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zwpb7" event={"ID":"9285be91-f419-4043-89c1-b29c044bc09a","Type":"ContainerStarted","Data":"8fb82476769d1b4803f60ff8243615f0fd5bc5df6896013ae3e99ac31c3200e3"} Jun 03 08:47:12.312844 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:12.312849 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zwpb7" event={"ID":"9285be91-f419-4043-89c1-b29c044bc09a","Type":"ContainerStarted","Data":"34e2a50cbc48bc4c5e158cfae2fb1809a48b7c7420bbbb1a84945e8326bbbf0c"} Jun 03 08:47:12.313293 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:12.312987 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zwpb7" Jun 03 08:47:12.334306 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:12.334260 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-zwpb7" podStartSLOduration=128.915102411 podStartE2EDuration="2m10.334248726s" podCreationTimestamp="2026-06-03 08:45:02 +0000 UTC" firstStartedPulling="2026-06-03 08:47:10.518912044 +0000 UTC m=+163.296407660" lastFinishedPulling="2026-06-03 08:47:11.938058356 +0000 UTC m=+164.715553975" observedRunningTime="2026-06-03 08:47:12.332941743 +0000 UTC m=+165.110437381" watchObservedRunningTime="2026-06-03 08:47:12.334248726 +0000 UTC m=+165.111744364" Jun 03 08:47:15.753211 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.753181 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr"] Jun 03 08:47:15.756710 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.756689 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.760075 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.760055 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 08:47:15.761193 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.761164 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 08:47:15.761295 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.761235 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 08:47:15.761411 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.761390 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 08:47:15.761529 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.761446 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 08:47:15.761529 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.761457 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-kdt86\"" Jun 03 08:47:15.761941 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.761925 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 08:47:15.767726 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.767704 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr"] Jun 03 08:47:15.790990 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.790960 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sv796"] Jun 03 08:47:15.794345 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.794330 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.797696 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.797677 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 08:47:15.797801 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.797772 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mxqg8\"" Jun 03 08:47:15.797886 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.797868 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 08:47:15.798070 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.798052 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 08:47:15.820092 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820069 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66782d44-0b01-4ebf-8081-3271f2e5bd9f-metrics-client-ca\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820200 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820110 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-sys\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820200 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.820200 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820358 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6lx5\" (UniqueName: \"kubernetes.io/projected/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-api-access-x6lx5\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.820358 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mlzc\" (UniqueName: \"kubernetes.io/projected/66782d44-0b01-4ebf-8081-3271f2e5bd9f-kube-api-access-4mlzc\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820358 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820358 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-tls\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820358 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820338 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-wtmp\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820358 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.820643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820372 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-textfile\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820460 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.820643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-root\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.820643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.820643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.820554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.837540 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.837519 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:47:15.840345 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.840328 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4qg6q\"" Jun 03 08:47:15.848742 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.848724 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4469f" Jun 03 08:47:15.921587 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921558 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921603 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921625 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x6lx5\" (UniqueName: \"kubernetes.io/projected/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-api-access-x6lx5\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921657 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4mlzc\" (UniqueName: \"kubernetes.io/projected/66782d44-0b01-4ebf-8081-3271f2e5bd9f-kube-api-access-4mlzc\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921686 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921715 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-tls\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921742 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-wtmp\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921765 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.921805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921791 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-textfile\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.922201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921858 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.922201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921880 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-root\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.922201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921904 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.922201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921939 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.922201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.921977 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66782d44-0b01-4ebf-8081-3271f2e5bd9f-metrics-client-ca\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.922201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.922012 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-sys\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.922201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.922115 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-sys\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.922581 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.922323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-wtmp\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.922581 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.922523 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.924466 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.922788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-textfile\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.924466 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.923025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.924466 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.923473 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.924466 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:15.923668 2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 08:47:15.924466 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:15.923721 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-tls podName:ad75032a-57e6-4cb2-bfd3-0cffdfb25e44 nodeName:}" failed. No retries permitted until 2026-06-03 08:47:16.423703708 +0000 UTC m=+169.201199324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-tvrjr" (UID: "ad75032a-57e6-4cb2-bfd3-0cffdfb25e44") : secret "kube-state-metrics-tls" not found Jun 03 08:47:15.924466 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.923947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66782d44-0b01-4ebf-8081-3271f2e5bd9f-root\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.924466 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.924199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66782d44-0b01-4ebf-8081-3271f2e5bd9f-metrics-client-ca\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.925104 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.924542 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.926596 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.926539 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.927073 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.926801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.927073 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.927032 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66782d44-0b01-4ebf-8081-3271f2e5bd9f-node-exporter-tls\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.935836 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.935711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6lx5\" (UniqueName: \"kubernetes.io/projected/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-api-access-x6lx5\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:15.936865 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.936809 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mlzc\" (UniqueName: \"kubernetes.io/projected/66782d44-0b01-4ebf-8081-3271f2e5bd9f-kube-api-access-4mlzc\") pod \"node-exporter-sv796\" (UID: \"66782d44-0b01-4ebf-8081-3271f2e5bd9f\") " pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:15.995996 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:15.995942 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4469f"] Jun 03 08:47:16.000700 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:16.000659 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26932fb2_d30f_4b60_8195_f92cd29aea4d.slice/crio-e62cfd7f34d9cc93a231540b2033525ae5a03770ec995329aacc83d3c84d5294 WatchSource:0}: Error finding container e62cfd7f34d9cc93a231540b2033525ae5a03770ec995329aacc83d3c84d5294: Status 404 returned error can't find the container with id e62cfd7f34d9cc93a231540b2033525ae5a03770ec995329aacc83d3c84d5294 Jun 03 08:47:16.102934 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:16.102899 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sv796" Jun 03 08:47:16.113456 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:16.113429 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66782d44_0b01_4ebf_8081_3271f2e5bd9f.slice/crio-2b5d32bea404e4c4c77eab7dc52e0b8b40a6da5044da086d3578a29219a2667a WatchSource:0}: Error finding container 2b5d32bea404e4c4c77eab7dc52e0b8b40a6da5044da086d3578a29219a2667a: Status 404 returned error can't find the container with id 2b5d32bea404e4c4c77eab7dc52e0b8b40a6da5044da086d3578a29219a2667a Jun 03 08:47:16.324514 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:16.324475 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sv796" event={"ID":"66782d44-0b01-4ebf-8081-3271f2e5bd9f","Type":"ContainerStarted","Data":"2b5d32bea404e4c4c77eab7dc52e0b8b40a6da5044da086d3578a29219a2667a"} Jun 03 08:47:16.325513 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:16.325490 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4469f" event={"ID":"26932fb2-d30f-4b60-8195-f92cd29aea4d","Type":"ContainerStarted","Data":"e62cfd7f34d9cc93a231540b2033525ae5a03770ec995329aacc83d3c84d5294"} Jun 03 08:47:16.425979 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:16.425944 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:16.428764 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:16.428733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ad75032a-57e6-4cb2-bfd3-0cffdfb25e44-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-tvrjr\" (UID: \"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:16.666817 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:16.666718 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" Jun 03 08:47:16.830329 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:16.830289 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr"] Jun 03 08:47:17.039834 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:17.039755 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad75032a_57e6_4cb2_bfd3_0cffdfb25e44.slice/crio-95763a2edac60a934ea1846629db08999a44d2e8a16ea7c5c375401423e701b7 WatchSource:0}: Error finding container 95763a2edac60a934ea1846629db08999a44d2e8a16ea7c5c375401423e701b7: Status 404 returned error can't find the container with id 95763a2edac60a934ea1846629db08999a44d2e8a16ea7c5c375401423e701b7 Jun 03 08:47:17.329132 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:17.329096 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" event={"ID":"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44","Type":"ContainerStarted","Data":"95763a2edac60a934ea1846629db08999a44d2e8a16ea7c5c375401423e701b7"} Jun 03 08:47:17.330503 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:17.330466 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sv796" event={"ID":"66782d44-0b01-4ebf-8081-3271f2e5bd9f","Type":"ContainerStarted","Data":"3161f1c8ec85e79e4280e8b92c9a0ad44bb09c5bc14fd9ce661d3be1724785fa"} Jun 03 08:47:18.334795 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:18.334755 2561 generic.go:358] "Generic (PLEG): container finished" podID="66782d44-0b01-4ebf-8081-3271f2e5bd9f" containerID="3161f1c8ec85e79e4280e8b92c9a0ad44bb09c5bc14fd9ce661d3be1724785fa" exitCode=0 Jun 03 08:47:18.335256 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:18.334838 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sv796" event={"ID":"66782d44-0b01-4ebf-8081-3271f2e5bd9f","Type":"ContainerDied","Data":"3161f1c8ec85e79e4280e8b92c9a0ad44bb09c5bc14fd9ce661d3be1724785fa"} Jun 03 08:47:18.336354 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:18.336324 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4469f" event={"ID":"26932fb2-d30f-4b60-8195-f92cd29aea4d","Type":"ContainerStarted","Data":"1f87a52fc7174aaf1cfabad09d2262f4db020459a0123fa0206a70a4d3fc84ba"} Jun 03 08:47:18.375019 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:18.374962 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4469f" podStartSLOduration=134.742857953 podStartE2EDuration="2m16.374948546s" podCreationTimestamp="2026-06-03 08:45:02 +0000 UTC" firstStartedPulling="2026-06-03 08:47:16.003230261 +0000 UTC m=+168.780725880" lastFinishedPulling="2026-06-03 08:47:17.635320858 +0000 UTC m=+170.412816473" observedRunningTime="2026-06-03 08:47:18.37414717 +0000 UTC m=+171.151642810" watchObservedRunningTime="2026-06-03 08:47:18.374948546 +0000 UTC m=+171.152444184" Jun 03 08:47:19.341536 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:19.341488 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" event={"ID":"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44","Type":"ContainerStarted","Data":"5e59bfc398477ca8c62e2cc40292822c993b009ba136270f3ade85a384771433"} Jun 03 08:47:19.341536 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:19.341540 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" event={"ID":"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44","Type":"ContainerStarted","Data":"01bbd1919a6f25ccb55986ab637416aa12113c733942fe8ae64c8f5b09de0a97"} Jun 03 08:47:19.341971 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:19.341555 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" event={"ID":"ad75032a-57e6-4cb2-bfd3-0cffdfb25e44","Type":"ContainerStarted","Data":"381e103d52bf44f2d45a203754b6feb5928354dbfe278a7f42cdf1e6757567f1"} Jun 03 08:47:19.343367 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:19.343339 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sv796" event={"ID":"66782d44-0b01-4ebf-8081-3271f2e5bd9f","Type":"ContainerStarted","Data":"8edc24289ac7fa728782ee29edfef187836ca10de3050304a91e9da8312907af"} Jun 03 08:47:19.343367 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:19.343369 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sv796" event={"ID":"66782d44-0b01-4ebf-8081-3271f2e5bd9f","Type":"ContainerStarted","Data":"e309cf97a132b872b14fe7816ca39d1df52f5babef9181641e2ea8929bb59a48"} Jun 03 08:47:19.364187 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:19.364140 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-tvrjr" podStartSLOduration=2.910581627 podStartE2EDuration="4.36412854s" podCreationTimestamp="2026-06-03 08:47:15 +0000 UTC" firstStartedPulling="2026-06-03 08:47:17.041874013 +0000 UTC m=+169.819369633" lastFinishedPulling="2026-06-03 08:47:18.495420929 +0000 UTC m=+171.272916546" observedRunningTime="2026-06-03 08:47:19.362608866 +0000 UTC m=+172.140104504" watchObservedRunningTime="2026-06-03 08:47:19.36412854 +0000 UTC m=+172.141624177" Jun 03 08:47:19.383642 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:19.383596 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sv796" podStartSLOduration=3.412400175 podStartE2EDuration="4.383582476s" podCreationTimestamp="2026-06-03 08:47:15 +0000 UTC" firstStartedPulling="2026-06-03 08:47:16.115264129 +0000 UTC m=+168.892759745" lastFinishedPulling="2026-06-03 08:47:17.086446428 +0000 UTC m=+169.863942046" observedRunningTime="2026-06-03 08:47:19.38276137 +0000 UTC m=+172.160257031" watchObservedRunningTime="2026-06-03 08:47:19.383582476 +0000 UTC m=+172.161078154" Jun 03 08:47:20.515569 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.515536 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng"] Jun 03 08:47:20.518792 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.518773 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:20.521664 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.521647 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 08:47:20.521664 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.521657 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-j6jls\"" Jun 03 08:47:20.527196 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.527178 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng"] Jun 03 08:47:20.571017 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.570976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-cz6ng\" (UID: \"1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:20.671408 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.671352 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-cz6ng\" (UID: \"1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:20.671584 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:20.671511 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 03 08:47:20.671584 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:47:20.671577 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c-monitoring-plugin-cert podName:1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c nodeName:}" failed. No retries permitted until 2026-06-03 08:47:21.171559054 +0000 UTC m=+173.949054672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-cz6ng" (UID: "1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c") : secret "monitoring-plugin-cert" not found Jun 03 08:47:20.833434 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.833363 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:47:20.833699 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:20.833683 2561 scope.go:117] "RemoveContainer" containerID="6e31b08d2c33208ccd3b9a8c879483c71eb69cd737223015c29ba238fd9adf16" Jun 03 08:47:21.175156 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.175052 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-cz6ng\" (UID: \"1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:21.177748 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.177720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-cz6ng\" (UID: \"1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:21.350957 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.350926 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:47:21.351135 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.350974 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" event={"ID":"a921e6ac-45f3-4eda-bdd2-2303eb26b521","Type":"ContainerStarted","Data":"55b9d2b766779d8cbe7b3c2c530c0380a6702819febc74f572067226f08d0893"} Jun 03 08:47:21.351272 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.351252 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:47:21.368183 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.368135 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" podStartSLOduration=44.11412393 podStartE2EDuration="47.368122424s" podCreationTimestamp="2026-06-03 08:46:34 +0000 UTC" firstStartedPulling="2026-06-03 08:46:35.303565429 +0000 UTC m=+128.081061060" lastFinishedPulling="2026-06-03 08:46:38.557563924 +0000 UTC m=+131.335059554" observedRunningTime="2026-06-03 08:47:21.367559712 +0000 UTC m=+174.145055554" watchObservedRunningTime="2026-06-03 08:47:21.368122424 +0000 UTC m=+174.145618061" Jun 03 08:47:21.427890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.427805 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:21.559228 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:21.559196 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng"] Jun 03 08:47:21.562423 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:21.562391 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d83a2c3_397f_4cd8_ace2_0ad0e89c7d8c.slice/crio-61778d28b0a6e10dc64a64bdf91f76d7e8831c5f189322c897bb83ed4975dd0d WatchSource:0}: Error finding container 61778d28b0a6e10dc64a64bdf91f76d7e8831c5f189322c897bb83ed4975dd0d: Status 404 returned error can't find the container with id 61778d28b0a6e10dc64a64bdf91f76d7e8831c5f189322c897bb83ed4975dd0d Jun 03 08:47:22.141316 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.141284 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-fflk7" Jun 03 08:47:22.317697 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.317666 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zwpb7" Jun 03 08:47:22.332616 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.332583 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-vg4x9"] Jun 03 08:47:22.335949 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.335923 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-vg4x9" Jun 03 08:47:22.339090 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.339068 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 08:47:22.339214 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.339114 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-r5sb2\"" Jun 03 08:47:22.339541 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.339523 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 08:47:22.350060 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.350016 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-vg4x9"] Jun 03 08:47:22.355878 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.355829 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" event={"ID":"1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c","Type":"ContainerStarted","Data":"61778d28b0a6e10dc64a64bdf91f76d7e8831c5f189322c897bb83ed4975dd0d"} Jun 03 08:47:22.388205 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.388156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96dbr\" (UniqueName: \"kubernetes.io/projected/edd1698c-9075-4887-891d-45e96a973292-kube-api-access-96dbr\") pod \"downloads-c65b8dc4b-vg4x9\" (UID: \"edd1698c-9075-4887-891d-45e96a973292\") " pod="openshift-console/downloads-c65b8dc4b-vg4x9" Jun 03 08:47:22.489633 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.489549 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-96dbr\" (UniqueName: \"kubernetes.io/projected/edd1698c-9075-4887-891d-45e96a973292-kube-api-access-96dbr\") pod \"downloads-c65b8dc4b-vg4x9\" (UID: \"edd1698c-9075-4887-891d-45e96a973292\") " pod="openshift-console/downloads-c65b8dc4b-vg4x9" Jun 03 08:47:22.500257 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.500225 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96dbr\" (UniqueName: \"kubernetes.io/projected/edd1698c-9075-4887-891d-45e96a973292-kube-api-access-96dbr\") pod \"downloads-c65b8dc4b-vg4x9\" (UID: \"edd1698c-9075-4887-891d-45e96a973292\") " pod="openshift-console/downloads-c65b8dc4b-vg4x9" Jun 03 08:47:22.647682 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.647645 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-vg4x9" Jun 03 08:47:22.793807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:22.793780 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-vg4x9"] Jun 03 08:47:23.064881 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:23.064847 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd1698c_9075_4887_891d_45e96a973292.slice/crio-1ac66813cc1ae3f1ae2d8d7de2a639ead6cf8a4d8e90223a0e76978b343574c1 WatchSource:0}: Error finding container 1ac66813cc1ae3f1ae2d8d7de2a639ead6cf8a4d8e90223a0e76978b343574c1: Status 404 returned error can't find the container with id 1ac66813cc1ae3f1ae2d8d7de2a639ead6cf8a4d8e90223a0e76978b343574c1 Jun 03 08:47:23.359897 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:23.359811 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" event={"ID":"1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c","Type":"ContainerStarted","Data":"462b545a46f60f8ca4a57ea0576ed706ee91558f80c1ad5fb4e31d505820e98a"} Jun 03 08:47:23.360063 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:23.360014 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:23.360982 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:23.360947 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-vg4x9" event={"ID":"edd1698c-9075-4887-891d-45e96a973292","Type":"ContainerStarted","Data":"1ac66813cc1ae3f1ae2d8d7de2a639ead6cf8a4d8e90223a0e76978b343574c1"} Jun 03 08:47:23.365009 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:23.364991 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" Jun 03 08:47:23.377505 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:23.377462 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-cz6ng" podStartSLOduration=1.832780043 podStartE2EDuration="3.377451667s" podCreationTimestamp="2026-06-03 08:47:20 +0000 UTC" firstStartedPulling="2026-06-03 08:47:21.564665026 +0000 UTC m=+174.342160656" lastFinishedPulling="2026-06-03 08:47:23.109336663 +0000 UTC m=+175.886832280" observedRunningTime="2026-06-03 08:47:23.376505986 +0000 UTC m=+176.154001623" watchObservedRunningTime="2026-06-03 08:47:23.377451667 +0000 UTC m=+176.154947337" Jun 03 08:47:25.108865 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:25.108823 2561 patch_prober.go:28] interesting pod/image-registry-78878d788c-2c8rf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 08:47:25.109268 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:25.108891 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" podUID="fecc3687-291a-43b4-ba39-f28b948012a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 08:47:27.294434 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:27.294403 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78878d788c-2c8rf" Jun 03 08:47:34.452797 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.452757 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-c5864b99-x9bq5"] Jun 03 08:47:34.459089 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.459058 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.461940 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.461918 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 08:47:34.462053 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.461951 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 08:47:34.463480 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.463240 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 08:47:34.463480 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.463240 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 08:47:34.463480 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.463270 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-568j4\"" Jun 03 08:47:34.463480 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.463299 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 08:47:34.465202 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.465181 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5864b99-x9bq5"] Jun 03 08:47:34.601963 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.601919 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-service-ca\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.602131 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.602050 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnchc\" (UniqueName: \"kubernetes.io/projected/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-kube-api-access-fnchc\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.602131 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.602091 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-serving-cert\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.602222 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.602152 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-config\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.602222 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.602207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-oauth-config\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.602298 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.602242 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-oauth-serving-cert\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.703582 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.703499 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-config\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.703582 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.703575 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-oauth-config\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.703806 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.703652 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-oauth-serving-cert\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.703806 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.703722 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-service-ca\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.703806 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.703793 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnchc\" (UniqueName: \"kubernetes.io/projected/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-kube-api-access-fnchc\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.703958 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.703829 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-serving-cert\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.704313 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.704253 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-config\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.704575 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.704367 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-oauth-serving-cert\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.704575 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.704470 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-service-ca\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.706315 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.706295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-oauth-config\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.707016 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.706999 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-serving-cert\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.712798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.712772 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnchc\" (UniqueName: \"kubernetes.io/projected/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-kube-api-access-fnchc\") pod \"console-c5864b99-x9bq5\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:34.771507 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:34.771477 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:38.497251 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:38.497230 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c5864b99-x9bq5"] Jun 03 08:47:38.500434 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:38.500407 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42b4f65_57b5_4eb9_a2df_d5cad9940f9d.slice/crio-a85090f61c203f4ebd1cf62a5739df22866130eacd28c2d42498495ff2a72b18 WatchSource:0}: Error finding container a85090f61c203f4ebd1cf62a5739df22866130eacd28c2d42498495ff2a72b18: Status 404 returned error can't find the container with id a85090f61c203f4ebd1cf62a5739df22866130eacd28c2d42498495ff2a72b18 Jun 03 08:47:39.418655 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:39.418584 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-vg4x9" event={"ID":"edd1698c-9075-4887-891d-45e96a973292","Type":"ContainerStarted","Data":"868966290d99b44ed423c978597aef793bb2a60c3ed032c47532049ff861d3e1"} Jun 03 08:47:39.418962 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:39.418870 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-vg4x9" Jun 03 08:47:39.421264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:39.421238 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5864b99-x9bq5" event={"ID":"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d","Type":"ContainerStarted","Data":"a85090f61c203f4ebd1cf62a5739df22866130eacd28c2d42498495ff2a72b18"} Jun 03 08:47:39.435980 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:39.435948 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-vg4x9" Jun 03 08:47:39.437897 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:39.437839 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-vg4x9" podStartSLOduration=2.034580877 podStartE2EDuration="17.437823916s" podCreationTimestamp="2026-06-03 08:47:22 +0000 UTC" firstStartedPulling="2026-06-03 08:47:23.066691524 +0000 UTC m=+175.844187140" lastFinishedPulling="2026-06-03 08:47:38.46993455 +0000 UTC m=+191.247430179" observedRunningTime="2026-06-03 08:47:39.436566201 +0000 UTC m=+192.214061853" watchObservedRunningTime="2026-06-03 08:47:39.437823916 +0000 UTC m=+192.215319555" Jun 03 08:47:42.628255 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.628230 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d9d5758dc-nggkb"] Jun 03 08:47:42.645268 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.645241 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9d5758dc-nggkb"] Jun 03 08:47:42.645435 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.645372 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.655407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.655355 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 08:47:42.787239 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.787151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-oauth-serving-cert\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.787239 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.787193 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-trusted-ca-bundle\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.787487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.787269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-service-ca\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.787487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.787312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-oauth-config\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.787487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.787345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zqq\" (UniqueName: \"kubernetes.io/projected/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-kube-api-access-p8zqq\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.787487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.787451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-serving-cert\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.787487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.787477 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-config\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.888364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.888324 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zqq\" (UniqueName: \"kubernetes.io/projected/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-kube-api-access-p8zqq\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.888548 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.888424 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-serving-cert\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.888548 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.888458 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-config\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.888668 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.888618 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-oauth-serving-cert\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.888722 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.888666 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-trusted-ca-bundle\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.888775 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.888736 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-service-ca\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.888826 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.888778 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-oauth-config\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.889278 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.889245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-config\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.889419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.889251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-oauth-serving-cert\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.889625 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.889598 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-trusted-ca-bundle\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.889827 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.889801 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-service-ca\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.892060 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.892040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-serving-cert\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.892159 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.892128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-oauth-config\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.897899 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.897876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zqq\" (UniqueName: \"kubernetes.io/projected/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-kube-api-access-p8zqq\") pod \"console-7d9d5758dc-nggkb\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:42.959828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:42.959795 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:43.116765 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:43.116546 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9d5758dc-nggkb"] Jun 03 08:47:43.119825 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:47:43.119790 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de4c7a2_8f4b_4c7a_ae17_1de2d617c40e.slice/crio-2d61862a69858344abd0a216fae618144e5a670e8919529165a24175f9b9626a WatchSource:0}: Error finding container 2d61862a69858344abd0a216fae618144e5a670e8919529165a24175f9b9626a: Status 404 returned error can't find the container with id 2d61862a69858344abd0a216fae618144e5a670e8919529165a24175f9b9626a Jun 03 08:47:43.443632 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:43.443538 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5864b99-x9bq5" event={"ID":"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d","Type":"ContainerStarted","Data":"e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7"} Jun 03 08:47:43.445165 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:43.445138 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9d5758dc-nggkb" event={"ID":"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e","Type":"ContainerStarted","Data":"2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187"} Jun 03 08:47:43.445300 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:43.445172 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9d5758dc-nggkb" event={"ID":"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e","Type":"ContainerStarted","Data":"2d61862a69858344abd0a216fae618144e5a670e8919529165a24175f9b9626a"} Jun 03 08:47:43.465014 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:43.464965 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-c5864b99-x9bq5" podStartSLOduration=5.46624797 podStartE2EDuration="9.464952621s" podCreationTimestamp="2026-06-03 08:47:34 +0000 UTC" firstStartedPulling="2026-06-03 08:47:38.502196123 +0000 UTC m=+191.279691739" lastFinishedPulling="2026-06-03 08:47:42.500900756 +0000 UTC m=+195.278396390" observedRunningTime="2026-06-03 08:47:43.46244124 +0000 UTC m=+196.239936880" watchObservedRunningTime="2026-06-03 08:47:43.464952621 +0000 UTC m=+196.242448259" Jun 03 08:47:43.480511 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:43.480465 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-7d9d5758dc-nggkb" podStartSLOduration=1.480448547 podStartE2EDuration="1.480448547s" podCreationTimestamp="2026-06-03 08:47:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:47:43.479655094 +0000 UTC m=+196.257150732" watchObservedRunningTime="2026-06-03 08:47:43.480448547 +0000 UTC m=+196.257944185" Jun 03 08:47:44.772163 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:44.772122 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:44.772721 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:44.772183 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:44.777835 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:44.777806 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:45.456363 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:45.456332 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:47:52.960353 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:52.960313 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:52.960353 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:52.960358 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:52.965078 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:52.965052 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:53.480814 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:53.480787 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:47:53.540848 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:53.540810 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5864b99-x9bq5"] Jun 03 08:47:54.481510 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:54.481430 2561 generic.go:358] "Generic (PLEG): container finished" podID="a80bacf4-4c98-4d4a-af07-e79651cf8875" containerID="0d211ff66cc987df35be20b77d1e5aacf8483d29c76b1188d34701a20f8f18e6" exitCode=0 Jun 03 08:47:54.481882 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:54.481506 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" event={"ID":"a80bacf4-4c98-4d4a-af07-e79651cf8875","Type":"ContainerDied","Data":"0d211ff66cc987df35be20b77d1e5aacf8483d29c76b1188d34701a20f8f18e6"} Jun 03 08:47:54.481962 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:54.481946 2561 scope.go:117] "RemoveContainer" containerID="0d211ff66cc987df35be20b77d1e5aacf8483d29c76b1188d34701a20f8f18e6" Jun 03 08:47:55.485366 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:47:55.485325 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-nxhht" event={"ID":"a80bacf4-4c98-4d4a-af07-e79651cf8875","Type":"ContainerStarted","Data":"2cd2d660b0db2028fd6925eaac5219e731513c1852cb8dfd04d936acebb96b72"} Jun 03 08:48:14.537876 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:14.537797 2561 generic.go:358] "Generic (PLEG): container finished" podID="6770ff4a-0374-417d-924c-c0ab14114b3b" containerID="3dff51f2b694336a88fe161a9fc8f595219fadab219398acece08fc86790d60f" exitCode=0 Jun 03 08:48:14.538241 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:14.537871 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2fhnj" event={"ID":"6770ff4a-0374-417d-924c-c0ab14114b3b","Type":"ContainerDied","Data":"3dff51f2b694336a88fe161a9fc8f595219fadab219398acece08fc86790d60f"} Jun 03 08:48:14.538241 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:14.538237 2561 scope.go:117] "RemoveContainer" containerID="3dff51f2b694336a88fe161a9fc8f595219fadab219398acece08fc86790d60f" Jun 03 08:48:15.317870 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:15.317840 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zwpb7_9285be91-f419-4043-89c1-b29c044bc09a/dns/0.log" Jun 03 08:48:15.323439 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:15.323418 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zwpb7_9285be91-f419-4043-89c1-b29c044bc09a/kube-rbac-proxy/0.log" Jun 03 08:48:15.545163 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:15.545134 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-2fhnj" event={"ID":"6770ff4a-0374-417d-924c-c0ab14114b3b","Type":"ContainerStarted","Data":"e1ddcb4fc0885c4bde19f47a14e42f684bd83cd7f58a9d57292d560e083683c1"} Jun 03 08:48:15.794964 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:15.794889 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s5l7r_71bfcc55-0169-4fb1-b546-4839143aa713/dns-node-resolver/0.log" Jun 03 08:48:18.561508 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.561449 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-c5864b99-x9bq5" podUID="c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" containerName="console" containerID="cri-o://e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7" gracePeriod=15 Jun 03 08:48:18.824218 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.824193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c5864b99-x9bq5_c42b4f65-57b5-4eb9-a2df-d5cad9940f9d/console/0.log" Jun 03 08:48:18.824333 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.824268 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:48:18.889637 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.889609 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-serving-cert\") pod \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " Jun 03 08:48:18.889763 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.889661 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-oauth-config\") pod \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " Jun 03 08:48:18.889763 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.889684 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-oauth-serving-cert\") pod \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " Jun 03 08:48:18.889763 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.889728 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-service-ca\") pod \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " Jun 03 08:48:18.889763 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.889745 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnchc\" (UniqueName: \"kubernetes.io/projected/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-kube-api-access-fnchc\") pod \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " Jun 03 08:48:18.889944 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.889779 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-config\") pod \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\" (UID: \"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d\") " Jun 03 08:48:18.890175 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.890147 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-service-ca" (OuterVolumeSpecName: "service-ca") pod "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" (UID: "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:48:18.890175 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.890157 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" (UID: "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:48:18.890303 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.890198 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-config" (OuterVolumeSpecName: "console-config") pod "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" (UID: "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:48:18.892007 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.891987 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" (UID: "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:48:18.892081 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.892041 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-kube-api-access-fnchc" (OuterVolumeSpecName: "kube-api-access-fnchc") pod "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" (UID: "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d"). InnerVolumeSpecName "kube-api-access-fnchc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:48:18.892234 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.892217 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" (UID: "c42b4f65-57b5-4eb9-a2df-d5cad9940f9d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:48:18.991033 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.990993 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:48:18.991033 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.991025 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-oauth-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:48:18.991033 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.991035 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-oauth-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:48:18.991261 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.991045 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-service-ca\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:48:18.991261 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.991054 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnchc\" (UniqueName: \"kubernetes.io/projected/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-kube-api-access-fnchc\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:48:18.991261 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:18.991064 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d-console-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:48:19.558010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.557983 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c5864b99-x9bq5_c42b4f65-57b5-4eb9-a2df-d5cad9940f9d/console/0.log" Jun 03 08:48:19.558180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.558025 2561 generic.go:358] "Generic (PLEG): container finished" podID="c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" containerID="e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7" exitCode=2 Jun 03 08:48:19.558180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.558076 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5864b99-x9bq5" event={"ID":"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d","Type":"ContainerDied","Data":"e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7"} Jun 03 08:48:19.558180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.558098 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c5864b99-x9bq5" Jun 03 08:48:19.558180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.558109 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c5864b99-x9bq5" event={"ID":"c42b4f65-57b5-4eb9-a2df-d5cad9940f9d","Type":"ContainerDied","Data":"a85090f61c203f4ebd1cf62a5739df22866130eacd28c2d42498495ff2a72b18"} Jun 03 08:48:19.558180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.558127 2561 scope.go:117] "RemoveContainer" containerID="e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7" Jun 03 08:48:19.567140 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.566930 2561 scope.go:117] "RemoveContainer" containerID="e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7" Jun 03 08:48:19.567370 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:48:19.567160 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7\": container with ID starting with e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7 not found: ID does not exist" containerID="e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7" Jun 03 08:48:19.567370 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.567186 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7"} err="failed to get container status \"e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7\": rpc error: code = NotFound desc = could not find container \"e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7\": container with ID starting with e3b44f732a85732c0f89d258b6fb649483df1d9d2dbb69d4ce0e4048e54f91b7 not found: ID does not exist" Jun 03 08:48:19.580146 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.580124 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c5864b99-x9bq5"] Jun 03 08:48:19.583804 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.583784 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c5864b99-x9bq5"] Jun 03 08:48:19.836876 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:19.836804 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" path="/var/lib/kubelet/pods/c42b4f65-57b5-4eb9-a2df-d5cad9940f9d/volumes" Jun 03 08:48:34.668972 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.668941 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-658b67c5-4k68b"] Jun 03 08:48:34.669444 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.669225 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" containerName="console" Jun 03 08:48:34.669444 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.669236 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" containerName="console" Jun 03 08:48:34.669444 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.669285 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="c42b4f65-57b5-4eb9-a2df-d5cad9940f9d" containerName="console" Jun 03 08:48:34.672622 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.672602 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.713247 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.713220 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658b67c5-4k68b"] Jun 03 08:48:34.823161 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.823124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-oauth-config\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.823338 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.823170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-console-config\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.823338 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.823195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-service-ca\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.823338 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.823265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-trusted-ca-bundle\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.823338 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.823304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-oauth-serving-cert\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.823338 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.823336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-serving-cert\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.823562 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.823393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn8bl\" (UniqueName: \"kubernetes.io/projected/3faefeae-ad96-451e-b7da-6d6869c54f95-kube-api-access-rn8bl\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.923987 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-service-ca\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924025 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-trusted-ca-bundle\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924042 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-oauth-serving-cert\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924287 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924077 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-serving-cert\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924287 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924226 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rn8bl\" (UniqueName: \"kubernetes.io/projected/3faefeae-ad96-451e-b7da-6d6869c54f95-kube-api-access-rn8bl\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924405 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-oauth-config\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924509 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924485 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-console-config\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924783 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924757 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-service-ca\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.924882 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-oauth-serving-cert\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.925000 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.924985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-console-config\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.925643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.925622 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-trusted-ca-bundle\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.926956 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.926933 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-serving-cert\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.926956 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.926922 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-oauth-config\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.933810 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.933788 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn8bl\" (UniqueName: \"kubernetes.io/projected/3faefeae-ad96-451e-b7da-6d6869c54f95-kube-api-access-rn8bl\") pod \"console-658b67c5-4k68b\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:34.981698 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:34.981673 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:35.111851 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:35.111815 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658b67c5-4k68b"] Jun 03 08:48:35.114535 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:48:35.114510 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3faefeae_ad96_451e_b7da_6d6869c54f95.slice/crio-e2d4baced28bf7bc46a89187629e7ed93cac21e914521558d75104edf619e2eb WatchSource:0}: Error finding container e2d4baced28bf7bc46a89187629e7ed93cac21e914521558d75104edf619e2eb: Status 404 returned error can't find the container with id e2d4baced28bf7bc46a89187629e7ed93cac21e914521558d75104edf619e2eb Jun 03 08:48:35.611968 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:35.611928 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658b67c5-4k68b" event={"ID":"3faefeae-ad96-451e-b7da-6d6869c54f95","Type":"ContainerStarted","Data":"50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4"} Jun 03 08:48:35.611968 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:35.611970 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658b67c5-4k68b" event={"ID":"3faefeae-ad96-451e-b7da-6d6869c54f95","Type":"ContainerStarted","Data":"e2d4baced28bf7bc46a89187629e7ed93cac21e914521558d75104edf619e2eb"} Jun 03 08:48:35.631492 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:35.631435 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-658b67c5-4k68b" podStartSLOduration=1.631417544 podStartE2EDuration="1.631417544s" podCreationTimestamp="2026-06-03 08:48:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:48:35.630738173 +0000 UTC m=+248.408233823" watchObservedRunningTime="2026-06-03 08:48:35.631417544 +0000 UTC m=+248.408913184" Jun 03 08:48:39.563097 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:39.562999 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:48:39.565471 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:39.565450 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d130f311-edd0-4255-869f-453deb319458-metrics-certs\") pod \"network-metrics-daemon-q9mnc\" (UID: \"d130f311-edd0-4255-869f-453deb319458\") " pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:48:39.737638 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:39.737603 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llh4q\"" Jun 03 08:48:39.744879 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:39.744860 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-q9mnc" Jun 03 08:48:39.869105 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:39.869072 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-q9mnc"] Jun 03 08:48:40.627592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:40.627541 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9mnc" event={"ID":"d130f311-edd0-4255-869f-453deb319458","Type":"ContainerStarted","Data":"4a8be7f944fd747de4f8d0477db10c12a60b1284dedab034ce86d3ef2c4eb4f8"} Jun 03 08:48:41.631768 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:41.631731 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9mnc" event={"ID":"d130f311-edd0-4255-869f-453deb319458","Type":"ContainerStarted","Data":"516fb53e685b2f4c95e61ef2199ecd44dd06c16dba4a927005aa98bb07ee1e21"} Jun 03 08:48:41.631768 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:41.631770 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-q9mnc" event={"ID":"d130f311-edd0-4255-869f-453deb319458","Type":"ContainerStarted","Data":"b0dc07f6e55a2601f1c5899dc3c9d0b9a1255c320aace0bad0fc46b2480ea747"} Jun 03 08:48:41.648201 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:41.648141 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-q9mnc" podStartSLOduration=253.628315813 podStartE2EDuration="4m14.64812516s" podCreationTimestamp="2026-06-03 08:44:27 +0000 UTC" firstStartedPulling="2026-06-03 08:48:39.874002345 +0000 UTC m=+252.651497964" lastFinishedPulling="2026-06-03 08:48:40.893811691 +0000 UTC m=+253.671307311" observedRunningTime="2026-06-03 08:48:41.647844348 +0000 UTC m=+254.425340002" watchObservedRunningTime="2026-06-03 08:48:41.64812516 +0000 UTC m=+254.425620800" Jun 03 08:48:44.982803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:44.982758 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:44.982803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:44.982808 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:44.987500 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:44.987477 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:45.646746 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:45.646720 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:48:45.704643 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:48:45.704603 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9d5758dc-nggkb"] Jun 03 08:49:10.726158 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:10.726083 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-7d9d5758dc-nggkb" podUID="1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" containerName="console" containerID="cri-o://2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187" gracePeriod=15 Jun 03 08:49:10.973154 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:10.973133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d9d5758dc-nggkb_1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e/console/0.log" Jun 03 08:49:10.973258 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:10.973197 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:49:11.113205 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113174 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-trusted-ca-bundle\") pod \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " Jun 03 08:49:11.113428 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113214 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-service-ca\") pod \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " Jun 03 08:49:11.113428 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113243 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-oauth-serving-cert\") pod \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " Jun 03 08:49:11.113428 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113283 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-oauth-config\") pod \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " Jun 03 08:49:11.113428 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113314 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8zqq\" (UniqueName: \"kubernetes.io/projected/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-kube-api-access-p8zqq\") pod \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " Jun 03 08:49:11.113428 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113341 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-serving-cert\") pod \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " Jun 03 08:49:11.113428 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113398 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-config\") pod \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\" (UID: \"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e\") " Jun 03 08:49:11.113748 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113702 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-service-ca" (OuterVolumeSpecName: "service-ca") pod "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" (UID: "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:49:11.113748 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113722 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" (UID: "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:49:11.113828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113775 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" (UID: "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:49:11.113828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.113809 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-config" (OuterVolumeSpecName: "console-config") pod "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" (UID: "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:49:11.115784 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.115752 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" (UID: "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:49:11.115888 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.115776 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" (UID: "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:49:11.115888 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.115810 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-kube-api-access-p8zqq" (OuterVolumeSpecName: "kube-api-access-p8zqq") pod "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" (UID: "1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e"). InnerVolumeSpecName "kube-api-access-p8zqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:49:11.214153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.214112 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8zqq\" (UniqueName: \"kubernetes.io/projected/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-kube-api-access-p8zqq\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:49:11.214153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.214144 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:49:11.214153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.214154 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:49:11.214153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.214163 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-trusted-ca-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:49:11.214437 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.214172 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-service-ca\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:49:11.214437 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.214180 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-oauth-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:49:11.214437 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.214189 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e-console-oauth-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:49:11.719170 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.719143 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7d9d5758dc-nggkb_1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e/console/0.log" Jun 03 08:49:11.719362 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.719184 2561 generic.go:358] "Generic (PLEG): container finished" podID="1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" containerID="2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187" exitCode=2 Jun 03 08:49:11.719362 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.719219 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9d5758dc-nggkb" event={"ID":"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e","Type":"ContainerDied","Data":"2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187"} Jun 03 08:49:11.719362 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.719248 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9d5758dc-nggkb" Jun 03 08:49:11.719362 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.719266 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9d5758dc-nggkb" event={"ID":"1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e","Type":"ContainerDied","Data":"2d61862a69858344abd0a216fae618144e5a670e8919529165a24175f9b9626a"} Jun 03 08:49:11.719362 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.719287 2561 scope.go:117] "RemoveContainer" containerID="2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187" Jun 03 08:49:11.727710 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.727506 2561 scope.go:117] "RemoveContainer" containerID="2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187" Jun 03 08:49:11.727923 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:49:11.727733 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187\": container with ID starting with 2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187 not found: ID does not exist" containerID="2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187" Jun 03 08:49:11.727923 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.727756 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187"} err="failed to get container status \"2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187\": rpc error: code = NotFound desc = could not find container \"2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187\": container with ID starting with 2fbf4e08ad878bccafb0a416b34805a1f348dd994555b567c27caadbf0f1b187 not found: ID does not exist" Jun 03 08:49:11.741831 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.741804 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9d5758dc-nggkb"] Jun 03 08:49:11.746172 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.746154 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d9d5758dc-nggkb"] Jun 03 08:49:11.836595 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:11.836567 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" path="/var/lib/kubelet/pods/1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e/volumes" Jun 03 08:49:27.728252 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:27.728215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:49:27.729872 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:27.729841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:49:27.740565 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:27.740544 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:49:27.741366 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:49:27.741341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:52:22.771603 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.771567 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8rv8s"] Jun 03 08:52:22.772142 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.771843 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" containerName="console" Jun 03 08:52:22.772142 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.771853 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" containerName="console" Jun 03 08:52:22.772142 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.771900 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="1de4c7a2-8f4b-4c7a-ae17-1de2d617c40e" containerName="console" Jun 03 08:52:22.774755 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.774739 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.777461 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.777438 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 08:52:22.787189 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.787167 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8rv8s"] Jun 03 08:52:22.827648 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.827612 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c6b615d-cddd-4288-aa28-7563a3312fe8-kubelet-config\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.827776 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.827733 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c6b615d-cddd-4288-aa28-7563a3312fe8-original-pull-secret\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.827776 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.827769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c6b615d-cddd-4288-aa28-7563a3312fe8-dbus\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.928270 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.928237 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c6b615d-cddd-4288-aa28-7563a3312fe8-kubelet-config\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.928447 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.928324 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c6b615d-cddd-4288-aa28-7563a3312fe8-original-pull-secret\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.928447 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.928359 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c6b615d-cddd-4288-aa28-7563a3312fe8-dbus\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.928447 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.928361 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c6b615d-cddd-4288-aa28-7563a3312fe8-kubelet-config\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.928610 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.928513 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c6b615d-cddd-4288-aa28-7563a3312fe8-dbus\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:22.930751 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:22.930730 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c6b615d-cddd-4288-aa28-7563a3312fe8-original-pull-secret\") pod \"global-pull-secret-syncer-8rv8s\" (UID: \"7c6b615d-cddd-4288-aa28-7563a3312fe8\") " pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:23.084003 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:23.083976 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8rv8s" Jun 03 08:52:23.209151 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:23.209122 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8rv8s"] Jun 03 08:52:23.212089 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:52:23.212057 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6b615d_cddd_4288_aa28_7563a3312fe8.slice/crio-0748d2696ee787a2ddf2ccaa09963ece4f860942f0f6253779b7d9e7c007043a WatchSource:0}: Error finding container 0748d2696ee787a2ddf2ccaa09963ece4f860942f0f6253779b7d9e7c007043a: Status 404 returned error can't find the container with id 0748d2696ee787a2ddf2ccaa09963ece4f860942f0f6253779b7d9e7c007043a Jun 03 08:52:23.213663 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:23.213647 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 08:52:23.236112 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:23.236090 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8rv8s" event={"ID":"7c6b615d-cddd-4288-aa28-7563a3312fe8","Type":"ContainerStarted","Data":"0748d2696ee787a2ddf2ccaa09963ece4f860942f0f6253779b7d9e7c007043a"} Jun 03 08:52:27.250837 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:27.250751 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8rv8s" event={"ID":"7c6b615d-cddd-4288-aa28-7563a3312fe8","Type":"ContainerStarted","Data":"f681d746e7dfb50ec711668861d949c317515faedcf585fc592e79edb811b017"} Jun 03 08:52:27.267244 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:27.267194 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8rv8s" podStartSLOduration=1.6564940830000001 podStartE2EDuration="5.267180719s" podCreationTimestamp="2026-06-03 08:52:22 +0000 UTC" firstStartedPulling="2026-06-03 08:52:23.21377296 +0000 UTC m=+475.991268576" lastFinishedPulling="2026-06-03 08:52:26.824459592 +0000 UTC m=+479.601955212" observedRunningTime="2026-06-03 08:52:27.266346863 +0000 UTC m=+480.043842493" watchObservedRunningTime="2026-06-03 08:52:27.267180719 +0000 UTC m=+480.044676357" Jun 03 08:52:48.337855 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.337813 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq"] Jun 03 08:52:48.340247 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.340225 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.343071 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.343046 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 08:52:48.343180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.343052 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 08:52:48.344094 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.344080 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxk8r\"" Jun 03 08:52:48.350442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.350422 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq"] Jun 03 08:52:48.534631 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.534595 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.534807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.534671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.534807 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.534694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq6r5\" (UniqueName: \"kubernetes.io/projected/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-kube-api-access-tq6r5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.635999 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.635913 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.635999 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.635951 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tq6r5\" (UniqueName: \"kubernetes.io/projected/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-kube-api-access-tq6r5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.635999 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.635986 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.636301 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.636281 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.636341 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.636318 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.644116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.644099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq6r5\" (UniqueName: \"kubernetes.io/projected/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-kube-api-access-tq6r5\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.648634 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.648617 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:52:48.777366 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:48.777343 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq"] Jun 03 08:52:48.780635 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:52:48.780595 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d43a0a5_b8d8_48d4_a3e8_a5795e68af93.slice/crio-c67b2c021b7d96243cafc675f063601738530440e0804fb7ec2a5076b70a77ff WatchSource:0}: Error finding container c67b2c021b7d96243cafc675f063601738530440e0804fb7ec2a5076b70a77ff: Status 404 returned error can't find the container with id c67b2c021b7d96243cafc675f063601738530440e0804fb7ec2a5076b70a77ff Jun 03 08:52:49.313066 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:49.313026 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" event={"ID":"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93","Type":"ContainerStarted","Data":"c67b2c021b7d96243cafc675f063601738530440e0804fb7ec2a5076b70a77ff"} Jun 03 08:52:55.332573 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:55.332535 2561 generic.go:358] "Generic (PLEG): container finished" podID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerID="93129496a9d3a88c9bd0cb49489be584b0763c2060b437093f73358b3c6da60c" exitCode=0 Jun 03 08:52:55.332962 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:55.332583 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" event={"ID":"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93","Type":"ContainerDied","Data":"93129496a9d3a88c9bd0cb49489be584b0763c2060b437093f73358b3c6da60c"} Jun 03 08:52:58.343089 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:58.343050 2561 generic.go:358] "Generic (PLEG): container finished" podID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerID="d809498882b760c6b29bf340a10c591dc7a298dcf95ad545e19ae215f4100f7e" exitCode=0 Jun 03 08:52:58.343565 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:52:58.343134 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" event={"ID":"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93","Type":"ContainerDied","Data":"d809498882b760c6b29bf340a10c591dc7a298dcf95ad545e19ae215f4100f7e"} Jun 03 08:53:07.371339 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:07.371299 2561 generic.go:358] "Generic (PLEG): container finished" podID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerID="18ef08a742892046a5448d39aa77ac87de19cb75a67010fea32aed8455e18ea4" exitCode=0 Jun 03 08:53:07.371716 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:07.371412 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" event={"ID":"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93","Type":"ContainerDied","Data":"18ef08a742892046a5448d39aa77ac87de19cb75a67010fea32aed8455e18ea4"} Jun 03 08:53:08.499371 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.499340 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:53:08.600053 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.600018 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-bundle\") pod \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " Jun 03 08:53:08.600212 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.600091 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tq6r5\" (UniqueName: \"kubernetes.io/projected/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-kube-api-access-tq6r5\") pod \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " Jun 03 08:53:08.600212 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.600126 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-util\") pod \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\" (UID: \"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93\") " Jun 03 08:53:08.600772 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.600729 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-bundle" (OuterVolumeSpecName: "bundle") pod "0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" (UID: "0d43a0a5-b8d8-48d4-a3e8-a5795e68af93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:53:08.602495 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.602471 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-kube-api-access-tq6r5" (OuterVolumeSpecName: "kube-api-access-tq6r5") pod "0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" (UID: "0d43a0a5-b8d8-48d4-a3e8-a5795e68af93"). InnerVolumeSpecName "kube-api-access-tq6r5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:53:08.604389 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.604352 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-util" (OuterVolumeSpecName: "util") pod "0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" (UID: "0d43a0a5-b8d8-48d4-a3e8-a5795e68af93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:53:08.701518 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.701440 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:08.701518 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.701467 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq6r5\" (UniqueName: \"kubernetes.io/projected/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-kube-api-access-tq6r5\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:08.701518 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:08.701478 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d43a0a5-b8d8-48d4-a3e8-a5795e68af93-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:09.378592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:09.378550 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" event={"ID":"0d43a0a5-b8d8-48d4-a3e8-a5795e68af93","Type":"ContainerDied","Data":"c67b2c021b7d96243cafc675f063601738530440e0804fb7ec2a5076b70a77ff"} Jun 03 08:53:09.378592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:09.378592 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c67b2c021b7d96243cafc675f063601738530440e0804fb7ec2a5076b70a77ff" Jun 03 08:53:09.378798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:09.378603 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dtc9vq" Jun 03 08:53:16.314211 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314179 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d"] Jun 03 08:53:16.314592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314466 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerName="pull" Jun 03 08:53:16.314592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314477 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerName="pull" Jun 03 08:53:16.314592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314488 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerName="util" Jun 03 08:53:16.314592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314494 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerName="util" Jun 03 08:53:16.314592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314506 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerName="extract" Jun 03 08:53:16.314592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314512 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerName="extract" Jun 03 08:53:16.314592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.314556 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d43a0a5-b8d8-48d4-a3e8-a5795e68af93" containerName="extract" Jun 03 08:53:16.318357 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.318334 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.321560 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.321533 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 08:53:16.321689 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.321567 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:53:16.321689 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.321648 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jzmj2\"" Jun 03 08:53:16.327152 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.327129 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d"] Jun 03 08:53:16.361394 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.361356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-66g8d\" (UID: \"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.361516 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.361418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t67z\" (UniqueName: \"kubernetes.io/projected/a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7-kube-api-access-4t67z\") pod \"cert-manager-operator-controller-manager-54b9655956-66g8d\" (UID: \"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.462425 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.462368 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4t67z\" (UniqueName: \"kubernetes.io/projected/a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7-kube-api-access-4t67z\") pod \"cert-manager-operator-controller-manager-54b9655956-66g8d\" (UID: \"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.462573 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.462473 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-66g8d\" (UID: \"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.462805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.462790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-66g8d\" (UID: \"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.471488 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.471468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t67z\" (UniqueName: \"kubernetes.io/projected/a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7-kube-api-access-4t67z\") pod \"cert-manager-operator-controller-manager-54b9655956-66g8d\" (UID: \"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.628099 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.628016 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" Jun 03 08:53:16.761554 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:16.761519 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d"] Jun 03 08:53:16.764799 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:53:16.764773 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a6fc43_d40c_43dc_86fd_a3e3e0a20bf7.slice/crio-78ec47dd39107a2d117abd02ff852849b9bdcc34bd3f2c28c3735db5b7c7133e WatchSource:0}: Error finding container 78ec47dd39107a2d117abd02ff852849b9bdcc34bd3f2c28c3735db5b7c7133e: Status 404 returned error can't find the container with id 78ec47dd39107a2d117abd02ff852849b9bdcc34bd3f2c28c3735db5b7c7133e Jun 03 08:53:17.404078 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:17.404048 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" event={"ID":"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7","Type":"ContainerStarted","Data":"78ec47dd39107a2d117abd02ff852849b9bdcc34bd3f2c28c3735db5b7c7133e"} Jun 03 08:53:19.411505 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:19.411463 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" event={"ID":"a3a6fc43-d40c-43dc-86fd-a3e3e0a20bf7","Type":"ContainerStarted","Data":"a91225c2eef0fbc0d3ac16adc770d890ebc7937d166bdf1044c0e346e75fd661"} Jun 03 08:53:19.437326 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:19.437280 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-66g8d" podStartSLOduration=1.674363858 podStartE2EDuration="3.437266855s" podCreationTimestamp="2026-06-03 08:53:16 +0000 UTC" firstStartedPulling="2026-06-03 08:53:16.767194807 +0000 UTC m=+529.544690422" lastFinishedPulling="2026-06-03 08:53:18.5300978 +0000 UTC m=+531.307593419" observedRunningTime="2026-06-03 08:53:19.434808591 +0000 UTC m=+532.212304229" watchObservedRunningTime="2026-06-03 08:53:19.437266855 +0000 UTC m=+532.214762492" Jun 03 08:53:20.407827 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.407795 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp"] Jun 03 08:53:20.410045 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.410025 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.412779 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.412751 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxk8r\"" Jun 03 08:53:20.413106 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.412751 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 08:53:20.413106 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.412791 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 08:53:20.420673 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.420652 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp"] Jun 03 08:53:20.499307 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.499277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.499493 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.499320 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.499493 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.499479 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzs7q\" (UniqueName: \"kubernetes.io/projected/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-kube-api-access-vzs7q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.600658 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.600618 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.600834 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.600706 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vzs7q\" (UniqueName: \"kubernetes.io/projected/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-kube-api-access-vzs7q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.600834 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.600734 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.601031 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.601010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.601096 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.601042 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.616040 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.616017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzs7q\" (UniqueName: \"kubernetes.io/projected/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-kube-api-access-vzs7q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.718978 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.718901 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:20.854438 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:20.854412 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp"] Jun 03 08:53:20.856350 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:53:20.856320 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3077300_e4a7_4c6c_b7a9_8e41f1074cda.slice/crio-5138a170fdc64c88d4530badc04318bf474aed81c83ed84210545d86005ebc11 WatchSource:0}: Error finding container 5138a170fdc64c88d4530badc04318bf474aed81c83ed84210545d86005ebc11: Status 404 returned error can't find the container with id 5138a170fdc64c88d4530badc04318bf474aed81c83ed84210545d86005ebc11 Jun 03 08:53:21.367896 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.367860 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-dbtcg"] Jun 03 08:53:21.370009 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.369987 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.372629 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.372612 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 08:53:21.373857 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.373831 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 08:53:21.373946 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.373890 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-qzj8v\"" Jun 03 08:53:21.380188 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.380169 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-dbtcg"] Jun 03 08:53:21.419036 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.419004 2561 generic.go:358] "Generic (PLEG): container finished" podID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerID="3fe1fddb87b8f8baf44922ecf319e6c4e5f20b2b599919873875b842cca7e063" exitCode=0 Jun 03 08:53:21.419426 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.419057 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" event={"ID":"e3077300-e4a7-4c6c-b7a9-8e41f1074cda","Type":"ContainerDied","Data":"3fe1fddb87b8f8baf44922ecf319e6c4e5f20b2b599919873875b842cca7e063"} Jun 03 08:53:21.419426 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.419083 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" event={"ID":"e3077300-e4a7-4c6c-b7a9-8e41f1074cda","Type":"ContainerStarted","Data":"5138a170fdc64c88d4530badc04318bf474aed81c83ed84210545d86005ebc11"} Jun 03 08:53:21.509231 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.509189 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-dbtcg\" (UID: \"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.509231 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.509237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-477sz\" (UniqueName: \"kubernetes.io/projected/7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d-kube-api-access-477sz\") pod \"cert-manager-webhook-587ccfb98-dbtcg\" (UID: \"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.610557 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.610522 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-dbtcg\" (UID: \"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.610746 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.610564 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-477sz\" (UniqueName: \"kubernetes.io/projected/7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d-kube-api-access-477sz\") pod \"cert-manager-webhook-587ccfb98-dbtcg\" (UID: \"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.620106 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.619935 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-dbtcg\" (UID: \"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.620157 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.620133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-477sz\" (UniqueName: \"kubernetes.io/projected/7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d-kube-api-access-477sz\") pod \"cert-manager-webhook-587ccfb98-dbtcg\" (UID: \"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d\") " pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.687284 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.687247 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:21.813138 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:21.812700 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-dbtcg"] Jun 03 08:53:21.815579 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:53:21.815555 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ea8da46_2dfb_4cfc_b3d8_7f926dbfdc2d.slice/crio-bf2e17eec048704f6658282f89862fd2df78ae2598c5d6fceda7baff0ad2b89d WatchSource:0}: Error finding container bf2e17eec048704f6658282f89862fd2df78ae2598c5d6fceda7baff0ad2b89d: Status 404 returned error can't find the container with id bf2e17eec048704f6658282f89862fd2df78ae2598c5d6fceda7baff0ad2b89d Jun 03 08:53:22.423455 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:22.423416 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" event={"ID":"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d","Type":"ContainerStarted","Data":"bf2e17eec048704f6658282f89862fd2df78ae2598c5d6fceda7baff0ad2b89d"} Jun 03 08:53:24.431577 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:24.431539 2561 generic.go:358] "Generic (PLEG): container finished" podID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerID="8459b1ba3d699826adc921fafaab793975d5e36bbc99674e4a587832e106819a" exitCode=0 Jun 03 08:53:24.431980 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:24.431624 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" event={"ID":"e3077300-e4a7-4c6c-b7a9-8e41f1074cda","Type":"ContainerDied","Data":"8459b1ba3d699826adc921fafaab793975d5e36bbc99674e4a587832e106819a"} Jun 03 08:53:25.436803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:25.436764 2561 generic.go:358] "Generic (PLEG): container finished" podID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerID="4b1f066cd80e624c9615bdc54417ffad144da8ef8d90734fc785846017482f9c" exitCode=0 Jun 03 08:53:25.437242 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:25.436842 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" event={"ID":"e3077300-e4a7-4c6c-b7a9-8e41f1074cda","Type":"ContainerDied","Data":"4b1f066cd80e624c9615bdc54417ffad144da8ef8d90734fc785846017482f9c"} Jun 03 08:53:26.557516 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.557493 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:26.652584 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.652551 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzs7q\" (UniqueName: \"kubernetes.io/projected/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-kube-api-access-vzs7q\") pod \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " Jun 03 08:53:26.652743 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.652616 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-bundle\") pod \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " Jun 03 08:53:26.652743 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.652646 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-util\") pod \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\" (UID: \"e3077300-e4a7-4c6c-b7a9-8e41f1074cda\") " Jun 03 08:53:26.652974 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.652947 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-bundle" (OuterVolumeSpecName: "bundle") pod "e3077300-e4a7-4c6c-b7a9-8e41f1074cda" (UID: "e3077300-e4a7-4c6c-b7a9-8e41f1074cda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:53:26.654806 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.654781 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-kube-api-access-vzs7q" (OuterVolumeSpecName: "kube-api-access-vzs7q") pod "e3077300-e4a7-4c6c-b7a9-8e41f1074cda" (UID: "e3077300-e4a7-4c6c-b7a9-8e41f1074cda"). InnerVolumeSpecName "kube-api-access-vzs7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:53:26.658715 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.658684 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-util" (OuterVolumeSpecName: "util") pod "e3077300-e4a7-4c6c-b7a9-8e41f1074cda" (UID: "e3077300-e4a7-4c6c-b7a9-8e41f1074cda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:53:26.754048 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.753978 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:26.754048 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.754004 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:26.754048 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:26.754013 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzs7q\" (UniqueName: \"kubernetes.io/projected/e3077300-e4a7-4c6c-b7a9-8e41f1074cda-kube-api-access-vzs7q\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:27.445394 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:27.445341 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" event={"ID":"e3077300-e4a7-4c6c-b7a9-8e41f1074cda","Type":"ContainerDied","Data":"5138a170fdc64c88d4530badc04318bf474aed81c83ed84210545d86005ebc11"} Jun 03 08:53:27.445394 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:27.445371 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffzhdp" Jun 03 08:53:27.445394 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:27.445399 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5138a170fdc64c88d4530badc04318bf474aed81c83ed84210545d86005ebc11" Jun 03 08:53:33.618141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618102 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6"] Jun 03 08:53:33.618627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618532 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerName="pull" Jun 03 08:53:33.618627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618551 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerName="pull" Jun 03 08:53:33.618627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618573 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerName="extract" Jun 03 08:53:33.618627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618582 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerName="extract" Jun 03 08:53:33.618627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618597 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerName="util" Jun 03 08:53:33.618627 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618605 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerName="util" Jun 03 08:53:33.618988 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.618686 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="e3077300-e4a7-4c6c-b7a9-8e41f1074cda" containerName="extract" Jun 03 08:53:33.622317 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.622297 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:33.625341 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.625221 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gpmjw\"" Jun 03 08:53:33.625771 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.625716 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 08:53:33.626505 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.626453 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 08:53:33.632812 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.632441 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6"] Jun 03 08:53:33.708282 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.708245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73b8f46a-6d5a-41d8-b53b-ce30269bed06-tmp\") pod \"openshift-lws-operator-bfc7f696d-whgc6\" (UID: \"73b8f46a-6d5a-41d8-b53b-ce30269bed06\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:33.708501 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.708307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltrt4\" (UniqueName: \"kubernetes.io/projected/73b8f46a-6d5a-41d8-b53b-ce30269bed06-kube-api-access-ltrt4\") pod \"openshift-lws-operator-bfc7f696d-whgc6\" (UID: \"73b8f46a-6d5a-41d8-b53b-ce30269bed06\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:33.809037 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.809003 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73b8f46a-6d5a-41d8-b53b-ce30269bed06-tmp\") pod \"openshift-lws-operator-bfc7f696d-whgc6\" (UID: \"73b8f46a-6d5a-41d8-b53b-ce30269bed06\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:33.809210 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.809061 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltrt4\" (UniqueName: \"kubernetes.io/projected/73b8f46a-6d5a-41d8-b53b-ce30269bed06-kube-api-access-ltrt4\") pod \"openshift-lws-operator-bfc7f696d-whgc6\" (UID: \"73b8f46a-6d5a-41d8-b53b-ce30269bed06\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:33.809536 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.809513 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73b8f46a-6d5a-41d8-b53b-ce30269bed06-tmp\") pod \"openshift-lws-operator-bfc7f696d-whgc6\" (UID: \"73b8f46a-6d5a-41d8-b53b-ce30269bed06\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:33.821146 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.821086 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltrt4\" (UniqueName: \"kubernetes.io/projected/73b8f46a-6d5a-41d8-b53b-ce30269bed06-kube-api-access-ltrt4\") pod \"openshift-lws-operator-bfc7f696d-whgc6\" (UID: \"73b8f46a-6d5a-41d8-b53b-ce30269bed06\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:33.939900 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:33.939814 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" Jun 03 08:53:34.089732 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:34.089708 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6"] Jun 03 08:53:34.092247 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:53:34.092205 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73b8f46a_6d5a_41d8_b53b_ce30269bed06.slice/crio-3a1787cd631218bb8a46f3a0ab6e10d72f9d0bb5fdc939a4fabf6a1acddbbd55 WatchSource:0}: Error finding container 3a1787cd631218bb8a46f3a0ab6e10d72f9d0bb5fdc939a4fabf6a1acddbbd55: Status 404 returned error can't find the container with id 3a1787cd631218bb8a46f3a0ab6e10d72f9d0bb5fdc939a4fabf6a1acddbbd55 Jun 03 08:53:34.469442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:34.469401 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" event={"ID":"73b8f46a-6d5a-41d8-b53b-ce30269bed06","Type":"ContainerStarted","Data":"3a1787cd631218bb8a46f3a0ab6e10d72f9d0bb5fdc939a4fabf6a1acddbbd55"} Jun 03 08:53:35.474639 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:35.474539 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" event={"ID":"7ea8da46-2dfb-4cfc-b3d8-7f926dbfdc2d","Type":"ContainerStarted","Data":"83cb49bcffce1b531be8538c99557720aeb675db436777473a388c539f4bfc36"} Jun 03 08:53:35.474639 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:35.474590 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:35.492212 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:35.492155 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" podStartSLOduration=1.216056545 podStartE2EDuration="14.49214036s" podCreationTimestamp="2026-06-03 08:53:21 +0000 UTC" firstStartedPulling="2026-06-03 08:53:21.817438704 +0000 UTC m=+534.594934320" lastFinishedPulling="2026-06-03 08:53:35.093522507 +0000 UTC m=+547.871018135" observedRunningTime="2026-06-03 08:53:35.49122756 +0000 UTC m=+548.268723200" watchObservedRunningTime="2026-06-03 08:53:35.49214036 +0000 UTC m=+548.269636000" Jun 03 08:53:37.481888 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:37.481821 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" event={"ID":"73b8f46a-6d5a-41d8-b53b-ce30269bed06","Type":"ContainerStarted","Data":"ea2d76a2eb4b92d34a4c1824341c6a984eeabb97c2e0b66398bf60bbe9006a8b"} Jun 03 08:53:37.499419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:37.499354 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-whgc6" podStartSLOduration=2.139950504 podStartE2EDuration="4.499341054s" podCreationTimestamp="2026-06-03 08:53:33 +0000 UTC" firstStartedPulling="2026-06-03 08:53:34.093751979 +0000 UTC m=+546.871247599" lastFinishedPulling="2026-06-03 08:53:36.453142522 +0000 UTC m=+549.230638149" observedRunningTime="2026-06-03 08:53:37.497816045 +0000 UTC m=+550.275311685" watchObservedRunningTime="2026-06-03 08:53:37.499341054 +0000 UTC m=+550.276836692" Jun 03 08:53:40.096225 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.096193 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv"] Jun 03 08:53:40.109203 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.109179 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv"] Jun 03 08:53:40.109313 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.109291 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.112109 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.112082 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxk8r\"" Jun 03 08:53:40.112234 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.112085 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 08:53:40.112234 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.112082 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 08:53:40.261399 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.261344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.261561 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.261429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chccj\" (UniqueName: \"kubernetes.io/projected/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-kube-api-access-chccj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.261561 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.261456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.362078 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.361998 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.362078 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.362067 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chccj\" (UniqueName: \"kubernetes.io/projected/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-kube-api-access-chccj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.362252 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.362105 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.362459 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.362438 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.362508 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.362460 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.372509 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.372483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chccj\" (UniqueName: \"kubernetes.io/projected/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-kube-api-access-chccj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.419713 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.419691 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:40.548786 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.548750 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv"] Jun 03 08:53:40.551545 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:53:40.551519 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3b827e_0512_4d1c_b4f5_33bb383c3f79.slice/crio-7d4c2d4724704627f817726752fcff27413de9d8e5e66e0d34c1f472adc795c9 WatchSource:0}: Error finding container 7d4c2d4724704627f817726752fcff27413de9d8e5e66e0d34c1f472adc795c9: Status 404 returned error can't find the container with id 7d4c2d4724704627f817726752fcff27413de9d8e5e66e0d34c1f472adc795c9 Jun 03 08:53:40.826617 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.826587 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-hj9fg"] Jun 03 08:53:40.841698 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.841660 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-hj9fg"] Jun 03 08:53:40.841698 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.841689 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:40.844709 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.844692 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rxpvx\"" Jun 03 08:53:40.966903 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.966809 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc6l8\" (UniqueName: \"kubernetes.io/projected/e71f244e-696a-45c9-9788-abede390736b-kube-api-access-qc6l8\") pod \"cert-manager-79c8d999ff-hj9fg\" (UID: \"e71f244e-696a-45c9-9788-abede390736b\") " pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:40.967060 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:40.966924 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e71f244e-696a-45c9-9788-abede390736b-bound-sa-token\") pod \"cert-manager-79c8d999ff-hj9fg\" (UID: \"e71f244e-696a-45c9-9788-abede390736b\") " pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:41.067871 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.067834 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e71f244e-696a-45c9-9788-abede390736b-bound-sa-token\") pod \"cert-manager-79c8d999ff-hj9fg\" (UID: \"e71f244e-696a-45c9-9788-abede390736b\") " pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:41.068041 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.067885 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qc6l8\" (UniqueName: \"kubernetes.io/projected/e71f244e-696a-45c9-9788-abede390736b-kube-api-access-qc6l8\") pod \"cert-manager-79c8d999ff-hj9fg\" (UID: \"e71f244e-696a-45c9-9788-abede390736b\") " pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:41.076699 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.076676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e71f244e-696a-45c9-9788-abede390736b-bound-sa-token\") pod \"cert-manager-79c8d999ff-hj9fg\" (UID: \"e71f244e-696a-45c9-9788-abede390736b\") " pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:41.076826 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.076807 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc6l8\" (UniqueName: \"kubernetes.io/projected/e71f244e-696a-45c9-9788-abede390736b-kube-api-access-qc6l8\") pod \"cert-manager-79c8d999ff-hj9fg\" (UID: \"e71f244e-696a-45c9-9788-abede390736b\") " pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:41.150153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.150124 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-hj9fg" Jun 03 08:53:41.274010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.273983 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-hj9fg"] Jun 03 08:53:41.276451 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:53:41.276417 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode71f244e_696a_45c9_9788_abede390736b.slice/crio-b7518572ac3c11b3f6309938e9c8ef24c78b4792690cda9137aba235adb85d38 WatchSource:0}: Error finding container b7518572ac3c11b3f6309938e9c8ef24c78b4792690cda9137aba235adb85d38: Status 404 returned error can't find the container with id b7518572ac3c11b3f6309938e9c8ef24c78b4792690cda9137aba235adb85d38 Jun 03 08:53:41.479873 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.479797 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-dbtcg" Jun 03 08:53:41.496266 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.496226 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-hj9fg" event={"ID":"e71f244e-696a-45c9-9788-abede390736b","Type":"ContainerStarted","Data":"133f29f6bb37f5ae65c3391e6ec2208f290dc54d9870908ed090b360b4508519"} Jun 03 08:53:41.496266 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.496264 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-hj9fg" event={"ID":"e71f244e-696a-45c9-9788-abede390736b","Type":"ContainerStarted","Data":"b7518572ac3c11b3f6309938e9c8ef24c78b4792690cda9137aba235adb85d38"} Jun 03 08:53:41.497675 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.497650 2561 generic.go:358] "Generic (PLEG): container finished" podID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerID="3ac42e709c76cdfaa46f003f5660a427bb58bd9e654662baca4250f9308e978c" exitCode=0 Jun 03 08:53:41.497803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.497736 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" event={"ID":"2d3b827e-0512-4d1c-b4f5-33bb383c3f79","Type":"ContainerDied","Data":"3ac42e709c76cdfaa46f003f5660a427bb58bd9e654662baca4250f9308e978c"} Jun 03 08:53:41.497803 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.497773 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" event={"ID":"2d3b827e-0512-4d1c-b4f5-33bb383c3f79","Type":"ContainerStarted","Data":"7d4c2d4724704627f817726752fcff27413de9d8e5e66e0d34c1f472adc795c9"} Jun 03 08:53:41.515855 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:41.515805 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-hj9fg" podStartSLOduration=1.515788658 podStartE2EDuration="1.515788658s" podCreationTimestamp="2026-06-03 08:53:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:53:41.514174914 +0000 UTC m=+554.291670554" watchObservedRunningTime="2026-06-03 08:53:41.515788658 +0000 UTC m=+554.293284297" Jun 03 08:53:42.503132 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:42.503101 2561 generic.go:358] "Generic (PLEG): container finished" podID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerID="54da46d8a2a9a9afc58890444e1bba4a607ffb840fe5d01a7ac692d84ee8aee0" exitCode=0 Jun 03 08:53:42.503551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:42.503191 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" event={"ID":"2d3b827e-0512-4d1c-b4f5-33bb383c3f79","Type":"ContainerDied","Data":"54da46d8a2a9a9afc58890444e1bba4a607ffb840fe5d01a7ac692d84ee8aee0"} Jun 03 08:53:43.508579 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:43.508539 2561 generic.go:358] "Generic (PLEG): container finished" podID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerID="d24476e116021e9660ab209ce4e1d5af3bc27d127602ac0da685bf474083c92c" exitCode=0 Jun 03 08:53:43.508579 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:43.508580 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" event={"ID":"2d3b827e-0512-4d1c-b4f5-33bb383c3f79","Type":"ContainerDied","Data":"d24476e116021e9660ab209ce4e1d5af3bc27d127602ac0da685bf474083c92c"} Jun 03 08:53:44.637428 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.637405 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:44.802674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.802573 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-util\") pod \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " Jun 03 08:53:44.802674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.802638 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-bundle\") pod \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " Jun 03 08:53:44.802906 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.802693 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chccj\" (UniqueName: \"kubernetes.io/projected/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-kube-api-access-chccj\") pod \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\" (UID: \"2d3b827e-0512-4d1c-b4f5-33bb383c3f79\") " Jun 03 08:53:44.803345 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.803305 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-bundle" (OuterVolumeSpecName: "bundle") pod "2d3b827e-0512-4d1c-b4f5-33bb383c3f79" (UID: "2d3b827e-0512-4d1c-b4f5-33bb383c3f79"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:53:44.804883 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.804853 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-kube-api-access-chccj" (OuterVolumeSpecName: "kube-api-access-chccj") pod "2d3b827e-0512-4d1c-b4f5-33bb383c3f79" (UID: "2d3b827e-0512-4d1c-b4f5-33bb383c3f79"). InnerVolumeSpecName "kube-api-access-chccj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:53:44.810352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.810326 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-util" (OuterVolumeSpecName: "util") pod "2d3b827e-0512-4d1c-b4f5-33bb383c3f79" (UID: "2d3b827e-0512-4d1c-b4f5-33bb383c3f79"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:53:44.903843 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.903801 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chccj\" (UniqueName: \"kubernetes.io/projected/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-kube-api-access-chccj\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:44.903843 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.903835 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:44.903843 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:44.903845 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d3b827e-0512-4d1c-b4f5-33bb383c3f79-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:53:45.517689 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:45.517663 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" Jun 03 08:53:45.517689 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:45.517672 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdjmwcv" event={"ID":"2d3b827e-0512-4d1c-b4f5-33bb383c3f79","Type":"ContainerDied","Data":"7d4c2d4724704627f817726752fcff27413de9d8e5e66e0d34c1f472adc795c9"} Jun 03 08:53:45.517900 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:45.517704 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d4c2d4724704627f817726752fcff27413de9d8e5e66e0d34c1f472adc795c9" Jun 03 08:53:57.030436 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030404 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd"] Jun 03 08:53:57.030933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030723 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerName="util" Jun 03 08:53:57.030933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030734 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerName="util" Jun 03 08:53:57.030933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030744 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerName="pull" Jun 03 08:53:57.030933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030749 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerName="pull" Jun 03 08:53:57.030933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030762 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerName="extract" Jun 03 08:53:57.030933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030767 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerName="extract" Jun 03 08:53:57.030933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.030826 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="2d3b827e-0512-4d1c-b4f5-33bb383c3f79" containerName="extract" Jun 03 08:53:57.035062 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.035044 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.038039 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.038015 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 08:53:57.038179 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.038020 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 08:53:57.038179 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.038025 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dlmg6\"" Jun 03 08:53:57.038326 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.038303 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 08:53:57.038460 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.038437 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 08:53:57.047837 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.047815 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd"] Jun 03 08:53:57.205818 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.205768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c523232a-6fde-4352-b45e-4e34c477ec48-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.205818 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.205818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c523232a-6fde-4352-b45e-4e34c477ec48-tmp\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.206019 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.205851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk7kh\" (UniqueName: \"kubernetes.io/projected/c523232a-6fde-4352-b45e-4e34c477ec48-kube-api-access-jk7kh\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.206019 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.205875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c523232a-6fde-4352-b45e-4e34c477ec48-webhook-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.206019 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.205909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c523232a-6fde-4352-b45e-4e34c477ec48-manifests\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.306584 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.306559 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c523232a-6fde-4352-b45e-4e34c477ec48-manifests\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.306717 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.306613 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c523232a-6fde-4352-b45e-4e34c477ec48-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.306717 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.306641 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c523232a-6fde-4352-b45e-4e34c477ec48-tmp\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.306717 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.306672 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jk7kh\" (UniqueName: \"kubernetes.io/projected/c523232a-6fde-4352-b45e-4e34c477ec48-kube-api-access-jk7kh\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.306717 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.306700 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c523232a-6fde-4352-b45e-4e34c477ec48-webhook-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.307015 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.306990 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c523232a-6fde-4352-b45e-4e34c477ec48-manifests\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.309095 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.309063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c523232a-6fde-4352-b45e-4e34c477ec48-tmp\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.309281 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.309262 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c523232a-6fde-4352-b45e-4e34c477ec48-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.309325 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.309268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c523232a-6fde-4352-b45e-4e34c477ec48-webhook-cert\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.319816 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.319793 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk7kh\" (UniqueName: \"kubernetes.io/projected/c523232a-6fde-4352-b45e-4e34c477ec48-kube-api-access-jk7kh\") pod \"opendatahub-operator-controller-manager-d95b9c768-f8lzd\" (UID: \"c523232a-6fde-4352-b45e-4e34c477ec48\") " pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.345677 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.345655 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:53:57.477773 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.477748 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd"] Jun 03 08:53:57.479915 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:53:57.479891 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc523232a_6fde_4352_b45e_4e34c477ec48.slice/crio-43cac804b1393aae367e862d62928aa5d5507569aad46c4b38b590956e8ea4d6 WatchSource:0}: Error finding container 43cac804b1393aae367e862d62928aa5d5507569aad46c4b38b590956e8ea4d6: Status 404 returned error can't find the container with id 43cac804b1393aae367e862d62928aa5d5507569aad46c4b38b590956e8ea4d6 Jun 03 08:53:57.557406 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:53:57.557303 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" event={"ID":"c523232a-6fde-4352-b45e-4e34c477ec48","Type":"ContainerStarted","Data":"43cac804b1393aae367e862d62928aa5d5507569aad46c4b38b590956e8ea4d6"} Jun 03 08:54:01.573760 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:01.573729 2561 generic.go:358] "Generic (PLEG): container finished" podID="c523232a-6fde-4352-b45e-4e34c477ec48" containerID="34487d2d22b10d70a458356eae2725aff8539fd8f514c5baae7bc91cf44c6fe3" exitCode=0 Jun 03 08:54:01.574062 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:01.573782 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" event={"ID":"c523232a-6fde-4352-b45e-4e34c477ec48","Type":"ContainerDied","Data":"34487d2d22b10d70a458356eae2725aff8539fd8f514c5baae7bc91cf44c6fe3"} Jun 03 08:54:02.579265 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:02.579223 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" event={"ID":"c523232a-6fde-4352-b45e-4e34c477ec48","Type":"ContainerStarted","Data":"75e0e93136643a745c0599faa7f3d8fd54bda5bd51d5a576c4dc5dff53dbc01c"} Jun 03 08:54:02.579696 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:02.579339 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:54:02.603356 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:02.603144 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" podStartSLOduration=2.13156163 podStartE2EDuration="6.603128685s" podCreationTimestamp="2026-06-03 08:53:56 +0000 UTC" firstStartedPulling="2026-06-03 08:53:57.481560283 +0000 UTC m=+570.259055899" lastFinishedPulling="2026-06-03 08:54:01.953127332 +0000 UTC m=+574.730622954" observedRunningTime="2026-06-03 08:54:02.601079933 +0000 UTC m=+575.378575571" watchObservedRunningTime="2026-06-03 08:54:02.603128685 +0000 UTC m=+575.380624325" Jun 03 08:54:13.585489 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:13.585460 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d95b9c768-f8lzd" Jun 03 08:54:18.841696 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.841657 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-947794d7f-gll75"] Jun 03 08:54:18.846081 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.846057 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.848908 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.848883 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 08:54:18.850092 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.850067 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 08:54:18.850240 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.850117 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-64t5c\"" Jun 03 08:54:18.850240 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.850161 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 08:54:18.860010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.859987 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-947794d7f-gll75"] Jun 03 08:54:18.889229 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.889201 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/572c214c-8cda-456f-a539-696866db80b9-cert\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.889349 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.889255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/572c214c-8cda-456f-a539-696866db80b9-metrics-cert\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.889349 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.889295 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwj8l\" (UniqueName: \"kubernetes.io/projected/572c214c-8cda-456f-a539-696866db80b9-kube-api-access-kwj8l\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.889501 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.889489 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/572c214c-8cda-456f-a539-696866db80b9-manager-config\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.989985 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.989950 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/572c214c-8cda-456f-a539-696866db80b9-metrics-cert\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.990181 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.989994 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwj8l\" (UniqueName: \"kubernetes.io/projected/572c214c-8cda-456f-a539-696866db80b9-kube-api-access-kwj8l\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.990181 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.990119 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/572c214c-8cda-456f-a539-696866db80b9-manager-config\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.990304 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.990202 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/572c214c-8cda-456f-a539-696866db80b9-cert\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.990913 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.990879 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/572c214c-8cda-456f-a539-696866db80b9-manager-config\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.992628 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.992605 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/572c214c-8cda-456f-a539-696866db80b9-cert\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.992722 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.992670 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/572c214c-8cda-456f-a539-696866db80b9-metrics-cert\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:18.999741 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:18.999718 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwj8l\" (UniqueName: \"kubernetes.io/projected/572c214c-8cda-456f-a539-696866db80b9-kube-api-access-kwj8l\") pod \"lws-controller-manager-947794d7f-gll75\" (UID: \"572c214c-8cda-456f-a539-696866db80b9\") " pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:19.157169 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:19.157076 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:19.300099 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:19.300064 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-947794d7f-gll75"] Jun 03 08:54:19.303010 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:54:19.302980 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572c214c_8cda_456f_a539_696866db80b9.slice/crio-253c94f52e66f69291dfdec6a859fe0a62c97f4226fe54520265c63677335518 WatchSource:0}: Error finding container 253c94f52e66f69291dfdec6a859fe0a62c97f4226fe54520265c63677335518: Status 404 returned error can't find the container with id 253c94f52e66f69291dfdec6a859fe0a62c97f4226fe54520265c63677335518 Jun 03 08:54:19.640849 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:19.640810 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" event={"ID":"572c214c-8cda-456f-a539-696866db80b9","Type":"ContainerStarted","Data":"253c94f52e66f69291dfdec6a859fe0a62c97f4226fe54520265c63677335518"} Jun 03 08:54:21.652852 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:21.652800 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" event={"ID":"572c214c-8cda-456f-a539-696866db80b9","Type":"ContainerStarted","Data":"2ba8f86684284b6dbff81d0755506eedbec7bd2851c7bd2ad83f38fc2ce51d91"} Jun 03 08:54:21.653348 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:21.653317 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:21.670705 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:21.670282 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" podStartSLOduration=2.01195588 podStartE2EDuration="3.670264347s" podCreationTimestamp="2026-06-03 08:54:18 +0000 UTC" firstStartedPulling="2026-06-03 08:54:19.304842434 +0000 UTC m=+592.082338053" lastFinishedPulling="2026-06-03 08:54:20.963150903 +0000 UTC m=+593.740646520" observedRunningTime="2026-06-03 08:54:21.66970726 +0000 UTC m=+594.447202924" watchObservedRunningTime="2026-06-03 08:54:21.670264347 +0000 UTC m=+594.447760003" Jun 03 08:54:23.471566 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.471523 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl"] Jun 03 08:54:23.475427 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.475406 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.478267 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.478246 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 08:54:23.479447 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.479428 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 08:54:23.479551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.479511 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxk8r\"" Jun 03 08:54:23.484149 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.484125 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl"] Jun 03 08:54:23.537387 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.537357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.537544 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.537428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.537609 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.537540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwbvw\" (UniqueName: \"kubernetes.io/projected/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-kube-api-access-jwbvw\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.638597 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.638559 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jwbvw\" (UniqueName: \"kubernetes.io/projected/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-kube-api-access-jwbvw\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.638755 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.638603 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.638755 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.638660 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.639091 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.639068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.639126 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.639099 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.647333 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.647306 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwbvw\" (UniqueName: \"kubernetes.io/projected/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-kube-api-access-jwbvw\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.786014 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.785933 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:23.921268 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:23.921241 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl"] Jun 03 08:54:23.924021 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:54:23.923998 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c5cdfe_9a37_47b4_be1a_a6d62e280d9f.slice/crio-34cc391758997d20d556f3fdb22568e2021530b0d08740649bc8d7c980500544 WatchSource:0}: Error finding container 34cc391758997d20d556f3fdb22568e2021530b0d08740649bc8d7c980500544: Status 404 returned error can't find the container with id 34cc391758997d20d556f3fdb22568e2021530b0d08740649bc8d7c980500544 Jun 03 08:54:24.665554 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:24.665515 2561 generic.go:358] "Generic (PLEG): container finished" podID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerID="4244ff34877e774b90e8ed1455a6a07472fd09ed48b6e4be2375a0bfb2ee3e38" exitCode=0 Jun 03 08:54:24.665978 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:24.665589 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" event={"ID":"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f","Type":"ContainerDied","Data":"4244ff34877e774b90e8ed1455a6a07472fd09ed48b6e4be2375a0bfb2ee3e38"} Jun 03 08:54:24.665978 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:24.665618 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" event={"ID":"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f","Type":"ContainerStarted","Data":"34cc391758997d20d556f3fdb22568e2021530b0d08740649bc8d7c980500544"} Jun 03 08:54:26.675230 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:26.675198 2561 generic.go:358] "Generic (PLEG): container finished" podID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerID="6516ec75ddae83c5cd858c76b3ef840222065e34d25309982626568bd9b03a88" exitCode=0 Jun 03 08:54:26.675646 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:26.675286 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" event={"ID":"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f","Type":"ContainerDied","Data":"6516ec75ddae83c5cd858c76b3ef840222065e34d25309982626568bd9b03a88"} Jun 03 08:54:27.681100 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:27.681066 2561 generic.go:358] "Generic (PLEG): container finished" podID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerID="32faa7cc3ab8df50c975e2295dd4356892821d9ce5bd344f222d03bc5ae6fb42" exitCode=0 Jun 03 08:54:27.681624 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:27.681138 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" event={"ID":"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f","Type":"ContainerDied","Data":"32faa7cc3ab8df50c975e2295dd4356892821d9ce5bd344f222d03bc5ae6fb42"} Jun 03 08:54:27.773275 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:27.773243 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:54:27.773750 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:27.773713 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:54:27.780872 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:27.780854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:54:27.780967 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:27.780908 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:54:28.830419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:28.830396 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:28.986014 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:28.985923 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwbvw\" (UniqueName: \"kubernetes.io/projected/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-kube-api-access-jwbvw\") pod \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " Jun 03 08:54:28.986014 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:28.985998 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-util\") pod \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " Jun 03 08:54:28.986198 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:28.986103 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-bundle\") pod \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\" (UID: \"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f\") " Jun 03 08:54:28.987066 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:28.987032 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-bundle" (OuterVolumeSpecName: "bundle") pod "56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" (UID: "56c5cdfe-9a37-47b4-be1a-a6d62e280d9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:54:28.988295 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:28.988258 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-kube-api-access-jwbvw" (OuterVolumeSpecName: "kube-api-access-jwbvw") pod "56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" (UID: "56c5cdfe-9a37-47b4-be1a-a6d62e280d9f"). InnerVolumeSpecName "kube-api-access-jwbvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:54:28.991479 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:28.991444 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-util" (OuterVolumeSpecName: "util") pod "56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" (UID: "56c5cdfe-9a37-47b4-be1a-a6d62e280d9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:54:29.086857 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:29.086822 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:54:29.086857 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:29.086858 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwbvw\" (UniqueName: \"kubernetes.io/projected/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-kube-api-access-jwbvw\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:54:29.087050 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:29.086875 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56c5cdfe-9a37-47b4-be1a-a6d62e280d9f-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:54:29.689623 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:29.689587 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" event={"ID":"56c5cdfe-9a37-47b4-be1a-a6d62e280d9f","Type":"ContainerDied","Data":"34cc391758997d20d556f3fdb22568e2021530b0d08740649bc8d7c980500544"} Jun 03 08:54:29.689623 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:29.689626 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34cc391758997d20d556f3fdb22568e2021530b0d08740649bc8d7c980500544" Jun 03 08:54:29.689821 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:29.689602 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835ctncl" Jun 03 08:54:33.661878 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:33.661846 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-947794d7f-gll75" Jun 03 08:54:37.766598 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.766557 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh"] Jun 03 08:54:37.767068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.767004 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerName="util" Jun 03 08:54:37.767068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.767021 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerName="util" Jun 03 08:54:37.767068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.767036 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerName="extract" Jun 03 08:54:37.767068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.767044 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerName="extract" Jun 03 08:54:37.767068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.767062 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerName="pull" Jun 03 08:54:37.767068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.767070 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerName="pull" Jun 03 08:54:37.767368 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.767164 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="56c5cdfe-9a37-47b4-be1a-a6d62e280d9f" containerName="extract" Jun 03 08:54:37.773859 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.773834 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:37.776790 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.776768 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 08:54:37.776919 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.776791 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 08:54:37.776919 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.776840 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxk8r\"" Jun 03 08:54:37.780580 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.780557 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh"] Jun 03 08:54:37.881595 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.881564 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5c68945bf9-gx7fr"] Jun 03 08:54:37.883730 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.883713 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:37.887149 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.887123 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 08:54:37.887149 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.887143 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jwpld\"" Jun 03 08:54:37.899950 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.899921 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c68945bf9-gx7fr"] Jun 03 08:54:37.964153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.964120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:37.964352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.964260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:37.964352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:37.964317 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq4c6\" (UniqueName: \"kubernetes.io/projected/3f3457eb-3c15-45c7-8600-9c48db86151f-kube-api-access-wq4c6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.065169 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.065134 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wq4c6\" (UniqueName: \"kubernetes.io/projected/3f3457eb-3c15-45c7-8600-9c48db86151f-kube-api-access-wq4c6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.065461 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.065221 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvw2\" (UniqueName: \"kubernetes.io/projected/d995dfbc-bad9-4c86-ae37-3de6863b8c12-kube-api-access-khvw2\") pod \"dashboard-redirect-5c68945bf9-gx7fr\" (UID: \"d995dfbc-bad9-4c86-ae37-3de6863b8c12\") " pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:38.065461 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.065264 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.065461 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.065364 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.065461 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.065434 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d995dfbc-bad9-4c86-ae37-3de6863b8c12-redirect-config\") pod \"dashboard-redirect-5c68945bf9-gx7fr\" (UID: \"d995dfbc-bad9-4c86-ae37-3de6863b8c12\") " pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:38.065683 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.065664 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.065760 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.065740 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.076366 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.076340 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq4c6\" (UniqueName: \"kubernetes.io/projected/3f3457eb-3c15-45c7-8600-9c48db86151f-kube-api-access-wq4c6\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.084076 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.084048 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:38.167070 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.166021 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d995dfbc-bad9-4c86-ae37-3de6863b8c12-redirect-config\") pod \"dashboard-redirect-5c68945bf9-gx7fr\" (UID: \"d995dfbc-bad9-4c86-ae37-3de6863b8c12\") " pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:38.167070 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.166080 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-khvw2\" (UniqueName: \"kubernetes.io/projected/d995dfbc-bad9-4c86-ae37-3de6863b8c12-kube-api-access-khvw2\") pod \"dashboard-redirect-5c68945bf9-gx7fr\" (UID: \"d995dfbc-bad9-4c86-ae37-3de6863b8c12\") " pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:38.167070 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.167009 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d995dfbc-bad9-4c86-ae37-3de6863b8c12-redirect-config\") pod \"dashboard-redirect-5c68945bf9-gx7fr\" (UID: \"d995dfbc-bad9-4c86-ae37-3de6863b8c12\") " pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:38.178215 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.178169 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvw2\" (UniqueName: \"kubernetes.io/projected/d995dfbc-bad9-4c86-ae37-3de6863b8c12-kube-api-access-khvw2\") pod \"dashboard-redirect-5c68945bf9-gx7fr\" (UID: \"d995dfbc-bad9-4c86-ae37-3de6863b8c12\") " pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:38.195835 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.195805 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" Jun 03 08:54:38.240476 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.240416 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh"] Jun 03 08:54:38.247071 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:54:38.247009 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3457eb_3c15_45c7_8600_9c48db86151f.slice/crio-392a6c5e4ea8d144564e261918b205092ac5ebd0e1242522196a9b09798026e0 WatchSource:0}: Error finding container 392a6c5e4ea8d144564e261918b205092ac5ebd0e1242522196a9b09798026e0: Status 404 returned error can't find the container with id 392a6c5e4ea8d144564e261918b205092ac5ebd0e1242522196a9b09798026e0 Jun 03 08:54:38.364321 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.364296 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5c68945bf9-gx7fr"] Jun 03 08:54:38.394321 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:54:38.394285 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd995dfbc_bad9_4c86_ae37_3de6863b8c12.slice/crio-1707e39a9f242201c2c264acadfaed143bec3fda63b28342ad9eceae18eb4eba WatchSource:0}: Error finding container 1707e39a9f242201c2c264acadfaed143bec3fda63b28342ad9eceae18eb4eba: Status 404 returned error can't find the container with id 1707e39a9f242201c2c264acadfaed143bec3fda63b28342ad9eceae18eb4eba Jun 03 08:54:38.726908 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.726821 2561 generic.go:358] "Generic (PLEG): container finished" podID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerID="65fb7daaa458af2c2a02865279a3bc65ec3d71a607d4154d3afea4d163852bf2" exitCode=0 Jun 03 08:54:38.727084 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.726907 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" event={"ID":"3f3457eb-3c15-45c7-8600-9c48db86151f","Type":"ContainerDied","Data":"65fb7daaa458af2c2a02865279a3bc65ec3d71a607d4154d3afea4d163852bf2"} Jun 03 08:54:38.727084 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.726947 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" event={"ID":"3f3457eb-3c15-45c7-8600-9c48db86151f","Type":"ContainerStarted","Data":"392a6c5e4ea8d144564e261918b205092ac5ebd0e1242522196a9b09798026e0"} Jun 03 08:54:38.728281 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:38.728251 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" event={"ID":"d995dfbc-bad9-4c86-ae37-3de6863b8c12","Type":"ContainerStarted","Data":"1707e39a9f242201c2c264acadfaed143bec3fda63b28342ad9eceae18eb4eba"} Jun 03 08:54:43.751947 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:43.751902 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" event={"ID":"d995dfbc-bad9-4c86-ae37-3de6863b8c12","Type":"ContainerStarted","Data":"b2159f2ed2daa3d9b075b16aa8d1b1ad3aa3d6547a1d761c45cb75b374411e41"} Jun 03 08:54:43.753632 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:43.753606 2561 generic.go:358] "Generic (PLEG): container finished" podID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerID="91e28fbe0913ceb7e3d4dc49bdce52c725bc98d8bdb302286086ae01c670060f" exitCode=0 Jun 03 08:54:43.753726 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:43.753697 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" event={"ID":"3f3457eb-3c15-45c7-8600-9c48db86151f","Type":"ContainerDied","Data":"91e28fbe0913ceb7e3d4dc49bdce52c725bc98d8bdb302286086ae01c670060f"} Jun 03 08:54:43.771115 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:43.771058 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5c68945bf9-gx7fr" podStartSLOduration=2.287611975 podStartE2EDuration="6.771038915s" podCreationTimestamp="2026-06-03 08:54:37 +0000 UTC" firstStartedPulling="2026-06-03 08:54:38.395827727 +0000 UTC m=+611.173323349" lastFinishedPulling="2026-06-03 08:54:42.879254661 +0000 UTC m=+615.656750289" observedRunningTime="2026-06-03 08:54:43.769470836 +0000 UTC m=+616.546966475" watchObservedRunningTime="2026-06-03 08:54:43.771038915 +0000 UTC m=+616.548534556" Jun 03 08:54:44.758723 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:44.758689 2561 generic.go:358] "Generic (PLEG): container finished" podID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerID="1f9d55b793feaf509025ab13dd3663f23d368eb460af205657d239964078cf15" exitCode=0 Jun 03 08:54:44.759098 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:44.758779 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" event={"ID":"3f3457eb-3c15-45c7-8600-9c48db86151f","Type":"ContainerDied","Data":"1f9d55b793feaf509025ab13dd3663f23d368eb460af205657d239964078cf15"} Jun 03 08:54:45.885957 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:45.885933 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:45.932365 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:45.932335 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-bundle\") pod \"3f3457eb-3c15-45c7-8600-9c48db86151f\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " Jun 03 08:54:45.932530 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:45.932389 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-util\") pod \"3f3457eb-3c15-45c7-8600-9c48db86151f\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " Jun 03 08:54:45.932530 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:45.932419 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq4c6\" (UniqueName: \"kubernetes.io/projected/3f3457eb-3c15-45c7-8600-9c48db86151f-kube-api-access-wq4c6\") pod \"3f3457eb-3c15-45c7-8600-9c48db86151f\" (UID: \"3f3457eb-3c15-45c7-8600-9c48db86151f\") " Jun 03 08:54:45.933289 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:45.933258 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-bundle" (OuterVolumeSpecName: "bundle") pod "3f3457eb-3c15-45c7-8600-9c48db86151f" (UID: "3f3457eb-3c15-45c7-8600-9c48db86151f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:54:45.934783 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:45.934760 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3457eb-3c15-45c7-8600-9c48db86151f-kube-api-access-wq4c6" (OuterVolumeSpecName: "kube-api-access-wq4c6") pod "3f3457eb-3c15-45c7-8600-9c48db86151f" (UID: "3f3457eb-3c15-45c7-8600-9c48db86151f"). InnerVolumeSpecName "kube-api-access-wq4c6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:54:45.937738 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:45.937709 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-util" (OuterVolumeSpecName: "util") pod "3f3457eb-3c15-45c7-8600-9c48db86151f" (UID: "3f3457eb-3c15-45c7-8600-9c48db86151f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:54:46.033752 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:46.033650 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:54:46.033752 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:46.033690 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f3457eb-3c15-45c7-8600-9c48db86151f-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:54:46.033752 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:46.033700 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq4c6\" (UniqueName: \"kubernetes.io/projected/3f3457eb-3c15-45c7-8600-9c48db86151f-kube-api-access-wq4c6\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:54:46.766488 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:46.766463 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" Jun 03 08:54:46.766678 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:46.766455 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acklvh" event={"ID":"3f3457eb-3c15-45c7-8600-9c48db86151f","Type":"ContainerDied","Data":"392a6c5e4ea8d144564e261918b205092ac5ebd0e1242522196a9b09798026e0"} Jun 03 08:54:46.766678 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:46.766567 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="392a6c5e4ea8d144564e261918b205092ac5ebd0e1242522196a9b09798026e0" Jun 03 08:54:55.829272 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829239 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p"] Jun 03 08:54:55.829675 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829576 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerName="pull" Jun 03 08:54:55.829675 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829588 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerName="pull" Jun 03 08:54:55.829675 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829597 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerName="extract" Jun 03 08:54:55.829675 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829602 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerName="extract" Jun 03 08:54:55.829675 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829610 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerName="util" Jun 03 08:54:55.829675 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829617 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerName="util" Jun 03 08:54:55.829876 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.829687 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f3457eb-3c15-45c7-8600-9c48db86151f" containerName="extract" Jun 03 08:54:55.835357 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.835334 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.840070 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.840043 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 08:54:55.840248 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.840229 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lgzkj\"" Jun 03 08:54:55.840311 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.840267 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 08:54:55.840362 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.840319 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 08:54:55.876721 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.876696 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p"] Jun 03 08:54:55.917683 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czrz\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-kube-api-access-6czrz\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917776 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917939 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917939 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917915 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917998 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917960 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:55.917998 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:55.917988 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.018577 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018546 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.018739 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018587 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.018739 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018616 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.018739 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018641 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.018739 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018681 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.018739 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018708 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019002 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018770 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6czrz\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-kube-api-access-6czrz\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019002 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018817 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019002 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.018842 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019154 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.019027 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019294 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.019259 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019590 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.019370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019590 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.019399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.019590 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.019524 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.021519 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.021497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.021864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.021842 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.033638 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.033614 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czrz\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-kube-api-access-6czrz\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.034143 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.034112 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.146259 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.146183 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:54:56.301720 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.296782 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p"] Jun 03 08:54:56.301720 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:54:56.298786 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183d8b7d_eaf3_4b62_8f00_35a2d6d234d5.slice/crio-297ae484741e7dd0b6729994a2ba5142846cc5a9131f4a0a9e275a90b55b19af WatchSource:0}: Error finding container 297ae484741e7dd0b6729994a2ba5142846cc5a9131f4a0a9e275a90b55b19af: Status 404 returned error can't find the container with id 297ae484741e7dd0b6729994a2ba5142846cc5a9131f4a0a9e275a90b55b19af Jun 03 08:54:56.802852 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:56.802789 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" event={"ID":"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5","Type":"ContainerStarted","Data":"297ae484741e7dd0b6729994a2ba5142846cc5a9131f4a0a9e275a90b55b19af"} Jun 03 08:54:59.220419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:59.220366 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 08:54:59.220671 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:59.220455 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 08:54:59.220671 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:59.220481 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 08:54:59.815758 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:59.815723 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" event={"ID":"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5","Type":"ContainerStarted","Data":"ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e"} Jun 03 08:54:59.837802 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:54:59.837743 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" podStartSLOduration=1.920798058 podStartE2EDuration="4.837727816s" podCreationTimestamp="2026-06-03 08:54:55 +0000 UTC" firstStartedPulling="2026-06-03 08:54:56.303191806 +0000 UTC m=+629.080687422" lastFinishedPulling="2026-06-03 08:54:59.220121564 +0000 UTC m=+631.997617180" observedRunningTime="2026-06-03 08:54:59.834309991 +0000 UTC m=+632.611805628" watchObservedRunningTime="2026-06-03 08:54:59.837727816 +0000 UTC m=+632.615223453" Jun 03 08:55:00.146998 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:00.146910 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:55:00.148209 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:00.148184 2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 03 08:55:00.148327 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:00.148239 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" podUID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 03 08:55:00.634083 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:00.634050 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p"] Jun 03 08:55:01.147400 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:01.147347 2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jun 03 08:55:01.147579 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:01.147429 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" podUID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jun 03 08:55:01.825098 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:01.825023 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" podUID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" containerName="istio-proxy" containerID="cri-o://ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e" gracePeriod=30 Jun 03 08:55:07.073218 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.073193 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:55:07.118465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118371 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istiod-ca-cert\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118445 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-token\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118487 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-envoy\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118559 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-credential-socket\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118586 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-certs\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118628 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-data\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118652 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-socket\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118921 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118688 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-podinfo\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118921 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118733 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6czrz\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-kube-api-access-6czrz\") pod \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\" (UID: \"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5\") " Jun 03 08:55:07.118921 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118740 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:55:07.118921 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.118837 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:07.119125 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.119004 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:07.119125 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.119052 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:07.119125 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.119074 2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istiod-ca-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.119125 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.119093 2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-credential-socket\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.119322 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.119240 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:07.121169 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.121093 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-kube-api-access-6czrz" (OuterVolumeSpecName: "kube-api-access-6czrz") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "kube-api-access-6czrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:07.130331 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.121284 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:07.130331 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.121477 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 03 08:55:07.130331 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.121491 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" (UID: "183d8b7d-eaf3-4b62-8f00-35a2d6d234d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:07.220434 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.220374 2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-envoy\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.220434 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.220430 2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-certs\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.220434 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.220442 2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-data\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.220647 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.220451 2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-workload-socket\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.220647 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.220460 2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-podinfo\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.220647 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.220471 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6czrz\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-kube-api-access-6czrz\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.220647 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.220481 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5-istio-token\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:07.845591 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.845559 2561 generic.go:358] "Generic (PLEG): container finished" podID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" containerID="ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e" exitCode=0 Jun 03 08:55:07.845795 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.845617 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" Jun 03 08:55:07.845795 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.845638 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" event={"ID":"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5","Type":"ContainerDied","Data":"ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e"} Jun 03 08:55:07.845795 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.845683 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p" event={"ID":"183d8b7d-eaf3-4b62-8f00-35a2d6d234d5","Type":"ContainerDied","Data":"297ae484741e7dd0b6729994a2ba5142846cc5a9131f4a0a9e275a90b55b19af"} Jun 03 08:55:07.845795 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.845700 2561 scope.go:117] "RemoveContainer" containerID="ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e" Jun 03 08:55:07.854110 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.854092 2561 scope.go:117] "RemoveContainer" containerID="ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e" Jun 03 08:55:07.854358 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:55:07.854339 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e\": container with ID starting with ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e not found: ID does not exist" containerID="ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e" Jun 03 08:55:07.854431 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.854366 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e"} err="failed to get container status \"ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e\": rpc error: code = NotFound desc = could not find container \"ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e\": container with ID starting with ca02450e0335d505f2538f048676cdc1225c9b832cc25e739ca30c2edf0a119e not found: ID does not exist" Jun 03 08:55:07.866550 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.866526 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p"] Jun 03 08:55:07.870804 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:07.870782 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44ncv4p"] Jun 03 08:55:09.837390 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:09.837341 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" path="/var/lib/kubelet/pods/183d8b7d-eaf3-4b62-8f00-35a2d6d234d5/volumes" Jun 03 08:55:18.012450 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.012419 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dd9pj"] Jun 03 08:55:18.012852 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.012722 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" containerName="istio-proxy" Jun 03 08:55:18.012852 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.012733 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" containerName="istio-proxy" Jun 03 08:55:18.012852 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.012802 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="183d8b7d-eaf3-4b62-8f00-35a2d6d234d5" containerName="istio-proxy" Jun 03 08:55:18.032754 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.032726 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dd9pj"] Jun 03 08:55:18.032884 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.032831 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:18.037652 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.037619 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-pdd88\"" Jun 03 08:55:18.038095 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.038079 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 08:55:18.038891 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.038869 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 08:55:18.115592 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.115558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6hm\" (UniqueName: \"kubernetes.io/projected/92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b-kube-api-access-5t6hm\") pod \"kuadrant-operator-catalog-dd9pj\" (UID: \"92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b\") " pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:18.216828 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.216790 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6hm\" (UniqueName: \"kubernetes.io/projected/92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b-kube-api-access-5t6hm\") pod \"kuadrant-operator-catalog-dd9pj\" (UID: \"92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b\") " pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:18.225233 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.225199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6hm\" (UniqueName: \"kubernetes.io/projected/92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b-kube-api-access-5t6hm\") pod \"kuadrant-operator-catalog-dd9pj\" (UID: \"92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b\") " pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:18.344163 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.344129 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:18.471816 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.471788 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-dd9pj"] Jun 03 08:55:18.474483 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:18.474451 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c35e43_a1a7_4b47_8d9b_49a5f5b2c86b.slice/crio-f48351a592b0239614553509249319abb6777f4a00fb29b7d852d8a41109752b WatchSource:0}: Error finding container f48351a592b0239614553509249319abb6777f4a00fb29b7d852d8a41109752b: Status 404 returned error can't find the container with id f48351a592b0239614553509249319abb6777f4a00fb29b7d852d8a41109752b Jun 03 08:55:18.890203 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:18.890170 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" event={"ID":"92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b","Type":"ContainerStarted","Data":"f48351a592b0239614553509249319abb6777f4a00fb29b7d852d8a41109752b"} Jun 03 08:55:20.898666 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:20.898579 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" event={"ID":"92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b","Type":"ContainerStarted","Data":"908f4255ba4597574e52a564c2f80fc67f74d06dfef00f3221334bd3615689b7"} Jun 03 08:55:20.916601 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:20.916555 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" podStartSLOduration=1.828904911 podStartE2EDuration="3.916540441s" podCreationTimestamp="2026-06-03 08:55:17 +0000 UTC" firstStartedPulling="2026-06-03 08:55:18.47621279 +0000 UTC m=+651.253708406" lastFinishedPulling="2026-06-03 08:55:20.563848315 +0000 UTC m=+653.341343936" observedRunningTime="2026-06-03 08:55:20.914776477 +0000 UTC m=+653.692272114" watchObservedRunningTime="2026-06-03 08:55:20.916540441 +0000 UTC m=+653.694036079" Jun 03 08:55:28.345126 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:28.345089 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:28.345126 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:28.345130 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:28.367108 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:28.367082 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:28.945635 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:28.945609 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-dd9pj" Jun 03 08:55:31.641304 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.641268 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5"] Jun 03 08:55:31.652026 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.652002 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5"] Jun 03 08:55:31.652153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.652112 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.655251 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.655228 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xhjth\"" Jun 03 08:55:31.731318 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.731284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.731486 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.731336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crhw2\" (UniqueName: \"kubernetes.io/projected/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-kube-api-access-crhw2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.731486 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.731421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.831864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.831819 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.832010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.831886 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crhw2\" (UniqueName: \"kubernetes.io/projected/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-kube-api-access-crhw2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.832010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.831921 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.832225 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.832205 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.832261 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.832213 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.840890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.840858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crhw2\" (UniqueName: \"kubernetes.io/projected/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-kube-api-access-crhw2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:31.962662 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:31.962584 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:32.116826 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.116802 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5"] Jun 03 08:55:32.118781 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:32.118754 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4656c86_3ee8_41a6_90b7_f2b56f58a9fc.slice/crio-97ff1fa9862254dc2140a40186b629263668af43789118189d4eed9a2f6d7569 WatchSource:0}: Error finding container 97ff1fa9862254dc2140a40186b629263668af43789118189d4eed9a2f6d7569: Status 404 returned error can't find the container with id 97ff1fa9862254dc2140a40186b629263668af43789118189d4eed9a2f6d7569 Jun 03 08:55:32.237946 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.237914 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp"] Jun 03 08:55:32.241812 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.241790 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.248824 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.248802 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp"] Jun 03 08:55:32.336211 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.336170 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.336373 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.336232 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vk28\" (UniqueName: \"kubernetes.io/projected/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-kube-api-access-6vk28\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.336373 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.336258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.437147 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.437116 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.437340 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.437169 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vk28\" (UniqueName: \"kubernetes.io/projected/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-kube-api-access-6vk28\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.437340 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.437189 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.437553 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.437536 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.437553 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.437527 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.445637 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.445619 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vk28\" (UniqueName: \"kubernetes.io/projected/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-kube-api-access-6vk28\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.592761 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.592728 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:32.721128 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.721102 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp"] Jun 03 08:55:32.722762 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:32.722731 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ee66c0_887d_48c1_81b8_b007b5bbcd1e.slice/crio-563442cb49859663422fa2c6b51c0f1e3d22def41d09f0ec49d36c944bb289c4 WatchSource:0}: Error finding container 563442cb49859663422fa2c6b51c0f1e3d22def41d09f0ec49d36c944bb289c4: Status 404 returned error can't find the container with id 563442cb49859663422fa2c6b51c0f1e3d22def41d09f0ec49d36c944bb289c4 Jun 03 08:55:32.838887 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.838853 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl"] Jun 03 08:55:32.842226 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.842209 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:32.850238 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.850179 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl"] Jun 03 08:55:32.939007 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.938976 2561 generic.go:358] "Generic (PLEG): container finished" podID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerID="3499a2d75610cc987045fff19a8f2df14ad5a205f98c0b2c723daaa620fe69a9" exitCode=0 Jun 03 08:55:32.939180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.939027 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" event={"ID":"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc","Type":"ContainerDied","Data":"3499a2d75610cc987045fff19a8f2df14ad5a205f98c0b2c723daaa620fe69a9"} Jun 03 08:55:32.939180 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.939062 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" event={"ID":"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc","Type":"ContainerStarted","Data":"97ff1fa9862254dc2140a40186b629263668af43789118189d4eed9a2f6d7569"} Jun 03 08:55:32.940326 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.940301 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:32.940466 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.940358 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpt77\" (UniqueName: \"kubernetes.io/projected/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-kube-api-access-lpt77\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:32.940466 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.940455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:32.940652 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.940630 2561 generic.go:358] "Generic (PLEG): container finished" podID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerID="596f685b9a07da059e04f19b6da0334a1cad03056332e34f81218b83119ba6d8" exitCode=0 Jun 03 08:55:32.940718 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.940700 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" event={"ID":"53ee66c0-887d-48c1-81b8-b007b5bbcd1e","Type":"ContainerDied","Data":"596f685b9a07da059e04f19b6da0334a1cad03056332e34f81218b83119ba6d8"} Jun 03 08:55:32.940754 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:32.940728 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" event={"ID":"53ee66c0-887d-48c1-81b8-b007b5bbcd1e","Type":"ContainerStarted","Data":"563442cb49859663422fa2c6b51c0f1e3d22def41d09f0ec49d36c944bb289c4"} Jun 03 08:55:33.041952 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.041912 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:33.042144 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.041967 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpt77\" (UniqueName: \"kubernetes.io/projected/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-kube-api-access-lpt77\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:33.042144 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.042011 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:33.042332 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.042311 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:33.042419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.042332 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:33.051429 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.051405 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpt77\" (UniqueName: \"kubernetes.io/projected/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-kube-api-access-lpt77\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:33.196084 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.196000 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:33.332272 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.332243 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl"] Jun 03 08:55:33.334270 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:33.334238 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed4ded8_6993_497b_8ac6_17c4ce1ea827.slice/crio-7812a49998f1b37dad27f7e43c59d22f86e28041a195bf60e9ca2c26ad38e9ca WatchSource:0}: Error finding container 7812a49998f1b37dad27f7e43c59d22f86e28041a195bf60e9ca2c26ad38e9ca: Status 404 returned error can't find the container with id 7812a49998f1b37dad27f7e43c59d22f86e28041a195bf60e9ca2c26ad38e9ca Jun 03 08:55:33.446029 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.446004 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6"] Jun 03 08:55:33.449812 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.449755 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.459023 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.458987 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6"] Jun 03 08:55:33.546138 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.546103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wxms\" (UniqueName: \"kubernetes.io/projected/e55faaf2-7418-4f44-af4d-f754ce36e4ca-kube-api-access-9wxms\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.546306 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.546202 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.546306 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.546255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.647125 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.647087 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.647304 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.647162 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9wxms\" (UniqueName: \"kubernetes.io/projected/e55faaf2-7418-4f44-af4d-f754ce36e4ca-kube-api-access-9wxms\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.647304 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.647293 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.647503 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.647483 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.647619 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.647601 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.657049 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.657030 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wxms\" (UniqueName: \"kubernetes.io/projected/e55faaf2-7418-4f44-af4d-f754ce36e4ca-kube-api-access-9wxms\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.795537 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.795508 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:33.923889 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.923857 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6"] Jun 03 08:55:33.924954 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:33.924924 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55faaf2_7418_4f44_af4d_f754ce36e4ca.slice/crio-747ea8b09c3bd3bc496c0ffde7a93af76eb49426db0f8f6f26d19b3fd15c060a WatchSource:0}: Error finding container 747ea8b09c3bd3bc496c0ffde7a93af76eb49426db0f8f6f26d19b3fd15c060a: Status 404 returned error can't find the container with id 747ea8b09c3bd3bc496c0ffde7a93af76eb49426db0f8f6f26d19b3fd15c060a Jun 03 08:55:33.946640 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.946606 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" event={"ID":"e55faaf2-7418-4f44-af4d-f754ce36e4ca","Type":"ContainerStarted","Data":"747ea8b09c3bd3bc496c0ffde7a93af76eb49426db0f8f6f26d19b3fd15c060a"} Jun 03 08:55:33.948496 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.948467 2561 generic.go:358] "Generic (PLEG): container finished" podID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerID="7422e17edab70b8713836dd439924dcda105339a5c78b3f90beb08b0d78f55b6" exitCode=0 Jun 03 08:55:33.948607 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.948553 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" event={"ID":"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc","Type":"ContainerDied","Data":"7422e17edab70b8713836dd439924dcda105339a5c78b3f90beb08b0d78f55b6"} Jun 03 08:55:33.950465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.950445 2561 generic.go:358] "Generic (PLEG): container finished" podID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerID="00f3b63beb6f2029e431b089591cd2a4b8e355e3d7baf7f83b238ca1e1f3fbe9" exitCode=0 Jun 03 08:55:33.950570 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.950520 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" event={"ID":"53ee66c0-887d-48c1-81b8-b007b5bbcd1e","Type":"ContainerDied","Data":"00f3b63beb6f2029e431b089591cd2a4b8e355e3d7baf7f83b238ca1e1f3fbe9"} Jun 03 08:55:33.951855 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.951762 2561 generic.go:358] "Generic (PLEG): container finished" podID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerID="e73c42b3d2daf0271f0dc37949e82edd48ef2a57a22119ff08cfe1c94489af0d" exitCode=0 Jun 03 08:55:33.951855 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.951803 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" event={"ID":"8ed4ded8-6993-497b-8ac6-17c4ce1ea827","Type":"ContainerDied","Data":"e73c42b3d2daf0271f0dc37949e82edd48ef2a57a22119ff08cfe1c94489af0d"} Jun 03 08:55:33.951855 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:33.951820 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" event={"ID":"8ed4ded8-6993-497b-8ac6-17c4ce1ea827","Type":"ContainerStarted","Data":"7812a49998f1b37dad27f7e43c59d22f86e28041a195bf60e9ca2c26ad38e9ca"} Jun 03 08:55:34.958892 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.958812 2561 generic.go:358] "Generic (PLEG): container finished" podID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerID="e5422b4883fd1fe50a5d25aeb46221c4459b071264a1ac4fa0ae911cbdb9515c" exitCode=0 Jun 03 08:55:34.959223 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.958900 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" event={"ID":"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc","Type":"ContainerDied","Data":"e5422b4883fd1fe50a5d25aeb46221c4459b071264a1ac4fa0ae911cbdb9515c"} Jun 03 08:55:34.960779 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.960758 2561 generic.go:358] "Generic (PLEG): container finished" podID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerID="32416be1fa95dda1f6e5ca05689fad21dc30ce0100cba00f648a66b0655b90f6" exitCode=0 Jun 03 08:55:34.960892 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.960815 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" event={"ID":"53ee66c0-887d-48c1-81b8-b007b5bbcd1e","Type":"ContainerDied","Data":"32416be1fa95dda1f6e5ca05689fad21dc30ce0100cba00f648a66b0655b90f6"} Jun 03 08:55:34.962361 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.962295 2561 generic.go:358] "Generic (PLEG): container finished" podID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerID="faccf51a97decca8e279bd6dc059ae309baf83e25dceff15f014c0cc6186fc50" exitCode=0 Jun 03 08:55:34.962361 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.962344 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" event={"ID":"8ed4ded8-6993-497b-8ac6-17c4ce1ea827","Type":"ContainerDied","Data":"faccf51a97decca8e279bd6dc059ae309baf83e25dceff15f014c0cc6186fc50"} Jun 03 08:55:34.963816 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.963798 2561 generic.go:358] "Generic (PLEG): container finished" podID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerID="357a0e3479f6a7fb548ad40eb7aa1c208ce147544275b9142da81110735a5ca0" exitCode=0 Jun 03 08:55:34.963904 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:34.963823 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" event={"ID":"e55faaf2-7418-4f44-af4d-f754ce36e4ca","Type":"ContainerDied","Data":"357a0e3479f6a7fb548ad40eb7aa1c208ce147544275b9142da81110735a5ca0"} Jun 03 08:55:35.968928 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:35.968833 2561 generic.go:358] "Generic (PLEG): container finished" podID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerID="6d87a24de1bf05eae249a45b61fbf02d39598380b9b90aca8fee7ea9507f9c18" exitCode=0 Jun 03 08:55:35.969324 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:35.968926 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" event={"ID":"8ed4ded8-6993-497b-8ac6-17c4ce1ea827","Type":"ContainerDied","Data":"6d87a24de1bf05eae249a45b61fbf02d39598380b9b90aca8fee7ea9507f9c18"} Jun 03 08:55:35.970494 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:35.970467 2561 generic.go:358] "Generic (PLEG): container finished" podID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerID="1fe2100564c25b468bcf65bd3101c3bff66c4479dc2e10900faa36426c035e4e" exitCode=0 Jun 03 08:55:35.970614 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:35.970557 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" event={"ID":"e55faaf2-7418-4f44-af4d-f754ce36e4ca","Type":"ContainerDied","Data":"1fe2100564c25b468bcf65bd3101c3bff66c4479dc2e10900faa36426c035e4e"} Jun 03 08:55:36.127020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.126995 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:36.165892 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.165864 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crhw2\" (UniqueName: \"kubernetes.io/projected/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-kube-api-access-crhw2\") pod \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " Jun 03 08:55:36.166035 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.165929 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-util\") pod \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " Jun 03 08:55:36.166035 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.165971 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-bundle\") pod \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\" (UID: \"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc\") " Jun 03 08:55:36.166458 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.166432 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-bundle" (OuterVolumeSpecName: "bundle") pod "c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" (UID: "c4656c86-3ee8-41a6-90b7-f2b56f58a9fc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:36.168094 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.168070 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-kube-api-access-crhw2" (OuterVolumeSpecName: "kube-api-access-crhw2") pod "c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" (UID: "c4656c86-3ee8-41a6-90b7-f2b56f58a9fc"). InnerVolumeSpecName "kube-api-access-crhw2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:36.171569 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.171548 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-util" (OuterVolumeSpecName: "util") pod "c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" (UID: "c4656c86-3ee8-41a6-90b7-f2b56f58a9fc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:36.189540 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.189518 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:36.267072 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.266983 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-util\") pod \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " Jun 03 08:55:36.267072 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.267025 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vk28\" (UniqueName: \"kubernetes.io/projected/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-kube-api-access-6vk28\") pod \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " Jun 03 08:55:36.267305 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.267074 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-bundle\") pod \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\" (UID: \"53ee66c0-887d-48c1-81b8-b007b5bbcd1e\") " Jun 03 08:55:36.267305 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.267230 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:36.267305 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.267242 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crhw2\" (UniqueName: \"kubernetes.io/projected/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-kube-api-access-crhw2\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:36.267305 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.267251 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4656c86-3ee8-41a6-90b7-f2b56f58a9fc-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:36.267574 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.267550 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-bundle" (OuterVolumeSpecName: "bundle") pod "53ee66c0-887d-48c1-81b8-b007b5bbcd1e" (UID: "53ee66c0-887d-48c1-81b8-b007b5bbcd1e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:36.269286 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.269261 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-kube-api-access-6vk28" (OuterVolumeSpecName: "kube-api-access-6vk28") pod "53ee66c0-887d-48c1-81b8-b007b5bbcd1e" (UID: "53ee66c0-887d-48c1-81b8-b007b5bbcd1e"). InnerVolumeSpecName "kube-api-access-6vk28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:36.271871 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.271839 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-util" (OuterVolumeSpecName: "util") pod "53ee66c0-887d-48c1-81b8-b007b5bbcd1e" (UID: "53ee66c0-887d-48c1-81b8-b007b5bbcd1e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:36.368051 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.368015 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:36.368051 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.368044 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:36.368051 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.368054 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vk28\" (UniqueName: \"kubernetes.io/projected/53ee66c0-887d-48c1-81b8-b007b5bbcd1e-kube-api-access-6vk28\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:36.975737 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.975703 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" event={"ID":"53ee66c0-887d-48c1-81b8-b007b5bbcd1e","Type":"ContainerDied","Data":"563442cb49859663422fa2c6b51c0f1e3d22def41d09f0ec49d36c944bb289c4"} Jun 03 08:55:36.976166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.975748 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="563442cb49859663422fa2c6b51c0f1e3d22def41d09f0ec49d36c944bb289c4" Jun 03 08:55:36.976166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.975711 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp" Jun 03 08:55:36.977780 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.977754 2561 generic.go:358] "Generic (PLEG): container finished" podID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerID="719767d40762cbc9f161ed424160637b0e570cad5cebd7c6f30d0e78b123835a" exitCode=0 Jun 03 08:55:36.977889 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.977783 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" event={"ID":"e55faaf2-7418-4f44-af4d-f754ce36e4ca","Type":"ContainerDied","Data":"719767d40762cbc9f161ed424160637b0e570cad5cebd7c6f30d0e78b123835a"} Jun 03 08:55:36.979476 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.979454 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" Jun 03 08:55:36.979590 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.979478 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5" event={"ID":"c4656c86-3ee8-41a6-90b7-f2b56f58a9fc","Type":"ContainerDied","Data":"97ff1fa9862254dc2140a40186b629263668af43789118189d4eed9a2f6d7569"} Jun 03 08:55:36.979590 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:36.979501 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97ff1fa9862254dc2140a40186b629263668af43789118189d4eed9a2f6d7569" Jun 03 08:55:37.113002 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.112977 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:37.173298 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.173269 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-util\") pod \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " Jun 03 08:55:37.173474 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.173315 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpt77\" (UniqueName: \"kubernetes.io/projected/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-kube-api-access-lpt77\") pod \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " Jun 03 08:55:37.173474 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.173364 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-bundle\") pod \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\" (UID: \"8ed4ded8-6993-497b-8ac6-17c4ce1ea827\") " Jun 03 08:55:37.174187 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.174157 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-bundle" (OuterVolumeSpecName: "bundle") pod "8ed4ded8-6993-497b-8ac6-17c4ce1ea827" (UID: "8ed4ded8-6993-497b-8ac6-17c4ce1ea827"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:37.175663 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.175641 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-kube-api-access-lpt77" (OuterVolumeSpecName: "kube-api-access-lpt77") pod "8ed4ded8-6993-497b-8ac6-17c4ce1ea827" (UID: "8ed4ded8-6993-497b-8ac6-17c4ce1ea827"). InnerVolumeSpecName "kube-api-access-lpt77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:37.179308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.179285 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-util" (OuterVolumeSpecName: "util") pod "8ed4ded8-6993-497b-8ac6-17c4ce1ea827" (UID: "8ed4ded8-6993-497b-8ac6-17c4ce1ea827"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:37.274633 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.274548 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:37.274633 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.274577 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpt77\" (UniqueName: \"kubernetes.io/projected/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-kube-api-access-lpt77\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:37.274633 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.274587 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ed4ded8-6993-497b-8ac6-17c4ce1ea827-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:37.983785 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.983760 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" Jun 03 08:55:37.984147 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.983753 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl" event={"ID":"8ed4ded8-6993-497b-8ac6-17c4ce1ea827","Type":"ContainerDied","Data":"7812a49998f1b37dad27f7e43c59d22f86e28041a195bf60e9ca2c26ad38e9ca"} Jun 03 08:55:37.984147 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:37.983899 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7812a49998f1b37dad27f7e43c59d22f86e28041a195bf60e9ca2c26ad38e9ca" Jun 03 08:55:38.111037 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.111014 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:38.180352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.180321 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-util\") pod \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " Jun 03 08:55:38.180352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.180365 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-bundle\") pod \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " Jun 03 08:55:38.180617 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.180519 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wxms\" (UniqueName: \"kubernetes.io/projected/e55faaf2-7418-4f44-af4d-f754ce36e4ca-kube-api-access-9wxms\") pod \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\" (UID: \"e55faaf2-7418-4f44-af4d-f754ce36e4ca\") " Jun 03 08:55:38.180961 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.180934 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-bundle" (OuterVolumeSpecName: "bundle") pod "e55faaf2-7418-4f44-af4d-f754ce36e4ca" (UID: "e55faaf2-7418-4f44-af4d-f754ce36e4ca"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:38.182674 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.182639 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55faaf2-7418-4f44-af4d-f754ce36e4ca-kube-api-access-9wxms" (OuterVolumeSpecName: "kube-api-access-9wxms") pod "e55faaf2-7418-4f44-af4d-f754ce36e4ca" (UID: "e55faaf2-7418-4f44-af4d-f754ce36e4ca"). InnerVolumeSpecName "kube-api-access-9wxms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:55:38.185886 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.185851 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-util" (OuterVolumeSpecName: "util") pod "e55faaf2-7418-4f44-af4d-f754ce36e4ca" (UID: "e55faaf2-7418-4f44-af4d-f754ce36e4ca"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:55:38.281545 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.281516 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wxms\" (UniqueName: \"kubernetes.io/projected/e55faaf2-7418-4f44-af4d-f754ce36e4ca-kube-api-access-9wxms\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:38.281545 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.281543 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:38.281721 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.281552 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e55faaf2-7418-4f44-af4d-f754ce36e4ca-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:55:38.988437 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.988401 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" event={"ID":"e55faaf2-7418-4f44-af4d-f754ce36e4ca","Type":"ContainerDied","Data":"747ea8b09c3bd3bc496c0ffde7a93af76eb49426db0f8f6f26d19b3fd15c060a"} Jun 03 08:55:38.988437 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.988435 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="747ea8b09c3bd3bc496c0ffde7a93af76eb49426db0f8f6f26d19b3fd15c060a" Jun 03 08:55:38.988842 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:38.988459 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6" Jun 03 08:55:49.991063 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991024 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr"] Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991330 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerName="extract" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991340 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerName="extract" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991352 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerName="util" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991357 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerName="util" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991367 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerName="util" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991373 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerName="util" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991394 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerName="pull" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991399 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerName="pull" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991406 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerName="pull" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991411 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerName="pull" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991420 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerName="util" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991425 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerName="util" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991430 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerName="extract" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991435 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerName="extract" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991441 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerName="extract" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991446 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerName="extract" Jun 03 08:55:49.991446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991455 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerName="extract" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991460 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerName="extract" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991468 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerName="util" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991473 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerName="util" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991480 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerName="pull" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991484 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerName="pull" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991489 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerName="pull" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991494 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerName="pull" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991541 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="53ee66c0-887d-48c1-81b8-b007b5bbcd1e" containerName="extract" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991552 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="c4656c86-3ee8-41a6-90b7-f2b56f58a9fc" containerName="extract" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991561 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="8ed4ded8-6993-497b-8ac6-17c4ce1ea827" containerName="extract" Jun 03 08:55:49.992116 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.991567 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="e55faaf2-7418-4f44-af4d-f754ce36e4ca" containerName="extract" Jun 03 08:55:49.994573 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.994557 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:49.998611 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:49.998592 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kgjv6\"" Jun 03 08:55:50.010060 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.010037 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr"] Jun 03 08:55:50.075584 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.075553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3441d764-120a-42fd-9bac-c4a4a620ab37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:50.075717 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.075593 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hftkr\" (UniqueName: \"kubernetes.io/projected/3441d764-120a-42fd-9bac-c4a4a620ab37-kube-api-access-hftkr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:50.176487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.176449 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3441d764-120a-42fd-9bac-c4a4a620ab37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:50.176636 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.176498 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hftkr\" (UniqueName: \"kubernetes.io/projected/3441d764-120a-42fd-9bac-c4a4a620ab37-kube-api-access-hftkr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:50.176898 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.176876 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3441d764-120a-42fd-9bac-c4a4a620ab37-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:50.188860 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.188829 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hftkr\" (UniqueName: \"kubernetes.io/projected/3441d764-120a-42fd-9bac-c4a4a620ab37-kube-api-access-hftkr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:50.304741 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.304645 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:50.441004 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:50.440978 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr"] Jun 03 08:55:50.442514 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:50.442482 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3441d764_120a_42fd_9bac_c4a4a620ab37.slice/crio-92ab30ab8e4a5fea3716982bd663e9f2313507230240c840c25340212c55596e WatchSource:0}: Error finding container 92ab30ab8e4a5fea3716982bd663e9f2313507230240c840c25340212c55596e: Status 404 returned error can't find the container with id 92ab30ab8e4a5fea3716982bd663e9f2313507230240c840c25340212c55596e Jun 03 08:55:51.038541 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:51.038504 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" event={"ID":"3441d764-120a-42fd-9bac-c4a4a620ab37","Type":"ContainerStarted","Data":"92ab30ab8e4a5fea3716982bd663e9f2313507230240c840c25340212c55596e"} Jun 03 08:55:54.877111 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:54.876262 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw"] Jun 03 08:55:54.880810 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:54.880788 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" Jun 03 08:55:54.883978 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:54.883953 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 08:55:54.884195 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:54.884169 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s5cwj\"" Jun 03 08:55:54.891300 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:54.891260 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw"] Jun 03 08:55:54.921170 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:54.921139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq5jw\" (UniqueName: \"kubernetes.io/projected/68cdcdba-40ce-4067-91db-fc7ad81d4ef4-kube-api-access-fq5jw\") pod \"dns-operator-controller-manager-648d5c98bc-w9pjw\" (UID: \"68cdcdba-40ce-4067-91db-fc7ad81d4ef4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" Jun 03 08:55:55.022439 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:55.022370 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5jw\" (UniqueName: \"kubernetes.io/projected/68cdcdba-40ce-4067-91db-fc7ad81d4ef4-kube-api-access-fq5jw\") pod \"dns-operator-controller-manager-648d5c98bc-w9pjw\" (UID: \"68cdcdba-40ce-4067-91db-fc7ad81d4ef4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" Jun 03 08:55:55.033514 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:55.033480 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq5jw\" (UniqueName: \"kubernetes.io/projected/68cdcdba-40ce-4067-91db-fc7ad81d4ef4-kube-api-access-fq5jw\") pod \"dns-operator-controller-manager-648d5c98bc-w9pjw\" (UID: \"68cdcdba-40ce-4067-91db-fc7ad81d4ef4\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" Jun 03 08:55:55.195030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:55.194951 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" Jun 03 08:55:55.350200 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:55.350170 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw"] Jun 03 08:55:55.352245 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:55.352221 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68cdcdba_40ce_4067_91db_fc7ad81d4ef4.slice/crio-489d39a5e5fd13603a0aa29800bd383725dc7fb63fa97cf4a165ee8d701e4a1c WatchSource:0}: Error finding container 489d39a5e5fd13603a0aa29800bd383725dc7fb63fa97cf4a165ee8d701e4a1c: Status 404 returned error can't find the container with id 489d39a5e5fd13603a0aa29800bd383725dc7fb63fa97cf4a165ee8d701e4a1c Jun 03 08:55:56.063597 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:56.063553 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" event={"ID":"3441d764-120a-42fd-9bac-c4a4a620ab37","Type":"ContainerStarted","Data":"d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84"} Jun 03 08:55:56.064010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:56.063678 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:55:56.064715 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:56.064690 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" event={"ID":"68cdcdba-40ce-4067-91db-fc7ad81d4ef4","Type":"ContainerStarted","Data":"489d39a5e5fd13603a0aa29800bd383725dc7fb63fa97cf4a165ee8d701e4a1c"} Jun 03 08:55:56.091782 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:56.091738 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" podStartSLOduration=2.319239389 podStartE2EDuration="7.091725126s" podCreationTimestamp="2026-06-03 08:55:49 +0000 UTC" firstStartedPulling="2026-06-03 08:55:50.444718924 +0000 UTC m=+683.222214540" lastFinishedPulling="2026-06-03 08:55:55.217204643 +0000 UTC m=+687.994700277" observedRunningTime="2026-06-03 08:55:56.089570116 +0000 UTC m=+688.867065754" watchObservedRunningTime="2026-06-03 08:55:56.091725126 +0000 UTC m=+688.869220763" Jun 03 08:55:57.782158 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:57.782056 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl"] Jun 03 08:55:57.786779 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:57.786756 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:55:57.790358 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:57.790337 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g7s59\"" Jun 03 08:55:57.798797 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:57.798775 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl"] Jun 03 08:55:57.849203 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:57.849169 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h9mp\" (UniqueName: \"kubernetes.io/projected/b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682-kube-api-access-8h9mp\") pod \"limitador-operator-controller-manager-85c4996f8c-k7thl\" (UID: \"b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:55:57.949991 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:57.949959 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8h9mp\" (UniqueName: \"kubernetes.io/projected/b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682-kube-api-access-8h9mp\") pod \"limitador-operator-controller-manager-85c4996f8c-k7thl\" (UID: \"b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:55:57.960109 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:57.960075 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h9mp\" (UniqueName: \"kubernetes.io/projected/b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682-kube-api-access-8h9mp\") pod \"limitador-operator-controller-manager-85c4996f8c-k7thl\" (UID: \"b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:55:58.074037 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:58.073998 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" event={"ID":"68cdcdba-40ce-4067-91db-fc7ad81d4ef4","Type":"ContainerStarted","Data":"f3d2a903a8d7b8f956a7c70002864e3b4e58baaeb6a5ed081106d32a130d51ab"} Jun 03 08:55:58.074221 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:58.074049 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" Jun 03 08:55:58.095279 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:58.095219 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" podStartSLOduration=2.087953643 podStartE2EDuration="4.095202552s" podCreationTimestamp="2026-06-03 08:55:54 +0000 UTC" firstStartedPulling="2026-06-03 08:55:55.354713589 +0000 UTC m=+688.132209218" lastFinishedPulling="2026-06-03 08:55:57.361962506 +0000 UTC m=+690.139458127" observedRunningTime="2026-06-03 08:55:58.092482769 +0000 UTC m=+690.869978421" watchObservedRunningTime="2026-06-03 08:55:58.095202552 +0000 UTC m=+690.872698191" Jun 03 08:55:58.098335 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:58.098309 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:55:58.234960 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:58.234932 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl"] Jun 03 08:55:58.237270 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:55:58.237235 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b20c2b_fb7f_4d23_8ea8_dcfd93c2e682.slice/crio-6313256782af22e458829533db0ce75431cec257ccc2dd752d605e8fe5d1f00d WatchSource:0}: Error finding container 6313256782af22e458829533db0ce75431cec257ccc2dd752d605e8fe5d1f00d: Status 404 returned error can't find the container with id 6313256782af22e458829533db0ce75431cec257ccc2dd752d605e8fe5d1f00d Jun 03 08:55:59.081415 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:55:59.081351 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" event={"ID":"b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682","Type":"ContainerStarted","Data":"6313256782af22e458829533db0ce75431cec257ccc2dd752d605e8fe5d1f00d"} Jun 03 08:56:01.090457 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:01.090411 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" event={"ID":"b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682","Type":"ContainerStarted","Data":"5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616"} Jun 03 08:56:01.090840 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:01.090510 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:56:01.114684 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:01.114637 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" podStartSLOduration=2.15189876 podStartE2EDuration="4.1146236s" podCreationTimestamp="2026-06-03 08:55:57 +0000 UTC" firstStartedPulling="2026-06-03 08:55:58.239282625 +0000 UTC m=+691.016778242" lastFinishedPulling="2026-06-03 08:56:00.202007466 +0000 UTC m=+692.979503082" observedRunningTime="2026-06-03 08:56:01.111450621 +0000 UTC m=+693.888946258" watchObservedRunningTime="2026-06-03 08:56:01.1146236 +0000 UTC m=+693.892119238" Jun 03 08:56:07.071046 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:07.071014 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:56:08.883735 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:08.883647 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq"] Jun 03 08:56:08.888721 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:08.888700 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:08.898445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:08.898418 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq"] Jun 03 08:56:09.046906 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.046862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9b7x\" (UniqueName: \"kubernetes.io/projected/2c04d0f1-709e-464e-ab63-42a4be4f0b03-kube-api-access-r9b7x\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" (UID: \"2c04d0f1-709e-464e-ab63-42a4be4f0b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:09.047106 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.046977 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c04d0f1-709e-464e-ab63-42a4be4f0b03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" (UID: \"2c04d0f1-709e-464e-ab63-42a4be4f0b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:09.048055 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.048028 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq"] Jun 03 08:56:09.048279 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:56:09.048256 2561 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-r9b7x], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" podUID="2c04d0f1-709e-464e-ab63-42a4be4f0b03" Jun 03 08:56:09.053971 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.053946 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq"] Jun 03 08:56:09.066032 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.065995 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr"] Jun 03 08:56:09.066906 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.066869 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" podUID="3441d764-120a-42fd-9bac-c4a4a620ab37" containerName="manager" containerID="cri-o://d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84" gracePeriod=2 Jun 03 08:56:09.069306 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.069285 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c"] Jun 03 08:56:09.073214 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.073199 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.080232 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.080210 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr"] Jun 03 08:56:09.084103 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.084083 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-w9pjw" Jun 03 08:56:09.085237 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.085212 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c"] Jun 03 08:56:09.091726 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.091705 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d"] Jun 03 08:56:09.092025 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.092014 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3441d764-120a-42fd-9bac-c4a4a620ab37" containerName="manager" Jun 03 08:56:09.092063 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.092027 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3441d764-120a-42fd-9bac-c4a4a620ab37" containerName="manager" Jun 03 08:56:09.092118 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.092108 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="3441d764-120a-42fd-9bac-c4a4a620ab37" containerName="manager" Jun 03 08:56:09.095240 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.095224 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.098283 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.098262 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl"] Jun 03 08:56:09.098549 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.098526 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" containerName="manager" containerID="cri-o://5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616" gracePeriod=2 Jun 03 08:56:09.100345 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.100326 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:56:09.106548 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.106527 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl"] Jun 03 08:56:09.112864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.112827 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d"] Jun 03 08:56:09.121539 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.121518 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:09.148100 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.148020 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c04d0f1-709e-464e-ab63-42a4be4f0b03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" (UID: \"2c04d0f1-709e-464e-ab63-42a4be4f0b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:09.148100 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.148076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klpxr\" (UniqueName: \"kubernetes.io/projected/80824cc5-1940-4405-92cf-26eb7553be33-kube-api-access-klpxr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zqc9c\" (UID: \"80824cc5-1940-4405-92cf-26eb7553be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.148494 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.148117 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9b7x\" (UniqueName: \"kubernetes.io/projected/2c04d0f1-709e-464e-ab63-42a4be4f0b03-kube-api-access-r9b7x\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" (UID: \"2c04d0f1-709e-464e-ab63-42a4be4f0b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:09.148494 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.148207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80824cc5-1940-4405-92cf-26eb7553be33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zqc9c\" (UID: \"80824cc5-1940-4405-92cf-26eb7553be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.149151 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.149062 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c04d0f1-709e-464e-ab63-42a4be4f0b03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" (UID: \"2c04d0f1-709e-464e-ab63-42a4be4f0b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:09.153418 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.153391 2561 status_manager.go:895] "Failed to get status for pod" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" err="pods \"limitador-operator-controller-manager-85c4996f8c-k7thl\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.155610 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:56:09.155591 2561 projected.go:194] Error preparing data for projected volume kube-api-access-r9b7x for pod kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq: failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-wf4gq" not found Jun 03 08:56:09.155711 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:56:09.155664 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2c04d0f1-709e-464e-ab63-42a4be4f0b03-kube-api-access-r9b7x podName:2c04d0f1-709e-464e-ab63-42a4be4f0b03 nodeName:}" failed. No retries permitted until 2026-06-03 08:56:09.655642914 +0000 UTC m=+702.433138544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r9b7x" (UniqueName: "kubernetes.io/projected/2c04d0f1-709e-464e-ab63-42a4be4f0b03-kube-api-access-r9b7x") pod "kuadrant-operator-controller-manager-55c7f4c975-wf4gq" (UID: "2c04d0f1-709e-464e-ab63-42a4be4f0b03") : failed to fetch token: pod "kuadrant-operator-controller-manager-55c7f4c975-wf4gq" not found Jun 03 08:56:09.180878 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.180845 2561 status_manager.go:895] "Failed to get status for pod" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" err="pods \"limitador-operator-controller-manager-85c4996f8c-k7thl\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.183297 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.183271 2561 status_manager.go:895] "Failed to get status for pod" podUID="2c04d0f1-709e-464e-ab63-42a4be4f0b03" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.214904 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.214881 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:09.219598 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.219562 2561 status_manager.go:895] "Failed to get status for pod" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" err="pods \"limitador-operator-controller-manager-85c4996f8c-k7thl\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.222333 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.222303 2561 status_manager.go:895] "Failed to get status for pod" podUID="2c04d0f1-709e-464e-ab63-42a4be4f0b03" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.248835 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.248788 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klpxr\" (UniqueName: \"kubernetes.io/projected/80824cc5-1940-4405-92cf-26eb7553be33-kube-api-access-klpxr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zqc9c\" (UID: \"80824cc5-1940-4405-92cf-26eb7553be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.249010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.248867 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80824cc5-1940-4405-92cf-26eb7553be33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zqc9c\" (UID: \"80824cc5-1940-4405-92cf-26eb7553be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.249010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.248929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjsnb\" (UniqueName: \"kubernetes.io/projected/3f02b708-308d-4dc7-99a9-29b7c888367f-kube-api-access-bjsnb\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ms78d\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.249010 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.248975 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f02b708-308d-4dc7-99a9-29b7c888367f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ms78d\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.249485 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.249459 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/80824cc5-1940-4405-92cf-26eb7553be33-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zqc9c\" (UID: \"80824cc5-1940-4405-92cf-26eb7553be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.258882 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.258858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klpxr\" (UniqueName: \"kubernetes.io/projected/80824cc5-1940-4405-92cf-26eb7553be33-kube-api-access-klpxr\") pod \"kuadrant-operator-controller-manager-55c7f4c975-zqc9c\" (UID: \"80824cc5-1940-4405-92cf-26eb7553be33\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.333798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.333774 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:56:09.336831 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.336802 2561 status_manager.go:895] "Failed to get status for pod" podUID="3441d764-120a-42fd-9bac-c4a4a620ab37" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.339219 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.339195 2561 status_manager.go:895] "Failed to get status for pod" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" err="pods \"limitador-operator-controller-manager-85c4996f8c-k7thl\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.341495 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.341472 2561 status_manager.go:895] "Failed to get status for pod" podUID="2c04d0f1-709e-464e-ab63-42a4be4f0b03" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.348850 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.348832 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:56:09.350058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.350039 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c04d0f1-709e-464e-ab63-42a4be4f0b03-extensions-socket-volume\") pod \"2c04d0f1-709e-464e-ab63-42a4be4f0b03\" (UID: \"2c04d0f1-709e-464e-ab63-42a4be4f0b03\") " Jun 03 08:56:09.350218 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.350202 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bjsnb\" (UniqueName: \"kubernetes.io/projected/3f02b708-308d-4dc7-99a9-29b7c888367f-kube-api-access-bjsnb\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ms78d\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.350289 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.350229 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f02b708-308d-4dc7-99a9-29b7c888367f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ms78d\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.350289 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.350261 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c04d0f1-709e-464e-ab63-42a4be4f0b03-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c04d0f1-709e-464e-ab63-42a4be4f0b03" (UID: "2c04d0f1-709e-464e-ab63-42a4be4f0b03"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:56:09.350289 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.350287 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9b7x\" (UniqueName: \"kubernetes.io/projected/2c04d0f1-709e-464e-ab63-42a4be4f0b03-kube-api-access-r9b7x\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:09.350629 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.350609 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f02b708-308d-4dc7-99a9-29b7c888367f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ms78d\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.351398 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.351354 2561 status_manager.go:895] "Failed to get status for pod" podUID="3441d764-120a-42fd-9bac-c4a4a620ab37" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-mrfnr\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.354153 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.354129 2561 status_manager.go:895] "Failed to get status for pod" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" err="pods \"limitador-operator-controller-manager-85c4996f8c-k7thl\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.356482 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.356459 2561 status_manager.go:895] "Failed to get status for pod" podUID="2c04d0f1-709e-464e-ab63-42a4be4f0b03" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:09.364998 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.364981 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjsnb\" (UniqueName: \"kubernetes.io/projected/3f02b708-308d-4dc7-99a9-29b7c888367f-kube-api-access-bjsnb\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-ms78d\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.450860 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.450781 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h9mp\" (UniqueName: \"kubernetes.io/projected/b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682-kube-api-access-8h9mp\") pod \"b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682\" (UID: \"b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682\") " Jun 03 08:56:09.450860 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.450824 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3441d764-120a-42fd-9bac-c4a4a620ab37-extensions-socket-volume\") pod \"3441d764-120a-42fd-9bac-c4a4a620ab37\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " Jun 03 08:56:09.450860 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.450841 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hftkr\" (UniqueName: \"kubernetes.io/projected/3441d764-120a-42fd-9bac-c4a4a620ab37-kube-api-access-hftkr\") pod \"3441d764-120a-42fd-9bac-c4a4a620ab37\" (UID: \"3441d764-120a-42fd-9bac-c4a4a620ab37\") " Jun 03 08:56:09.451129 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.451034 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c04d0f1-709e-464e-ab63-42a4be4f0b03-extensions-socket-volume\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:09.451327 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.451303 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3441d764-120a-42fd-9bac-c4a4a620ab37-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3441d764-120a-42fd-9bac-c4a4a620ab37" (UID: "3441d764-120a-42fd-9bac-c4a4a620ab37"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:56:09.452957 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.452935 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3441d764-120a-42fd-9bac-c4a4a620ab37-kube-api-access-hftkr" (OuterVolumeSpecName: "kube-api-access-hftkr") pod "3441d764-120a-42fd-9bac-c4a4a620ab37" (UID: "3441d764-120a-42fd-9bac-c4a4a620ab37"). InnerVolumeSpecName "kube-api-access-hftkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:56:09.452957 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.452950 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682-kube-api-access-8h9mp" (OuterVolumeSpecName: "kube-api-access-8h9mp") pod "b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" (UID: "b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682"). InnerVolumeSpecName "kube-api-access-8h9mp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:56:09.506299 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.506270 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:09.515047 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.515019 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:09.552340 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.552248 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h9mp\" (UniqueName: \"kubernetes.io/projected/b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682-kube-api-access-8h9mp\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:09.552340 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.552292 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3441d764-120a-42fd-9bac-c4a4a620ab37-extensions-socket-volume\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:09.552340 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.552312 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hftkr\" (UniqueName: \"kubernetes.io/projected/3441d764-120a-42fd-9bac-c4a4a620ab37-kube-api-access-hftkr\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:09.668035 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.668006 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c"] Jun 03 08:56:09.669736 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:56:09.669706 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80824cc5_1940_4405_92cf_26eb7553be33.slice/crio-bc6674835577b94a53664806e411b367c064d14ff15ad3aa4c03c4c4265ce7fe WatchSource:0}: Error finding container bc6674835577b94a53664806e411b367c064d14ff15ad3aa4c03c4c4265ce7fe: Status 404 returned error can't find the container with id bc6674835577b94a53664806e411b367c064d14ff15ad3aa4c03c4c4265ce7fe Jun 03 08:56:09.678871 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.678848 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d"] Jun 03 08:56:09.680050 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:56:09.680031 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f02b708_308d_4dc7_99a9_29b7c888367f.slice/crio-77d2a127cc0a3b74067e4c7a11f8a59fb105c77d3a0def8103bc5e70f1a22585 WatchSource:0}: Error finding container 77d2a127cc0a3b74067e4c7a11f8a59fb105c77d3a0def8103bc5e70f1a22585: Status 404 returned error can't find the container with id 77d2a127cc0a3b74067e4c7a11f8a59fb105c77d3a0def8103bc5e70f1a22585 Jun 03 08:56:09.837861 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.837828 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c04d0f1-709e-464e-ab63-42a4be4f0b03" path="/var/lib/kubelet/pods/2c04d0f1-709e-464e-ab63-42a4be4f0b03/volumes" Jun 03 08:56:09.838168 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.838152 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3441d764-120a-42fd-9bac-c4a4a620ab37" path="/var/lib/kubelet/pods/3441d764-120a-42fd-9bac-c4a4a620ab37/volumes" Jun 03 08:56:09.838566 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:09.838547 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" path="/var/lib/kubelet/pods/b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682/volumes" Jun 03 08:56:10.132933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.132890 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" event={"ID":"80824cc5-1940-4405-92cf-26eb7553be33","Type":"ContainerStarted","Data":"8bb9b5259cf4d199f386ff6457ae47bffceef3b6af3c788dc9a5af059c1e0562"} Jun 03 08:56:10.132933 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.132933 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" event={"ID":"80824cc5-1940-4405-92cf-26eb7553be33","Type":"ContainerStarted","Data":"bc6674835577b94a53664806e411b367c064d14ff15ad3aa4c03c4c4265ce7fe"} Jun 03 08:56:10.133436 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.133017 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:10.134146 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.134114 2561 generic.go:358] "Generic (PLEG): container finished" podID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" containerID="5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616" exitCode=0 Jun 03 08:56:10.134246 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.134192 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-k7thl" Jun 03 08:56:10.134246 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.134222 2561 scope.go:117] "RemoveContainer" containerID="5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616" Jun 03 08:56:10.135651 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.135629 2561 generic.go:358] "Generic (PLEG): container finished" podID="3441d764-120a-42fd-9bac-c4a4a620ab37" containerID="d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84" exitCode=0 Jun 03 08:56:10.135737 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.135688 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-mrfnr" Jun 03 08:56:10.137489 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.137465 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" event={"ID":"3f02b708-308d-4dc7-99a9-29b7c888367f","Type":"ContainerStarted","Data":"f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad"} Jun 03 08:56:10.137601 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.137497 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" event={"ID":"3f02b708-308d-4dc7-99a9-29b7c888367f","Type":"ContainerStarted","Data":"77d2a127cc0a3b74067e4c7a11f8a59fb105c77d3a0def8103bc5e70f1a22585"} Jun 03 08:56:10.137601 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.137563 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" Jun 03 08:56:10.144421 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.144400 2561 scope.go:117] "RemoveContainer" containerID="5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616" Jun 03 08:56:10.144665 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:56:10.144648 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616\": container with ID starting with 5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616 not found: ID does not exist" containerID="5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616" Jun 03 08:56:10.144730 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.144671 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616"} err="failed to get container status \"5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616\": rpc error: code = NotFound desc = could not find container \"5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616\": container with ID starting with 5ebc4defeafcb55448a025638c7deed92e4c7de59edd4ce8ecf3a35cca3de616 not found: ID does not exist" Jun 03 08:56:10.144730 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.144686 2561 scope.go:117] "RemoveContainer" containerID="d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84" Jun 03 08:56:10.154858 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.154842 2561 scope.go:117] "RemoveContainer" containerID="d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84" Jun 03 08:56:10.155128 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:56:10.155111 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84\": container with ID starting with d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84 not found: ID does not exist" containerID="d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84" Jun 03 08:56:10.155177 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.155135 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84"} err="failed to get container status \"d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84\": rpc error: code = NotFound desc = could not find container \"d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84\": container with ID starting with d1bfed69d476641f8c7af56d036a1162d48f0d06aa97de3f51e02b46475d2b84 not found: ID does not exist" Jun 03 08:56:10.159711 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.159670 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" podStartSLOduration=1.159658027 podStartE2EDuration="1.159658027s" podCreationTimestamp="2026-06-03 08:56:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:56:10.156703076 +0000 UTC m=+702.934198727" watchObservedRunningTime="2026-06-03 08:56:10.159658027 +0000 UTC m=+702.937153666" Jun 03 08:56:10.178800 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.178760 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" podStartSLOduration=1.178747541 podStartE2EDuration="1.178747541s" podCreationTimestamp="2026-06-03 08:56:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:56:10.176798748 +0000 UTC m=+702.954294387" watchObservedRunningTime="2026-06-03 08:56:10.178747541 +0000 UTC m=+702.956243198" Jun 03 08:56:10.179747 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:10.179724 2561 status_manager.go:895] "Failed to get status for pod" podUID="2c04d0f1-709e-464e-ab63-42a4be4f0b03" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-wf4gq" err="pods \"kuadrant-operator-controller-manager-55c7f4c975-wf4gq\" is forbidden: User \"system:node:ip-10-0-138-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-22.ec2.internal' and this object" Jun 03 08:56:11.143601 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:11.143576 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:21.146441 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.146407 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-zqc9c" Jun 03 08:56:21.232257 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.232225 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d"] Jun 03 08:56:21.232509 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.232486 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" podUID="3f02b708-308d-4dc7-99a9-29b7c888367f" containerName="manager" containerID="cri-o://f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad" gracePeriod=10 Jun 03 08:56:21.234283 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.234257 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:21.478246 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.478218 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:21.656478 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.656400 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjsnb\" (UniqueName: \"kubernetes.io/projected/3f02b708-308d-4dc7-99a9-29b7c888367f-kube-api-access-bjsnb\") pod \"3f02b708-308d-4dc7-99a9-29b7c888367f\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " Jun 03 08:56:21.656613 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.656480 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f02b708-308d-4dc7-99a9-29b7c888367f-extensions-socket-volume\") pod \"3f02b708-308d-4dc7-99a9-29b7c888367f\" (UID: \"3f02b708-308d-4dc7-99a9-29b7c888367f\") " Jun 03 08:56:21.656849 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.656819 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f02b708-308d-4dc7-99a9-29b7c888367f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f02b708-308d-4dc7-99a9-29b7c888367f" (UID: "3f02b708-308d-4dc7-99a9-29b7c888367f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:56:21.658467 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.658448 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f02b708-308d-4dc7-99a9-29b7c888367f-kube-api-access-bjsnb" (OuterVolumeSpecName: "kube-api-access-bjsnb") pod "3f02b708-308d-4dc7-99a9-29b7c888367f" (UID: "3f02b708-308d-4dc7-99a9-29b7c888367f"). InnerVolumeSpecName "kube-api-access-bjsnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:56:21.757595 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.757564 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjsnb\" (UniqueName: \"kubernetes.io/projected/3f02b708-308d-4dc7-99a9-29b7c888367f-kube-api-access-bjsnb\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:21.757595 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:21.757590 2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f02b708-308d-4dc7-99a9-29b7c888367f-extensions-socket-volume\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:22.187612 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.187577 2561 generic.go:358] "Generic (PLEG): container finished" podID="3f02b708-308d-4dc7-99a9-29b7c888367f" containerID="f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad" exitCode=0 Jun 03 08:56:22.188034 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.187639 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" Jun 03 08:56:22.188034 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.187665 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" event={"ID":"3f02b708-308d-4dc7-99a9-29b7c888367f","Type":"ContainerDied","Data":"f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad"} Jun 03 08:56:22.188034 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.187707 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d" event={"ID":"3f02b708-308d-4dc7-99a9-29b7c888367f","Type":"ContainerDied","Data":"77d2a127cc0a3b74067e4c7a11f8a59fb105c77d3a0def8103bc5e70f1a22585"} Jun 03 08:56:22.188034 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.187725 2561 scope.go:117] "RemoveContainer" containerID="f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad" Jun 03 08:56:22.196266 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.196250 2561 scope.go:117] "RemoveContainer" containerID="f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad" Jun 03 08:56:22.196524 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:56:22.196504 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad\": container with ID starting with f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad not found: ID does not exist" containerID="f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad" Jun 03 08:56:22.196580 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.196534 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad"} err="failed to get container status \"f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad\": rpc error: code = NotFound desc = could not find container \"f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad\": container with ID starting with f075fcb23152bbf221c593adc422e531fa20d10284b036d345ccb7ed7e95cfad not found: ID does not exist" Jun 03 08:56:22.227064 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.227042 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d"] Jun 03 08:56:22.231422 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:22.231399 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-ms78d"] Jun 03 08:56:23.837932 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:23.837898 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f02b708-308d-4dc7-99a9-29b7c888367f" path="/var/lib/kubelet/pods/3f02b708-308d-4dc7-99a9-29b7c888367f/volumes" Jun 03 08:56:37.600419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.600370 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5"] Jun 03 08:56:37.600987 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.600929 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f02b708-308d-4dc7-99a9-29b7c888367f" containerName="manager" Jun 03 08:56:37.600987 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.600951 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f02b708-308d-4dc7-99a9-29b7c888367f" containerName="manager" Jun 03 08:56:37.600987 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.600967 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" containerName="manager" Jun 03 08:56:37.600987 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.600975 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" containerName="manager" Jun 03 08:56:37.601192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.601077 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="b8b20c2b-fb7f-4d23-8ea8-dcfd93c2e682" containerName="manager" Jun 03 08:56:37.601192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.601091 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="3f02b708-308d-4dc7-99a9-29b7c888367f" containerName="manager" Jun 03 08:56:37.607495 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.607467 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.610548 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.610524 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 08:56:37.610664 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.610603 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 08:56:37.610727 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.610706 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-67v46\"" Jun 03 08:56:37.610809 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.610794 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 08:56:37.617664 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.617214 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5"] Jun 03 08:56:37.683897 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.683858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684069 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.683928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684069 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.683957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684069 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.683983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684205 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.684063 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684205 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.684105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684205 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.684132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684205 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.684192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.684348 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.684219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7w5l\" (UniqueName: \"kubernetes.io/projected/241f365a-c5e3-4c34-a1e8-f6683fcd270b-kube-api-access-j7w5l\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785393 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785350 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785591 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785427 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785591 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785457 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785591 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785485 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785591 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785520 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785591 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785553 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785935 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785611 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785935 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785656 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7w5l\" (UniqueName: \"kubernetes.io/projected/241f365a-c5e3-4c34-a1e8-f6683fcd270b-kube-api-access-j7w5l\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.785935 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785694 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.786101 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.786101 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.785987 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.786101 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.786042 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.786101 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.786080 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.786649 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.786627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.787943 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.787910 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.788134 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.788115 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.798635 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.798610 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/241f365a-c5e3-4c34-a1e8-f6683fcd270b-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.798726 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.798619 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7w5l\" (UniqueName: \"kubernetes.io/projected/241f365a-c5e3-4c34-a1e8-f6683fcd270b-kube-api-access-j7w5l\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-vsgz5\" (UID: \"241f365a-c5e3-4c34-a1e8-f6683fcd270b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:37.921108 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:37.921016 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:38.061654 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.060422 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5"] Jun 03 08:56:38.065797 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:56:38.065765 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241f365a_c5e3_4c34_a1e8_f6683fcd270b.slice/crio-95d45ae7456561e5cf6eb56f0e3545446f73d47687132fdaa7847c49f4c583bb WatchSource:0}: Error finding container 95d45ae7456561e5cf6eb56f0e3545446f73d47687132fdaa7847c49f4c583bb: Status 404 returned error can't find the container with id 95d45ae7456561e5cf6eb56f0e3545446f73d47687132fdaa7847c49f4c583bb Jun 03 08:56:38.067982 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.067954 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 08:56:38.068053 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.068032 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 08:56:38.068091 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.068058 2561 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 03 08:56:38.251692 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.251596 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" event={"ID":"241f365a-c5e3-4c34-a1e8-f6683fcd270b","Type":"ContainerStarted","Data":"41fee4a3e94ca8aa56dc9ec8c6296ad792e624779de76b95e073db8b02d7aa00"} Jun 03 08:56:38.251692 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.251638 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" event={"ID":"241f365a-c5e3-4c34-a1e8-f6683fcd270b","Type":"ContainerStarted","Data":"95d45ae7456561e5cf6eb56f0e3545446f73d47687132fdaa7847c49f4c583bb"} Jun 03 08:56:38.275910 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.275845 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" podStartSLOduration=1.275826505 podStartE2EDuration="1.275826505s" podCreationTimestamp="2026-06-03 08:56:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:56:38.27027552 +0000 UTC m=+731.047771149" watchObservedRunningTime="2026-06-03 08:56:38.275826505 +0000 UTC m=+731.053322145" Jun 03 08:56:38.921661 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:38.921612 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:39.926299 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:39.926269 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:40.259157 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:40.259065 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:40.259938 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:40.259918 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-vsgz5" Jun 03 08:56:42.481695 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.481662 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rjpq9"] Jun 03 08:56:42.485108 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.485091 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.487841 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.487819 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 08:56:42.487841 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.487837 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xhjth\"" Jun 03 08:56:42.493549 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.493527 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rjpq9"] Jun 03 08:56:42.530447 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.530415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feed2c69-6b21-417b-a41e-3c39a79373f7-config-file\") pod \"limitador-limitador-7d549b5b-rjpq9\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.530602 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.530462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnd72\" (UniqueName: \"kubernetes.io/projected/feed2c69-6b21-417b-a41e-3c39a79373f7-kube-api-access-qnd72\") pod \"limitador-limitador-7d549b5b-rjpq9\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.577270 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.577230 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rjpq9"] Jun 03 08:56:42.631136 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.631107 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feed2c69-6b21-417b-a41e-3c39a79373f7-config-file\") pod \"limitador-limitador-7d549b5b-rjpq9\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.631299 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.631150 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qnd72\" (UniqueName: \"kubernetes.io/projected/feed2c69-6b21-417b-a41e-3c39a79373f7-kube-api-access-qnd72\") pod \"limitador-limitador-7d549b5b-rjpq9\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.631805 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.631785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feed2c69-6b21-417b-a41e-3c39a79373f7-config-file\") pod \"limitador-limitador-7d549b5b-rjpq9\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.641206 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.641186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnd72\" (UniqueName: \"kubernetes.io/projected/feed2c69-6b21-417b-a41e-3c39a79373f7-kube-api-access-qnd72\") pod \"limitador-limitador-7d549b5b-rjpq9\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.797352 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.797259 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:42.934693 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:42.934661 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rjpq9"] Jun 03 08:56:42.935447 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:56:42.935422 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeed2c69_6b21_417b_a41e_3c39a79373f7.slice/crio-eed0e9cd4a3001dc93560bc9d6f6e673b39aded0dd73ff16c3f7512d4346b740 WatchSource:0}: Error finding container eed0e9cd4a3001dc93560bc9d6f6e673b39aded0dd73ff16c3f7512d4346b740: Status 404 returned error can't find the container with id eed0e9cd4a3001dc93560bc9d6f6e673b39aded0dd73ff16c3f7512d4346b740 Jun 03 08:56:43.271445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.271410 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" event={"ID":"feed2c69-6b21-417b-a41e-3c39a79373f7","Type":"ContainerStarted","Data":"eed0e9cd4a3001dc93560bc9d6f6e673b39aded0dd73ff16c3f7512d4346b740"} Jun 03 08:56:43.359291 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.359255 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xfzvb"] Jun 03 08:56:43.364601 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.364577 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" Jun 03 08:56:43.369282 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.369260 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wspbs\"" Jun 03 08:56:43.372221 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.372198 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xfzvb"] Jun 03 08:56:43.439779 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.439751 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n82t6\" (UniqueName: \"kubernetes.io/projected/ba033668-e226-4916-a5d7-801b83f95a7b-kube-api-access-n82t6\") pod \"authorino-f99f4b5cd-xfzvb\" (UID: \"ba033668-e226-4916-a5d7-801b83f95a7b\") " pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" Jun 03 08:56:43.540744 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.540662 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n82t6\" (UniqueName: \"kubernetes.io/projected/ba033668-e226-4916-a5d7-801b83f95a7b-kube-api-access-n82t6\") pod \"authorino-f99f4b5cd-xfzvb\" (UID: \"ba033668-e226-4916-a5d7-801b83f95a7b\") " pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" Jun 03 08:56:43.550277 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.550186 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n82t6\" (UniqueName: \"kubernetes.io/projected/ba033668-e226-4916-a5d7-801b83f95a7b-kube-api-access-n82t6\") pod \"authorino-f99f4b5cd-xfzvb\" (UID: \"ba033668-e226-4916-a5d7-801b83f95a7b\") " pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" Jun 03 08:56:43.675646 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.675613 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" Jun 03 08:56:43.854887 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:43.854857 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xfzvb"] Jun 03 08:56:43.856493 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:56:43.856465 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba033668_e226_4916_a5d7_801b83f95a7b.slice/crio-457c1ce14a50e9d7d061b4cd3bdee5935abc908a68444cf4d8c8cf7c0ff4bdf0 WatchSource:0}: Error finding container 457c1ce14a50e9d7d061b4cd3bdee5935abc908a68444cf4d8c8cf7c0ff4bdf0: Status 404 returned error can't find the container with id 457c1ce14a50e9d7d061b4cd3bdee5935abc908a68444cf4d8c8cf7c0ff4bdf0 Jun 03 08:56:44.277819 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:44.277765 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" event={"ID":"ba033668-e226-4916-a5d7-801b83f95a7b","Type":"ContainerStarted","Data":"457c1ce14a50e9d7d061b4cd3bdee5935abc908a68444cf4d8c8cf7c0ff4bdf0"} Jun 03 08:56:48.297848 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:48.297812 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" event={"ID":"feed2c69-6b21-417b-a41e-3c39a79373f7","Type":"ContainerStarted","Data":"b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6"} Jun 03 08:56:48.298316 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:48.297890 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:56:48.299314 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:48.299281 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" event={"ID":"ba033668-e226-4916-a5d7-801b83f95a7b","Type":"ContainerStarted","Data":"ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1"} Jun 03 08:56:48.317147 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:48.317102 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" podStartSLOduration=1.772001426 podStartE2EDuration="6.317088963s" podCreationTimestamp="2026-06-03 08:56:42 +0000 UTC" firstStartedPulling="2026-06-03 08:56:42.937245011 +0000 UTC m=+735.714740628" lastFinishedPulling="2026-06-03 08:56:47.482332547 +0000 UTC m=+740.259828165" observedRunningTime="2026-06-03 08:56:48.315406039 +0000 UTC m=+741.092901668" watchObservedRunningTime="2026-06-03 08:56:48.317088963 +0000 UTC m=+741.094584600" Jun 03 08:56:48.331218 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:48.331174 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" podStartSLOduration=1.6479800020000002 podStartE2EDuration="5.331164792s" podCreationTimestamp="2026-06-03 08:56:43 +0000 UTC" firstStartedPulling="2026-06-03 08:56:43.858127041 +0000 UTC m=+736.635622656" lastFinishedPulling="2026-06-03 08:56:47.541311831 +0000 UTC m=+740.318807446" observedRunningTime="2026-06-03 08:56:48.329439762 +0000 UTC m=+741.106935401" watchObservedRunningTime="2026-06-03 08:56:48.331164792 +0000 UTC m=+741.108660437" Jun 03 08:56:50.615518 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:50.615472 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xfzvb"] Jun 03 08:56:50.615967 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:50.615721 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" podUID="ba033668-e226-4916-a5d7-801b83f95a7b" containerName="authorino" containerID="cri-o://ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1" gracePeriod=30 Jun 03 08:56:50.858059 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:50.858034 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" Jun 03 08:56:50.911141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:50.911067 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n82t6\" (UniqueName: \"kubernetes.io/projected/ba033668-e226-4916-a5d7-801b83f95a7b-kube-api-access-n82t6\") pod \"ba033668-e226-4916-a5d7-801b83f95a7b\" (UID: \"ba033668-e226-4916-a5d7-801b83f95a7b\") " Jun 03 08:56:50.913279 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:50.913249 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba033668-e226-4916-a5d7-801b83f95a7b-kube-api-access-n82t6" (OuterVolumeSpecName: "kube-api-access-n82t6") pod "ba033668-e226-4916-a5d7-801b83f95a7b" (UID: "ba033668-e226-4916-a5d7-801b83f95a7b"). InnerVolumeSpecName "kube-api-access-n82t6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:56:51.012507 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.012477 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n82t6\" (UniqueName: \"kubernetes.io/projected/ba033668-e226-4916-a5d7-801b83f95a7b-kube-api-access-n82t6\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:56:51.312052 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.312015 2561 generic.go:358] "Generic (PLEG): container finished" podID="ba033668-e226-4916-a5d7-801b83f95a7b" containerID="ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1" exitCode=0 Jun 03 08:56:51.312224 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.312064 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" Jun 03 08:56:51.312224 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.312098 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" event={"ID":"ba033668-e226-4916-a5d7-801b83f95a7b","Type":"ContainerDied","Data":"ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1"} Jun 03 08:56:51.312224 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.312138 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xfzvb" event={"ID":"ba033668-e226-4916-a5d7-801b83f95a7b","Type":"ContainerDied","Data":"457c1ce14a50e9d7d061b4cd3bdee5935abc908a68444cf4d8c8cf7c0ff4bdf0"} Jun 03 08:56:51.312224 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.312154 2561 scope.go:117] "RemoveContainer" containerID="ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1" Jun 03 08:56:51.321414 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.321372 2561 scope.go:117] "RemoveContainer" containerID="ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1" Jun 03 08:56:51.321664 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:56:51.321645 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1\": container with ID starting with ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1 not found: ID does not exist" containerID="ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1" Jun 03 08:56:51.321744 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.321674 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1"} err="failed to get container status \"ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1\": rpc error: code = NotFound desc = could not find container \"ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1\": container with ID starting with ccbc53a109cd03ee2b1049811b2da815241a29d119899e1aab17d30f6c28cab1 not found: ID does not exist" Jun 03 08:56:51.333947 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.333928 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xfzvb"] Jun 03 08:56:51.338551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.338532 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xfzvb"] Jun 03 08:56:51.837451 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:51.837410 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba033668-e226-4916-a5d7-801b83f95a7b" path="/var/lib/kubelet/pods/ba033668-e226-4916-a5d7-801b83f95a7b/volumes" Jun 03 08:56:59.305018 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:56:59.304983 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:57:01.602301 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:01.602263 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rjpq9"] Jun 03 08:57:01.602734 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:01.602480 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" podUID="feed2c69-6b21-417b-a41e-3c39a79373f7" containerName="limitador" containerID="cri-o://b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6" gracePeriod=30 Jun 03 08:57:02.142419 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.142395 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:57:02.212262 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.212182 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qnd72\" (UniqueName: \"kubernetes.io/projected/feed2c69-6b21-417b-a41e-3c39a79373f7-kube-api-access-qnd72\") pod \"feed2c69-6b21-417b-a41e-3c39a79373f7\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " Jun 03 08:57:02.212262 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.212236 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feed2c69-6b21-417b-a41e-3c39a79373f7-config-file\") pod \"feed2c69-6b21-417b-a41e-3c39a79373f7\" (UID: \"feed2c69-6b21-417b-a41e-3c39a79373f7\") " Jun 03 08:57:02.212584 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.212562 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feed2c69-6b21-417b-a41e-3c39a79373f7-config-file" (OuterVolumeSpecName: "config-file") pod "feed2c69-6b21-417b-a41e-3c39a79373f7" (UID: "feed2c69-6b21-417b-a41e-3c39a79373f7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:57:02.214436 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.214404 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feed2c69-6b21-417b-a41e-3c39a79373f7-kube-api-access-qnd72" (OuterVolumeSpecName: "kube-api-access-qnd72") pod "feed2c69-6b21-417b-a41e-3c39a79373f7" (UID: "feed2c69-6b21-417b-a41e-3c39a79373f7"). InnerVolumeSpecName "kube-api-access-qnd72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:57:02.313020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.312980 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnd72\" (UniqueName: \"kubernetes.io/projected/feed2c69-6b21-417b-a41e-3c39a79373f7-kube-api-access-qnd72\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:57:02.313020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.313017 2561 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feed2c69-6b21-417b-a41e-3c39a79373f7-config-file\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:57:02.356143 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.356109 2561 generic.go:358] "Generic (PLEG): container finished" podID="feed2c69-6b21-417b-a41e-3c39a79373f7" containerID="b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6" exitCode=0 Jun 03 08:57:02.356308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.356183 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" Jun 03 08:57:02.356308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.356202 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" event={"ID":"feed2c69-6b21-417b-a41e-3c39a79373f7","Type":"ContainerDied","Data":"b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6"} Jun 03 08:57:02.356308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.356243 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-rjpq9" event={"ID":"feed2c69-6b21-417b-a41e-3c39a79373f7","Type":"ContainerDied","Data":"eed0e9cd4a3001dc93560bc9d6f6e673b39aded0dd73ff16c3f7512d4346b740"} Jun 03 08:57:02.356308 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.356271 2561 scope.go:117] "RemoveContainer" containerID="b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6" Jun 03 08:57:02.364836 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.364819 2561 scope.go:117] "RemoveContainer" containerID="b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6" Jun 03 08:57:02.365068 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:57:02.365050 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6\": container with ID starting with b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6 not found: ID does not exist" containerID="b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6" Jun 03 08:57:02.365107 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.365076 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6"} err="failed to get container status \"b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6\": rpc error: code = NotFound desc = could not find container \"b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6\": container with ID starting with b228a260fb016712c81cc79961cf1605022eb4521d9d6f94d8100647e7c68cb6 not found: ID does not exist" Jun 03 08:57:02.380050 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.380026 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rjpq9"] Jun 03 08:57:02.385660 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:02.385638 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-rjpq9"] Jun 03 08:57:03.698172 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.698137 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wtssf"] Jun 03 08:57:03.698561 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.698545 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba033668-e226-4916-a5d7-801b83f95a7b" containerName="authorino" Jun 03 08:57:03.698624 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.698562 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba033668-e226-4916-a5d7-801b83f95a7b" containerName="authorino" Jun 03 08:57:03.698624 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.698582 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feed2c69-6b21-417b-a41e-3c39a79373f7" containerName="limitador" Jun 03 08:57:03.698624 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.698587 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="feed2c69-6b21-417b-a41e-3c39a79373f7" containerName="limitador" Jun 03 08:57:03.698716 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.698658 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba033668-e226-4916-a5d7-801b83f95a7b" containerName="authorino" Jun 03 08:57:03.698716 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.698670 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="feed2c69-6b21-417b-a41e-3c39a79373f7" containerName="limitador" Jun 03 08:57:03.703192 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.703170 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:03.706081 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.706058 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 08:57:03.714068 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.714043 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wtssf"] Jun 03 08:57:03.826822 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.826791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7efaa06d-a041-41c8-ab8b-1768fe1935a8-data\") pod \"postgres-68c4fbbd6f-wtssf\" (UID: \"7efaa06d-a041-41c8-ab8b-1768fe1935a8\") " pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:03.826975 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.826846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v9gm\" (UniqueName: \"kubernetes.io/projected/7efaa06d-a041-41c8-ab8b-1768fe1935a8-kube-api-access-2v9gm\") pod \"postgres-68c4fbbd6f-wtssf\" (UID: \"7efaa06d-a041-41c8-ab8b-1768fe1935a8\") " pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:03.837216 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.837188 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feed2c69-6b21-417b-a41e-3c39a79373f7" path="/var/lib/kubelet/pods/feed2c69-6b21-417b-a41e-3c39a79373f7/volumes" Jun 03 08:57:03.928254 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.928224 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7efaa06d-a041-41c8-ab8b-1768fe1935a8-data\") pod \"postgres-68c4fbbd6f-wtssf\" (UID: \"7efaa06d-a041-41c8-ab8b-1768fe1935a8\") " pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:03.928424 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.928276 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2v9gm\" (UniqueName: \"kubernetes.io/projected/7efaa06d-a041-41c8-ab8b-1768fe1935a8-kube-api-access-2v9gm\") pod \"postgres-68c4fbbd6f-wtssf\" (UID: \"7efaa06d-a041-41c8-ab8b-1768fe1935a8\") " pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:03.928606 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.928585 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7efaa06d-a041-41c8-ab8b-1768fe1935a8-data\") pod \"postgres-68c4fbbd6f-wtssf\" (UID: \"7efaa06d-a041-41c8-ab8b-1768fe1935a8\") " pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:03.943734 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:03.943713 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v9gm\" (UniqueName: \"kubernetes.io/projected/7efaa06d-a041-41c8-ab8b-1768fe1935a8-kube-api-access-2v9gm\") pod \"postgres-68c4fbbd6f-wtssf\" (UID: \"7efaa06d-a041-41c8-ab8b-1768fe1935a8\") " pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:04.017746 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:04.017664 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:04.163796 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:04.163772 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-wtssf"] Jun 03 08:57:04.165230 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:57:04.165205 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7efaa06d_a041_41c8_ab8b_1768fe1935a8.slice/crio-4a54f55e6d4a312d919edaaca44d722f938b037c43542a99743b51a5368affda WatchSource:0}: Error finding container 4a54f55e6d4a312d919edaaca44d722f938b037c43542a99743b51a5368affda: Status 404 returned error can't find the container with id 4a54f55e6d4a312d919edaaca44d722f938b037c43542a99743b51a5368affda Jun 03 08:57:04.365612 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:04.365581 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wtssf" event={"ID":"7efaa06d-a041-41c8-ab8b-1768fe1935a8","Type":"ContainerStarted","Data":"4a54f55e6d4a312d919edaaca44d722f938b037c43542a99743b51a5368affda"} Jun 03 08:57:07.380479 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:07.380435 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-wtssf" event={"ID":"7efaa06d-a041-41c8-ab8b-1768fe1935a8","Type":"ContainerStarted","Data":"e174ba9c182fe4325e8515b40dc790c02f5f7fb99449c7776fdb83bf7dbdd362"} Jun 03 08:57:07.380891 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:07.380498 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:07.402844 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:07.402790 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-wtssf" podStartSLOduration=2.022748697 podStartE2EDuration="4.402775507s" podCreationTimestamp="2026-06-03 08:57:03 +0000 UTC" firstStartedPulling="2026-06-03 08:57:04.166786516 +0000 UTC m=+756.944282131" lastFinishedPulling="2026-06-03 08:57:06.546813308 +0000 UTC m=+759.324308941" observedRunningTime="2026-06-03 08:57:07.400561783 +0000 UTC m=+760.178057424" watchObservedRunningTime="2026-06-03 08:57:07.402775507 +0000 UTC m=+760.180271144" Jun 03 08:57:13.413976 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:13.413929 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-wtssf" Jun 03 08:57:15.218200 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.218164 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf"] Jun 03 08:57:15.224991 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.224971 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.232864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.231895 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 08:57:15.232864 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.232027 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wxk8r\"" Jun 03 08:57:15.233402 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.233356 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 08:57:15.233695 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.233675 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf"] Jun 03 08:57:15.326910 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.326871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.327086 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.326925 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.327086 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.327032 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqptb\" (UniqueName: \"kubernetes.io/projected/8288bde6-0867-456a-a607-48f26270cb43-kube-api-access-fqptb\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.427622 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.427589 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fqptb\" (UniqueName: \"kubernetes.io/projected/8288bde6-0867-456a-a607-48f26270cb43-kube-api-access-fqptb\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.427794 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.427647 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.427794 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.427681 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.428017 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.428000 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.428099 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.428037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.441088 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.441061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqptb\" (UniqueName: \"kubernetes.io/projected/8288bde6-0867-456a-a607-48f26270cb43-kube-api-access-fqptb\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.535934 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.535851 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:15.687852 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:15.687814 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf"] Jun 03 08:57:15.694766 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:57:15.694737 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8288bde6_0867_456a_a607_48f26270cb43.slice/crio-e939c7bd44a97084aee200856c1acdef61aad64faa92c6ba9214fb90ed0e87a9 WatchSource:0}: Error finding container e939c7bd44a97084aee200856c1acdef61aad64faa92c6ba9214fb90ed0e87a9: Status 404 returned error can't find the container with id e939c7bd44a97084aee200856c1acdef61aad64faa92c6ba9214fb90ed0e87a9 Jun 03 08:57:16.415323 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:16.415289 2561 generic.go:358] "Generic (PLEG): container finished" podID="8288bde6-0867-456a-a607-48f26270cb43" containerID="14b0692dca7dfa3da37ec96fea670fef204034256fdf0ceab560b473f0505fe2" exitCode=0 Jun 03 08:57:16.415721 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:16.415363 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" event={"ID":"8288bde6-0867-456a-a607-48f26270cb43","Type":"ContainerDied","Data":"14b0692dca7dfa3da37ec96fea670fef204034256fdf0ceab560b473f0505fe2"} Jun 03 08:57:16.415721 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:16.415410 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" event={"ID":"8288bde6-0867-456a-a607-48f26270cb43","Type":"ContainerStarted","Data":"e939c7bd44a97084aee200856c1acdef61aad64faa92c6ba9214fb90ed0e87a9"} Jun 03 08:57:17.420669 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:17.420631 2561 generic.go:358] "Generic (PLEG): container finished" podID="8288bde6-0867-456a-a607-48f26270cb43" containerID="7437a260252909895b66d6627f05debb62c3ff0b18c6a72c2bc8dc1950207728" exitCode=0 Jun 03 08:57:17.421042 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:17.420680 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" event={"ID":"8288bde6-0867-456a-a607-48f26270cb43","Type":"ContainerDied","Data":"7437a260252909895b66d6627f05debb62c3ff0b18c6a72c2bc8dc1950207728"} Jun 03 08:57:18.426058 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:18.426027 2561 generic.go:358] "Generic (PLEG): container finished" podID="8288bde6-0867-456a-a607-48f26270cb43" containerID="c7b1a4dd05a77d24722b5b128f0150ea05f0ceb7577c8419062e0bf7023ea1aa" exitCode=0 Jun 03 08:57:18.426465 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:18.426119 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" event={"ID":"8288bde6-0867-456a-a607-48f26270cb43","Type":"ContainerDied","Data":"c7b1a4dd05a77d24722b5b128f0150ea05f0ceb7577c8419062e0bf7023ea1aa"} Jun 03 08:57:19.579073 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.579046 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:19.767446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.767341 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-bundle\") pod \"8288bde6-0867-456a-a607-48f26270cb43\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " Jun 03 08:57:19.767446 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.767436 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-util\") pod \"8288bde6-0867-456a-a607-48f26270cb43\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " Jun 03 08:57:19.767639 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.767495 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqptb\" (UniqueName: \"kubernetes.io/projected/8288bde6-0867-456a-a607-48f26270cb43-kube-api-access-fqptb\") pod \"8288bde6-0867-456a-a607-48f26270cb43\" (UID: \"8288bde6-0867-456a-a607-48f26270cb43\") " Jun 03 08:57:19.767989 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.767936 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-bundle" (OuterVolumeSpecName: "bundle") pod "8288bde6-0867-456a-a607-48f26270cb43" (UID: "8288bde6-0867-456a-a607-48f26270cb43"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:57:19.769694 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.769673 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8288bde6-0867-456a-a607-48f26270cb43-kube-api-access-fqptb" (OuterVolumeSpecName: "kube-api-access-fqptb") pod "8288bde6-0867-456a-a607-48f26270cb43" (UID: "8288bde6-0867-456a-a607-48f26270cb43"). InnerVolumeSpecName "kube-api-access-fqptb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:57:19.774279 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.774254 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-util" (OuterVolumeSpecName: "util") pod "8288bde6-0867-456a-a607-48f26270cb43" (UID: "8288bde6-0867-456a-a607-48f26270cb43"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 08:57:19.868787 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.868761 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:57:19.868787 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.868791 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8288bde6-0867-456a-a607-48f26270cb43-util\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:57:19.868951 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:19.868803 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqptb\" (UniqueName: \"kubernetes.io/projected/8288bde6-0867-456a-a607-48f26270cb43-kube-api-access-fqptb\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:57:20.435799 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:20.435769 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" Jun 03 08:57:20.435972 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:20.435767 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70kpgqf" event={"ID":"8288bde6-0867-456a-a607-48f26270cb43","Type":"ContainerDied","Data":"e939c7bd44a97084aee200856c1acdef61aad64faa92c6ba9214fb90ed0e87a9"} Jun 03 08:57:20.435972 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:20.435883 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e939c7bd44a97084aee200856c1acdef61aad64faa92c6ba9214fb90ed0e87a9" Jun 03 08:57:24.279744 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.279704 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-wmk7v"] Jun 03 08:57:24.280141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.280057 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8288bde6-0867-456a-a607-48f26270cb43" containerName="util" Jun 03 08:57:24.280141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.280068 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8288bde6-0867-456a-a607-48f26270cb43" containerName="util" Jun 03 08:57:24.280141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.280076 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8288bde6-0867-456a-a607-48f26270cb43" containerName="pull" Jun 03 08:57:24.280141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.280081 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8288bde6-0867-456a-a607-48f26270cb43" containerName="pull" Jun 03 08:57:24.280141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.280099 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8288bde6-0867-456a-a607-48f26270cb43" containerName="extract" Jun 03 08:57:24.280141 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.280104 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8288bde6-0867-456a-a607-48f26270cb43" containerName="extract" Jun 03 08:57:24.280363 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.280159 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="8288bde6-0867-456a-a607-48f26270cb43" containerName="extract" Jun 03 08:57:24.285188 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.285171 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" Jun 03 08:57:24.290251 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.290231 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 08:57:24.291312 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.291297 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-lv6t7\"" Jun 03 08:57:24.291368 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.291333 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 08:57:24.303012 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.302982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44669\" (UniqueName: \"kubernetes.io/projected/37f86d4f-eef9-474a-8721-0d895b041a96-kube-api-access-44669\") pod \"keycloak-operator-7864d68cbd-wmk7v\" (UID: \"37f86d4f-eef9-474a-8721-0d895b041a96\") " pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" Jun 03 08:57:24.306582 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.306558 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-wmk7v"] Jun 03 08:57:24.404189 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.404156 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44669\" (UniqueName: \"kubernetes.io/projected/37f86d4f-eef9-474a-8721-0d895b041a96-kube-api-access-44669\") pod \"keycloak-operator-7864d68cbd-wmk7v\" (UID: \"37f86d4f-eef9-474a-8721-0d895b041a96\") " pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" Jun 03 08:57:24.424123 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.424096 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44669\" (UniqueName: \"kubernetes.io/projected/37f86d4f-eef9-474a-8721-0d895b041a96-kube-api-access-44669\") pod \"keycloak-operator-7864d68cbd-wmk7v\" (UID: \"37f86d4f-eef9-474a-8721-0d895b041a96\") " pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" Jun 03 08:57:24.594997 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.594961 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" Jun 03 08:57:24.783239 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.783178 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-wmk7v"] Jun 03 08:57:24.784914 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:57:24.784886 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f86d4f_eef9_474a_8721_0d895b041a96.slice/crio-e838ed96fb9eab2c2b5ac11b2b592248cf1ed211e94f6a264c577264904ac0b5 WatchSource:0}: Error finding container e838ed96fb9eab2c2b5ac11b2b592248cf1ed211e94f6a264c577264904ac0b5: Status 404 returned error can't find the container with id e838ed96fb9eab2c2b5ac11b2b592248cf1ed211e94f6a264c577264904ac0b5 Jun 03 08:57:24.786405 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:24.786359 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 08:57:25.458456 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:25.458417 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" event={"ID":"37f86d4f-eef9-474a-8721-0d895b041a96","Type":"ContainerStarted","Data":"e838ed96fb9eab2c2b5ac11b2b592248cf1ed211e94f6a264c577264904ac0b5"} Jun 03 08:57:30.489542 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:30.489508 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" event={"ID":"37f86d4f-eef9-474a-8721-0d895b041a96","Type":"ContainerStarted","Data":"1b60c3ce7e53d406995ee513baeb40c536946e3aff9d26140533ed49f8cfe9f6"} Jun 03 08:57:30.512289 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:30.512230 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-wmk7v" podStartSLOduration=0.964058436 podStartE2EDuration="6.512212759s" podCreationTimestamp="2026-06-03 08:57:24 +0000 UTC" firstStartedPulling="2026-06-03 08:57:24.786509526 +0000 UTC m=+777.564005145" lastFinishedPulling="2026-06-03 08:57:30.334663848 +0000 UTC m=+783.112159468" observedRunningTime="2026-06-03 08:57:30.511612588 +0000 UTC m=+783.289108225" watchObservedRunningTime="2026-06-03 08:57:30.512212759 +0000 UTC m=+783.289708398" Jun 03 08:57:39.645341 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.645249 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:57:39.649508 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.649479 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:39.653488 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.653458 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qcgwz\"" Jun 03 08:57:39.653488 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.653458 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 08:57:39.671801 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.671766 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:57:39.740847 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.740814 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ftlb\" (UniqueName: \"kubernetes.io/projected/a6a887c7-d9b7-4046-a304-5a30117c9e7f-kube-api-access-5ftlb\") pod \"maas-keycloak-0\" (UID: \"a6a887c7-d9b7-4046-a304-5a30117c9e7f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:39.841527 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.841494 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ftlb\" (UniqueName: \"kubernetes.io/projected/a6a887c7-d9b7-4046-a304-5a30117c9e7f-kube-api-access-5ftlb\") pod \"maas-keycloak-0\" (UID: \"a6a887c7-d9b7-4046-a304-5a30117c9e7f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:39.855709 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.855674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ftlb\" (UniqueName: \"kubernetes.io/projected/a6a887c7-d9b7-4046-a304-5a30117c9e7f-kube-api-access-5ftlb\") pod \"maas-keycloak-0\" (UID: \"a6a887c7-d9b7-4046-a304-5a30117c9e7f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:39.959563 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:39.959476 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:40.118559 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:40.118531 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:57:40.118982 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:57:40.118956 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a887c7_d9b7_4046_a304_5a30117c9e7f.slice/crio-0c207dfd4abf5141bbfcb96136793137ecd6028bdad87bd395a685905d85acd3 WatchSource:0}: Error finding container 0c207dfd4abf5141bbfcb96136793137ecd6028bdad87bd395a685905d85acd3: Status 404 returned error can't find the container with id 0c207dfd4abf5141bbfcb96136793137ecd6028bdad87bd395a685905d85acd3 Jun 03 08:57:40.530287 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:40.530250 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a6a887c7-d9b7-4046-a304-5a30117c9e7f","Type":"ContainerStarted","Data":"0c207dfd4abf5141bbfcb96136793137ecd6028bdad87bd395a685905d85acd3"} Jun 03 08:57:45.558791 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:45.558748 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a6a887c7-d9b7-4046-a304-5a30117c9e7f","Type":"ContainerStarted","Data":"4597a0990055c934619dd4d2693c1aa5af184114c787ae7e8a7d0692dd705426"} Jun 03 08:57:45.582261 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:45.582203 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.9387526990000001 podStartE2EDuration="6.58218682s" podCreationTimestamp="2026-06-03 08:57:39 +0000 UTC" firstStartedPulling="2026-06-03 08:57:40.12032444 +0000 UTC m=+792.897820056" lastFinishedPulling="2026-06-03 08:57:44.763758558 +0000 UTC m=+797.541254177" observedRunningTime="2026-06-03 08:57:45.580052031 +0000 UTC m=+798.357547694" watchObservedRunningTime="2026-06-03 08:57:45.58218682 +0000 UTC m=+798.359682506" Jun 03 08:57:45.960513 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:45.960418 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:45.961997 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:45.961964 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:46.960800 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:46.960741 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:47.960636 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:47.960577 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:48.960874 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:48.960813 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:49.960679 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:49.960619 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:49.961553 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:49.961529 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:50.960215 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:50.960169 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:51.960062 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:51.960002 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:52.960226 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:52.960183 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:53.960748 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:53.960691 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:54.960286 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:54.960226 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:55.960439 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:55.960391 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:56.960573 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:56.960513 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 03 08:57:58.074233 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:58.074193 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 08:57:58.092575 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:57:58.092526 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 08:58:06.889801 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.889765 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-8576dbc8df-wbpc5"] Jun 03 08:58:06.898624 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.898595 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:06.906709 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.906682 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8576dbc8df-wbpc5"] Jun 03 08:58:06.916557 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.916529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8cf9aa-f318-470f-8131-1642bc188636-console-oauth-config\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:06.916683 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.916617 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-console-config\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:06.916683 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.916649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-service-ca\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:06.916802 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.916726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8cf9aa-f318-470f-8131-1642bc188636-console-serving-cert\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:06.916802 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.916764 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sx5w\" (UniqueName: \"kubernetes.io/projected/3c8cf9aa-f318-470f-8131-1642bc188636-kube-api-access-8sx5w\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:06.916880 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.916822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-oauth-serving-cert\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:06.916880 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:06.916861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-trusted-ca-bundle\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.017749 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.017714 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-oauth-serving-cert\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.017930 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.017768 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-trusted-ca-bundle\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.017930 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.017858 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8cf9aa-f318-470f-8131-1642bc188636-console-oauth-config\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.017930 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.017905 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-console-config\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.018118 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.017933 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-service-ca\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.018118 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.017995 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8cf9aa-f318-470f-8131-1642bc188636-console-serving-cert\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.018118 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.018025 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sx5w\" (UniqueName: \"kubernetes.io/projected/3c8cf9aa-f318-470f-8131-1642bc188636-kube-api-access-8sx5w\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.018654 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.018629 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-trusted-ca-bundle\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.018654 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.018646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-console-config\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.018778 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.018709 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-service-ca\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.018778 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.018737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c8cf9aa-f318-470f-8131-1642bc188636-oauth-serving-cert\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.020905 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.020883 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c8cf9aa-f318-470f-8131-1642bc188636-console-serving-cert\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.020905 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.020898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c8cf9aa-f318-470f-8131-1642bc188636-console-oauth-config\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.028604 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.028584 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sx5w\" (UniqueName: \"kubernetes.io/projected/3c8cf9aa-f318-470f-8131-1642bc188636-kube-api-access-8sx5w\") pod \"console-8576dbc8df-wbpc5\" (UID: \"3c8cf9aa-f318-470f-8131-1642bc188636\") " pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.209050 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.208956 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:07.353284 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.353247 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8576dbc8df-wbpc5"] Jun 03 08:58:07.354007 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:58:07.353978 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8cf9aa_f318_470f_8131_1642bc188636.slice/crio-9070bf5a2b5bd8fb4275b32afa00f3bc4c717c03d984db0450cce6f1ce220c0d WatchSource:0}: Error finding container 9070bf5a2b5bd8fb4275b32afa00f3bc4c717c03d984db0450cce6f1ce220c0d: Status 404 returned error can't find the container with id 9070bf5a2b5bd8fb4275b32afa00f3bc4c717c03d984db0450cce6f1ce220c0d Jun 03 08:58:07.664255 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.664223 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576dbc8df-wbpc5" event={"ID":"3c8cf9aa-f318-470f-8131-1642bc188636","Type":"ContainerStarted","Data":"cc48a6045781940d6f9dd5cd2099d94aada17e4dbdcd89b05cac07d6f49823f2"} Jun 03 08:58:07.664255 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.664260 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8576dbc8df-wbpc5" event={"ID":"3c8cf9aa-f318-470f-8131-1642bc188636","Type":"ContainerStarted","Data":"9070bf5a2b5bd8fb4275b32afa00f3bc4c717c03d984db0450cce6f1ce220c0d"} Jun 03 08:58:07.688074 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:07.688029 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-8576dbc8df-wbpc5" podStartSLOduration=1.6880149169999998 podStartE2EDuration="1.688014917s" podCreationTimestamp="2026-06-03 08:58:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 08:58:07.685020737 +0000 UTC m=+820.462516385" watchObservedRunningTime="2026-06-03 08:58:07.688014917 +0000 UTC m=+820.465510554" Jun 03 08:58:08.081719 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:08.081689 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 08:58:09.045280 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.045249 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-4ls6k"] Jun 03 08:58:09.048079 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.048054 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" Jun 03 08:58:09.053262 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.053240 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wspbs\"" Jun 03 08:58:09.065638 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.065608 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-4ls6k"] Jun 03 08:58:09.137563 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.137533 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvkj\" (UniqueName: \"kubernetes.io/projected/d4c52146-8c0a-4040-98be-f6fa2b44e8f1-kube-api-access-wdvkj\") pod \"authorino-8b475cf9f-4ls6k\" (UID: \"d4c52146-8c0a-4040-98be-f6fa2b44e8f1\") " pod="kuadrant-system/authorino-8b475cf9f-4ls6k" Jun 03 08:58:09.238157 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.238124 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvkj\" (UniqueName: \"kubernetes.io/projected/d4c52146-8c0a-4040-98be-f6fa2b44e8f1-kube-api-access-wdvkj\") pod \"authorino-8b475cf9f-4ls6k\" (UID: \"d4c52146-8c0a-4040-98be-f6fa2b44e8f1\") " pod="kuadrant-system/authorino-8b475cf9f-4ls6k" Jun 03 08:58:09.252061 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.252039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvkj\" (UniqueName: \"kubernetes.io/projected/d4c52146-8c0a-4040-98be-f6fa2b44e8f1-kube-api-access-wdvkj\") pod \"authorino-8b475cf9f-4ls6k\" (UID: \"d4c52146-8c0a-4040-98be-f6fa2b44e8f1\") " pod="kuadrant-system/authorino-8b475cf9f-4ls6k" Jun 03 08:58:09.283832 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.283797 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-4ls6k"] Jun 03 08:58:09.284516 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.284499 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" Jun 03 08:58:09.321217 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.321192 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68b9d44ff7-mfltd"] Jun 03 08:58:09.324517 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.324493 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" Jun 03 08:58:09.336445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.335922 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68b9d44ff7-mfltd"] Jun 03 08:58:09.339758 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.339727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzzsg\" (UniqueName: \"kubernetes.io/projected/08d5747d-a22f-4de8-ae16-e27fe85ddd8e-kube-api-access-gzzsg\") pod \"authorino-68b9d44ff7-mfltd\" (UID: \"08d5747d-a22f-4de8-ae16-e27fe85ddd8e\") " pod="kuadrant-system/authorino-68b9d44ff7-mfltd" Jun 03 08:58:09.422831 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.422806 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-4ls6k"] Jun 03 08:58:09.424576 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:58:09.424551 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4c52146_8c0a_4040_98be_f6fa2b44e8f1.slice/crio-d71aff61242017de544161248ad9580af5c27a9c402d4060b1611c8897fcd7d9 WatchSource:0}: Error finding container d71aff61242017de544161248ad9580af5c27a9c402d4060b1611c8897fcd7d9: Status 404 returned error can't find the container with id d71aff61242017de544161248ad9580af5c27a9c402d4060b1611c8897fcd7d9 Jun 03 08:58:09.440244 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.440221 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gzzsg\" (UniqueName: \"kubernetes.io/projected/08d5747d-a22f-4de8-ae16-e27fe85ddd8e-kube-api-access-gzzsg\") pod \"authorino-68b9d44ff7-mfltd\" (UID: \"08d5747d-a22f-4de8-ae16-e27fe85ddd8e\") " pod="kuadrant-system/authorino-68b9d44ff7-mfltd" Jun 03 08:58:09.449188 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.449167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzzsg\" (UniqueName: \"kubernetes.io/projected/08d5747d-a22f-4de8-ae16-e27fe85ddd8e-kube-api-access-gzzsg\") pod \"authorino-68b9d44ff7-mfltd\" (UID: \"08d5747d-a22f-4de8-ae16-e27fe85ddd8e\") " pod="kuadrant-system/authorino-68b9d44ff7-mfltd" Jun 03 08:58:09.563780 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.563734 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b9d44ff7-mfltd"] Jun 03 08:58:09.564888 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.564330 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" Jun 03 08:58:09.595528 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.595492 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f94f8fbbf-f8hsl"] Jun 03 08:58:09.598661 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.598639 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:09.601934 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.601906 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 08:58:09.607767 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.607742 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f94f8fbbf-f8hsl"] Jun 03 08:58:09.641728 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.641694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98503101-cb97-4dd7-9a60-7c65c69e1899-tls-cert\") pod \"authorino-5f94f8fbbf-f8hsl\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:09.641888 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.641762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klgkw\" (UniqueName: \"kubernetes.io/projected/98503101-cb97-4dd7-9a60-7c65c69e1899-kube-api-access-klgkw\") pod \"authorino-5f94f8fbbf-f8hsl\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:09.675445 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.675408 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" event={"ID":"d4c52146-8c0a-4040-98be-f6fa2b44e8f1","Type":"ContainerStarted","Data":"d71aff61242017de544161248ad9580af5c27a9c402d4060b1611c8897fcd7d9"} Jun 03 08:58:09.705809 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.705716 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b9d44ff7-mfltd"] Jun 03 08:58:09.708318 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:58:09.708296 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08d5747d_a22f_4de8_ae16_e27fe85ddd8e.slice/crio-7d76ea7e9468982c9c19a7c3152ebd7c97e2c64f518226082cdc2d626ab8d791 WatchSource:0}: Error finding container 7d76ea7e9468982c9c19a7c3152ebd7c97e2c64f518226082cdc2d626ab8d791: Status 404 returned error can't find the container with id 7d76ea7e9468982c9c19a7c3152ebd7c97e2c64f518226082cdc2d626ab8d791 Jun 03 08:58:09.743209 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.743179 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-klgkw\" (UniqueName: \"kubernetes.io/projected/98503101-cb97-4dd7-9a60-7c65c69e1899-kube-api-access-klgkw\") pod \"authorino-5f94f8fbbf-f8hsl\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:09.743360 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.743260 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98503101-cb97-4dd7-9a60-7c65c69e1899-tls-cert\") pod \"authorino-5f94f8fbbf-f8hsl\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:09.745723 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.745704 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98503101-cb97-4dd7-9a60-7c65c69e1899-tls-cert\") pod \"authorino-5f94f8fbbf-f8hsl\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:09.753690 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.753667 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klgkw\" (UniqueName: \"kubernetes.io/projected/98503101-cb97-4dd7-9a60-7c65c69e1899-kube-api-access-klgkw\") pod \"authorino-5f94f8fbbf-f8hsl\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:09.912264 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:09.912225 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:58:10.055248 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.055221 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f94f8fbbf-f8hsl"] Jun 03 08:58:10.055756 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:58:10.055728 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98503101_cb97_4dd7_9a60_7c65c69e1899.slice/crio-1d8ec7dcdbd15b199e73ba4091fe38e2c3c6c9f3d2ac1c78721f75dd48a24dfe WatchSource:0}: Error finding container 1d8ec7dcdbd15b199e73ba4091fe38e2c3c6c9f3d2ac1c78721f75dd48a24dfe: Status 404 returned error can't find the container with id 1d8ec7dcdbd15b199e73ba4091fe38e2c3c6c9f3d2ac1c78721f75dd48a24dfe Jun 03 08:58:10.681002 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.680910 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" event={"ID":"98503101-cb97-4dd7-9a60-7c65c69e1899","Type":"ContainerStarted","Data":"ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db"} Jun 03 08:58:10.681002 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.680950 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" event={"ID":"98503101-cb97-4dd7-9a60-7c65c69e1899","Type":"ContainerStarted","Data":"1d8ec7dcdbd15b199e73ba4091fe38e2c3c6c9f3d2ac1c78721f75dd48a24dfe"} Jun 03 08:58:10.682430 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.682370 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" event={"ID":"d4c52146-8c0a-4040-98be-f6fa2b44e8f1","Type":"ContainerStarted","Data":"499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8"} Jun 03 08:58:10.682551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.682443 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" podUID="d4c52146-8c0a-4040-98be-f6fa2b44e8f1" containerName="authorino" containerID="cri-o://499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8" gracePeriod=30 Jun 03 08:58:10.683726 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.683694 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" podUID="08d5747d-a22f-4de8-ae16-e27fe85ddd8e" containerName="authorino" containerID="cri-o://35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70" gracePeriod=30 Jun 03 08:58:10.683851 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.683696 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" event={"ID":"08d5747d-a22f-4de8-ae16-e27fe85ddd8e","Type":"ContainerStarted","Data":"35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70"} Jun 03 08:58:10.683851 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.683780 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" event={"ID":"08d5747d-a22f-4de8-ae16-e27fe85ddd8e","Type":"ContainerStarted","Data":"7d76ea7e9468982c9c19a7c3152ebd7c97e2c64f518226082cdc2d626ab8d791"} Jun 03 08:58:10.713280 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.713238 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" podStartSLOduration=1.423288209 podStartE2EDuration="1.713225064s" podCreationTimestamp="2026-06-03 08:58:09 +0000 UTC" firstStartedPulling="2026-06-03 08:58:10.057090369 +0000 UTC m=+822.834585990" lastFinishedPulling="2026-06-03 08:58:10.347027228 +0000 UTC m=+823.124522845" observedRunningTime="2026-06-03 08:58:10.710812782 +0000 UTC m=+823.488308421" watchObservedRunningTime="2026-06-03 08:58:10.713225064 +0000 UTC m=+823.490720718" Jun 03 08:58:10.774154 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.772466 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" podStartSLOduration=1.455828347 podStartE2EDuration="1.772447451s" podCreationTimestamp="2026-06-03 08:58:09 +0000 UTC" firstStartedPulling="2026-06-03 08:58:09.709637479 +0000 UTC m=+822.487133108" lastFinishedPulling="2026-06-03 08:58:10.026256595 +0000 UTC m=+822.803752212" observedRunningTime="2026-06-03 08:58:10.770000494 +0000 UTC m=+823.547496134" watchObservedRunningTime="2026-06-03 08:58:10.772447451 +0000 UTC m=+823.549943091" Jun 03 08:58:10.838223 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.838156 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" podStartSLOduration=1.474247406 podStartE2EDuration="1.838132557s" podCreationTimestamp="2026-06-03 08:58:09 +0000 UTC" firstStartedPulling="2026-06-03 08:58:09.426479631 +0000 UTC m=+822.203975247" lastFinishedPulling="2026-06-03 08:58:09.790364781 +0000 UTC m=+822.567860398" observedRunningTime="2026-06-03 08:58:10.834728302 +0000 UTC m=+823.612223941" watchObservedRunningTime="2026-06-03 08:58:10.838132557 +0000 UTC m=+823.615628196" Jun 03 08:58:10.920682 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.920658 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" Jun 03 08:58:10.953463 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.953435 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzzsg\" (UniqueName: \"kubernetes.io/projected/08d5747d-a22f-4de8-ae16-e27fe85ddd8e-kube-api-access-gzzsg\") pod \"08d5747d-a22f-4de8-ae16-e27fe85ddd8e\" (UID: \"08d5747d-a22f-4de8-ae16-e27fe85ddd8e\") " Jun 03 08:58:10.956030 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.956004 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08d5747d-a22f-4de8-ae16-e27fe85ddd8e-kube-api-access-gzzsg" (OuterVolumeSpecName: "kube-api-access-gzzsg") pod "08d5747d-a22f-4de8-ae16-e27fe85ddd8e" (UID: "08d5747d-a22f-4de8-ae16-e27fe85ddd8e"). InnerVolumeSpecName "kube-api-access-gzzsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:58:10.957079 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:10.957060 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" Jun 03 08:58:11.054452 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.054426 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdvkj\" (UniqueName: \"kubernetes.io/projected/d4c52146-8c0a-4040-98be-f6fa2b44e8f1-kube-api-access-wdvkj\") pod \"d4c52146-8c0a-4040-98be-f6fa2b44e8f1\" (UID: \"d4c52146-8c0a-4040-98be-f6fa2b44e8f1\") " Jun 03 08:58:11.054749 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.054732 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzzsg\" (UniqueName: \"kubernetes.io/projected/08d5747d-a22f-4de8-ae16-e27fe85ddd8e-kube-api-access-gzzsg\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:11.056563 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.056542 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4c52146-8c0a-4040-98be-f6fa2b44e8f1-kube-api-access-wdvkj" (OuterVolumeSpecName: "kube-api-access-wdvkj") pod "d4c52146-8c0a-4040-98be-f6fa2b44e8f1" (UID: "d4c52146-8c0a-4040-98be-f6fa2b44e8f1"). InnerVolumeSpecName "kube-api-access-wdvkj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:58:11.156151 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.156116 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdvkj\" (UniqueName: \"kubernetes.io/projected/d4c52146-8c0a-4040-98be-f6fa2b44e8f1-kube-api-access-wdvkj\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:11.689407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.689357 2561 generic.go:358] "Generic (PLEG): container finished" podID="d4c52146-8c0a-4040-98be-f6fa2b44e8f1" containerID="499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8" exitCode=0 Jun 03 08:58:11.689878 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.689430 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" Jun 03 08:58:11.689878 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.689452 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" event={"ID":"d4c52146-8c0a-4040-98be-f6fa2b44e8f1","Type":"ContainerDied","Data":"499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8"} Jun 03 08:58:11.689878 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.689492 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-4ls6k" event={"ID":"d4c52146-8c0a-4040-98be-f6fa2b44e8f1","Type":"ContainerDied","Data":"d71aff61242017de544161248ad9580af5c27a9c402d4060b1611c8897fcd7d9"} Jun 03 08:58:11.689878 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.689509 2561 scope.go:117] "RemoveContainer" containerID="499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8" Jun 03 08:58:11.691407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.690900 2561 generic.go:358] "Generic (PLEG): container finished" podID="08d5747d-a22f-4de8-ae16-e27fe85ddd8e" containerID="35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70" exitCode=0 Jun 03 08:58:11.691407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.690946 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" Jun 03 08:58:11.691407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.691119 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" event={"ID":"08d5747d-a22f-4de8-ae16-e27fe85ddd8e","Type":"ContainerDied","Data":"35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70"} Jun 03 08:58:11.691407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.691168 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b9d44ff7-mfltd" event={"ID":"08d5747d-a22f-4de8-ae16-e27fe85ddd8e","Type":"ContainerDied","Data":"7d76ea7e9468982c9c19a7c3152ebd7c97e2c64f518226082cdc2d626ab8d791"} Jun 03 08:58:11.699240 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.699218 2561 scope.go:117] "RemoveContainer" containerID="499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8" Jun 03 08:58:11.699579 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:58:11.699555 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8\": container with ID starting with 499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8 not found: ID does not exist" containerID="499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8" Jun 03 08:58:11.699693 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.699589 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8"} err="failed to get container status \"499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8\": rpc error: code = NotFound desc = could not find container \"499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8\": container with ID starting with 499c6c0fb72d3135c1515fca406c69d3b2f0255310a092db7c94029ed51931c8 not found: ID does not exist" Jun 03 08:58:11.699693 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.699613 2561 scope.go:117] "RemoveContainer" containerID="35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70" Jun 03 08:58:11.708193 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.708176 2561 scope.go:117] "RemoveContainer" containerID="35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70" Jun 03 08:58:11.708462 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:58:11.708442 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70\": container with ID starting with 35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70 not found: ID does not exist" containerID="35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70" Jun 03 08:58:11.708514 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.708472 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70"} err="failed to get container status \"35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70\": rpc error: code = NotFound desc = could not find container \"35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70\": container with ID starting with 35c0e36ed2da2f62d65ca8de396bca96cce6a27a359bc7df94c25ba607cc0f70 not found: ID does not exist" Jun 03 08:58:11.736925 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.736904 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b9d44ff7-mfltd"] Jun 03 08:58:11.745791 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.745772 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68b9d44ff7-mfltd"] Jun 03 08:58:11.774798 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.774770 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-4ls6k"] Jun 03 08:58:11.784845 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.784826 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-4ls6k"] Jun 03 08:58:11.837507 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.837481 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08d5747d-a22f-4de8-ae16-e27fe85ddd8e" path="/var/lib/kubelet/pods/08d5747d-a22f-4de8-ae16-e27fe85ddd8e/volumes" Jun 03 08:58:11.837826 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:11.837813 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4c52146-8c0a-4040-98be-f6fa2b44e8f1" path="/var/lib/kubelet/pods/d4c52146-8c0a-4040-98be-f6fa2b44e8f1/volumes" Jun 03 08:58:17.210020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:17.209966 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:17.210020 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:17.210029 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:17.214887 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:17.214863 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:17.725226 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:17.725195 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8576dbc8df-wbpc5" Jun 03 08:58:17.784997 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:17.784966 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658b67c5-4k68b"] Jun 03 08:58:42.806579 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:42.806516 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-658b67c5-4k68b" podUID="3faefeae-ad96-451e-b7da-6d6869c54f95" containerName="console" containerID="cri-o://50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4" gracePeriod=15 Jun 03 08:58:43.056401 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.056349 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-658b67c5-4k68b_3faefeae-ad96-451e-b7da-6d6869c54f95/console/0.log" Jun 03 08:58:43.056546 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.056446 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:58:43.142166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142085 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-oauth-config\") pod \"3faefeae-ad96-451e-b7da-6d6869c54f95\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " Jun 03 08:58:43.142166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142146 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-service-ca\") pod \"3faefeae-ad96-451e-b7da-6d6869c54f95\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " Jun 03 08:58:43.142166 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142163 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-serving-cert\") pod \"3faefeae-ad96-451e-b7da-6d6869c54f95\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " Jun 03 08:58:43.142483 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142207 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-console-config\") pod \"3faefeae-ad96-451e-b7da-6d6869c54f95\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " Jun 03 08:58:43.142483 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142223 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-oauth-serving-cert\") pod \"3faefeae-ad96-451e-b7da-6d6869c54f95\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " Jun 03 08:58:43.142483 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142265 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn8bl\" (UniqueName: \"kubernetes.io/projected/3faefeae-ad96-451e-b7da-6d6869c54f95-kube-api-access-rn8bl\") pod \"3faefeae-ad96-451e-b7da-6d6869c54f95\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " Jun 03 08:58:43.142483 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142299 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-trusted-ca-bundle\") pod \"3faefeae-ad96-451e-b7da-6d6869c54f95\" (UID: \"3faefeae-ad96-451e-b7da-6d6869c54f95\") " Jun 03 08:58:43.142711 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142671 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3faefeae-ad96-451e-b7da-6d6869c54f95" (UID: "3faefeae-ad96-451e-b7da-6d6869c54f95"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:58:43.142711 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142682 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-service-ca" (OuterVolumeSpecName: "service-ca") pod "3faefeae-ad96-451e-b7da-6d6869c54f95" (UID: "3faefeae-ad96-451e-b7da-6d6869c54f95"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:58:43.142815 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142695 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-console-config" (OuterVolumeSpecName: "console-config") pod "3faefeae-ad96-451e-b7da-6d6869c54f95" (UID: "3faefeae-ad96-451e-b7da-6d6869c54f95"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:58:43.142897 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.142880 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3faefeae-ad96-451e-b7da-6d6869c54f95" (UID: "3faefeae-ad96-451e-b7da-6d6869c54f95"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 08:58:43.144636 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.144614 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3faefeae-ad96-451e-b7da-6d6869c54f95" (UID: "3faefeae-ad96-451e-b7da-6d6869c54f95"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:58:43.144763 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.144697 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3faefeae-ad96-451e-b7da-6d6869c54f95" (UID: "3faefeae-ad96-451e-b7da-6d6869c54f95"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:58:43.144890 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.144873 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3faefeae-ad96-451e-b7da-6d6869c54f95-kube-api-access-rn8bl" (OuterVolumeSpecName: "kube-api-access-rn8bl") pod "3faefeae-ad96-451e-b7da-6d6869c54f95" (UID: "3faefeae-ad96-451e-b7da-6d6869c54f95"). InnerVolumeSpecName "kube-api-access-rn8bl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:58:43.243495 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.243463 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn8bl\" (UniqueName: \"kubernetes.io/projected/3faefeae-ad96-451e-b7da-6d6869c54f95-kube-api-access-rn8bl\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:43.243495 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.243491 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-trusted-ca-bundle\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:43.243495 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.243500 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-oauth-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:43.243718 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.243510 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-service-ca\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:43.243718 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.243520 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3faefeae-ad96-451e-b7da-6d6869c54f95-console-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:43.243718 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.243529 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-console-config\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:43.243718 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.243538 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3faefeae-ad96-451e-b7da-6d6869c54f95-oauth-serving-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:58:43.825372 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.825339 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-658b67c5-4k68b_3faefeae-ad96-451e-b7da-6d6869c54f95/console/0.log" Jun 03 08:58:43.825838 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.825407 2561 generic.go:358] "Generic (PLEG): container finished" podID="3faefeae-ad96-451e-b7da-6d6869c54f95" containerID="50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4" exitCode=2 Jun 03 08:58:43.825838 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.825464 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658b67c5-4k68b" Jun 03 08:58:43.825838 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.825488 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658b67c5-4k68b" event={"ID":"3faefeae-ad96-451e-b7da-6d6869c54f95","Type":"ContainerDied","Data":"50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4"} Jun 03 08:58:43.825838 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.825534 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658b67c5-4k68b" event={"ID":"3faefeae-ad96-451e-b7da-6d6869c54f95","Type":"ContainerDied","Data":"e2d4baced28bf7bc46a89187629e7ed93cac21e914521558d75104edf619e2eb"} Jun 03 08:58:43.825838 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.825556 2561 scope.go:117] "RemoveContainer" containerID="50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4" Jun 03 08:58:43.835698 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.835681 2561 scope.go:117] "RemoveContainer" containerID="50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4" Jun 03 08:58:43.835961 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:58:43.835942 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4\": container with ID starting with 50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4 not found: ID does not exist" containerID="50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4" Jun 03 08:58:43.836015 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.835969 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4"} err="failed to get container status \"50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4\": rpc error: code = NotFound desc = could not find container \"50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4\": container with ID starting with 50fdb3d8024045602cde423b406210d3532e129e79a938ba1e05296af689bea4 not found: ID does not exist" Jun 03 08:58:43.853243 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.853212 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658b67c5-4k68b"] Jun 03 08:58:43.862007 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:43.861986 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-658b67c5-4k68b"] Jun 03 08:58:45.837491 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:58:45.837461 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3faefeae-ad96-451e-b7da-6d6869c54f95" path="/var/lib/kubelet/pods/3faefeae-ad96-451e-b7da-6d6869c54f95/volumes" Jun 03 08:59:04.217397 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:04.217352 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:59:04.217915 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:04.217607 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" containerID="cri-o://4597a0990055c934619dd4d2693c1aa5af184114c787ae7e8a7d0692dd705426" gracePeriod=30 Jun 03 08:59:05.921850 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:05.921755 2561 generic.go:358] "Generic (PLEG): container finished" podID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerID="4597a0990055c934619dd4d2693c1aa5af184114c787ae7e8a7d0692dd705426" exitCode=143 Jun 03 08:59:05.921850 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:05.921835 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a6a887c7-d9b7-4046-a304-5a30117c9e7f","Type":"ContainerDied","Data":"4597a0990055c934619dd4d2693c1aa5af184114c787ae7e8a7d0692dd705426"} Jun 03 08:59:06.270252 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.270225 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:06.342619 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.342583 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ftlb\" (UniqueName: \"kubernetes.io/projected/a6a887c7-d9b7-4046-a304-5a30117c9e7f-kube-api-access-5ftlb\") pod \"a6a887c7-d9b7-4046-a304-5a30117c9e7f\" (UID: \"a6a887c7-d9b7-4046-a304-5a30117c9e7f\") " Jun 03 08:59:06.345362 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.345330 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a887c7-d9b7-4046-a304-5a30117c9e7f-kube-api-access-5ftlb" (OuterVolumeSpecName: "kube-api-access-5ftlb") pod "a6a887c7-d9b7-4046-a304-5a30117c9e7f" (UID: "a6a887c7-d9b7-4046-a304-5a30117c9e7f"). InnerVolumeSpecName "kube-api-access-5ftlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:59:06.444127 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.444037 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ftlb\" (UniqueName: \"kubernetes.io/projected/a6a887c7-d9b7-4046-a304-5a30117c9e7f-kube-api-access-5ftlb\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:59:06.926487 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.926452 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a6a887c7-d9b7-4046-a304-5a30117c9e7f","Type":"ContainerDied","Data":"0c207dfd4abf5141bbfcb96136793137ecd6028bdad87bd395a685905d85acd3"} Jun 03 08:59:06.926899 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.926500 2561 scope.go:117] "RemoveContainer" containerID="4597a0990055c934619dd4d2693c1aa5af184114c787ae7e8a7d0692dd705426" Jun 03 08:59:06.926899 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.926532 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:06.968493 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.968465 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:59:06.980092 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:06.980070 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:59:07.024489 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024463 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:59:07.024846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024831 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4c52146-8c0a-4040-98be-f6fa2b44e8f1" containerName="authorino" Jun 03 08:59:07.024846 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024847 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4c52146-8c0a-4040-98be-f6fa2b44e8f1" containerName="authorino" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024857 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024863 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024875 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08d5747d-a22f-4de8-ae16-e27fe85ddd8e" containerName="authorino" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024880 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="08d5747d-a22f-4de8-ae16-e27fe85ddd8e" containerName="authorino" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024889 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3faefeae-ad96-451e-b7da-6d6869c54f95" containerName="console" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024894 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3faefeae-ad96-451e-b7da-6d6869c54f95" containerName="console" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024956 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="d4c52146-8c0a-4040-98be-f6fa2b44e8f1" containerName="authorino" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024966 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="08d5747d-a22f-4de8-ae16-e27fe85ddd8e" containerName="authorino" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024974 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" containerName="keycloak" Jun 03 08:59:07.024983 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.024981 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="3faefeae-ad96-451e-b7da-6d6869c54f95" containerName="console" Jun 03 08:59:07.029859 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.029831 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.044110 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.044087 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 08:59:07.044110 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.044104 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-qcgwz\"" Jun 03 08:59:07.044254 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.044186 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 08:59:07.059897 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.059858 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:59:07.151312 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.151268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cf58\" (UniqueName: \"kubernetes.io/projected/dfa8268d-2565-4fdc-9bfb-c53421fe63ad-kube-api-access-6cf58\") pod \"maas-keycloak-0\" (UID: \"dfa8268d-2565-4fdc-9bfb-c53421fe63ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.151509 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.151462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dfa8268d-2565-4fdc-9bfb-c53421fe63ad-test-realms\") pod \"maas-keycloak-0\" (UID: \"dfa8268d-2565-4fdc-9bfb-c53421fe63ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.252834 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.252737 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6cf58\" (UniqueName: \"kubernetes.io/projected/dfa8268d-2565-4fdc-9bfb-c53421fe63ad-kube-api-access-6cf58\") pod \"maas-keycloak-0\" (UID: \"dfa8268d-2565-4fdc-9bfb-c53421fe63ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.253012 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.252848 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dfa8268d-2565-4fdc-9bfb-c53421fe63ad-test-realms\") pod \"maas-keycloak-0\" (UID: \"dfa8268d-2565-4fdc-9bfb-c53421fe63ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.253565 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.253541 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/dfa8268d-2565-4fdc-9bfb-c53421fe63ad-test-realms\") pod \"maas-keycloak-0\" (UID: \"dfa8268d-2565-4fdc-9bfb-c53421fe63ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.265181 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.265164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cf58\" (UniqueName: \"kubernetes.io/projected/dfa8268d-2565-4fdc-9bfb-c53421fe63ad-kube-api-access-6cf58\") pod \"maas-keycloak-0\" (UID: \"dfa8268d-2565-4fdc-9bfb-c53421fe63ad\") " pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.340520 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.340494 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:07.491926 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.491900 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 08:59:07.494013 ip-10-0-138-22 kubenswrapper[2561]: W0603 08:59:07.493978 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa8268d_2565_4fdc_9bfb_c53421fe63ad.slice/crio-eef631eba3344337bd928ff8a30c4b517b63f2e5e0f203576aef8d314db940ea WatchSource:0}: Error finding container eef631eba3344337bd928ff8a30c4b517b63f2e5e0f203576aef8d314db940ea: Status 404 returned error can't find the container with id eef631eba3344337bd928ff8a30c4b517b63f2e5e0f203576aef8d314db940ea Jun 03 08:59:07.837533 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.837497 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a887c7-d9b7-4046-a304-5a30117c9e7f" path="/var/lib/kubelet/pods/a6a887c7-d9b7-4046-a304-5a30117c9e7f/volumes" Jun 03 08:59:07.932929 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.932897 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfa8268d-2565-4fdc-9bfb-c53421fe63ad","Type":"ContainerStarted","Data":"c836179fdd66a672b5daaa33f7c1f88d4b846f8b8a4ebcf31e59bf60f0ecf8c8"} Jun 03 08:59:07.933254 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.932936 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dfa8268d-2565-4fdc-9bfb-c53421fe63ad","Type":"ContainerStarted","Data":"eef631eba3344337bd928ff8a30c4b517b63f2e5e0f203576aef8d314db940ea"} Jun 03 08:59:07.977345 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:07.977291 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.612556926 podStartE2EDuration="1.977276688s" podCreationTimestamp="2026-06-03 08:59:06 +0000 UTC" firstStartedPulling="2026-06-03 08:59:07.495719667 +0000 UTC m=+880.273215283" lastFinishedPulling="2026-06-03 08:59:07.86043942 +0000 UTC m=+880.637935045" observedRunningTime="2026-06-03 08:59:07.973232536 +0000 UTC m=+880.750728174" watchObservedRunningTime="2026-06-03 08:59:07.977276688 +0000 UTC m=+880.754772326" Jun 03 08:59:08.341438 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:08.341373 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:08.342978 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:08.342946 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:09.341480 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:09.341432 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:10.341105 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:10.341071 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:11.341508 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:11.341446 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:12.341912 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:12.341864 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:13.340991 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:13.340938 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:14.341572 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:14.341524 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:15.341743 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:15.341688 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:16.341213 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:16.341170 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:17.341442 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:17.341391 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:17.342112 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:17.341690 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:18.341168 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:18.341107 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:19.341364 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:19.341315 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:20.341314 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:20.341264 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.58:9000/health/started\": dial tcp 10.134.0.58:9000: connect: connection refused" Jun 03 08:59:21.476464 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:21.476419 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:21.496407 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:21.496330 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dfa8268d-2565-4fdc-9bfb-c53421fe63ad" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 08:59:27.813273 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:27.813244 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:59:27.814404 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:27.814355 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 08:59:27.818926 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:27.818905 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:59:27.820053 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:27.820032 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 08:59:31.482735 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:31.482699 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 08:59:44.121485 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.121446 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f94f8fbbf-f8hsl"] Jun 03 08:59:44.122118 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.121636 2561 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" podUID="98503101-cb97-4dd7-9a60-7c65c69e1899" containerName="authorino" containerID="cri-o://ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db" gracePeriod=30 Jun 03 08:59:44.373946 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.373890 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:59:44.417154 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.417122 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98503101-cb97-4dd7-9a60-7c65c69e1899-tls-cert\") pod \"98503101-cb97-4dd7-9a60-7c65c69e1899\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " Jun 03 08:59:44.417327 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.417279 2561 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klgkw\" (UniqueName: \"kubernetes.io/projected/98503101-cb97-4dd7-9a60-7c65c69e1899-kube-api-access-klgkw\") pod \"98503101-cb97-4dd7-9a60-7c65c69e1899\" (UID: \"98503101-cb97-4dd7-9a60-7c65c69e1899\") " Jun 03 08:59:44.419434 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.419373 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98503101-cb97-4dd7-9a60-7c65c69e1899-kube-api-access-klgkw" (OuterVolumeSpecName: "kube-api-access-klgkw") pod "98503101-cb97-4dd7-9a60-7c65c69e1899" (UID: "98503101-cb97-4dd7-9a60-7c65c69e1899"). InnerVolumeSpecName "kube-api-access-klgkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 08:59:44.428518 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.428494 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98503101-cb97-4dd7-9a60-7c65c69e1899-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "98503101-cb97-4dd7-9a60-7c65c69e1899" (UID: "98503101-cb97-4dd7-9a60-7c65c69e1899"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 08:59:44.518586 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.518561 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klgkw\" (UniqueName: \"kubernetes.io/projected/98503101-cb97-4dd7-9a60-7c65c69e1899-kube-api-access-klgkw\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:59:44.518586 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:44.518587 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/98503101-cb97-4dd7-9a60-7c65c69e1899-tls-cert\") on node \"ip-10-0-138-22.ec2.internal\" DevicePath \"\"" Jun 03 08:59:45.107363 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.107323 2561 generic.go:358] "Generic (PLEG): container finished" podID="98503101-cb97-4dd7-9a60-7c65c69e1899" containerID="ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db" exitCode=0 Jun 03 08:59:45.107551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.107403 2561 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" Jun 03 08:59:45.107551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.107421 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" event={"ID":"98503101-cb97-4dd7-9a60-7c65c69e1899","Type":"ContainerDied","Data":"ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db"} Jun 03 08:59:45.107551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.107478 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f94f8fbbf-f8hsl" event={"ID":"98503101-cb97-4dd7-9a60-7c65c69e1899","Type":"ContainerDied","Data":"1d8ec7dcdbd15b199e73ba4091fe38e2c3c6c9f3d2ac1c78721f75dd48a24dfe"} Jun 03 08:59:45.107551 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.107500 2561 scope.go:117] "RemoveContainer" containerID="ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db" Jun 03 08:59:45.117307 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.117293 2561 scope.go:117] "RemoveContainer" containerID="ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db" Jun 03 08:59:45.117570 ip-10-0-138-22 kubenswrapper[2561]: E0603 08:59:45.117551 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db\": container with ID starting with ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db not found: ID does not exist" containerID="ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db" Jun 03 08:59:45.117642 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.117577 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db"} err="failed to get container status \"ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db\": rpc error: code = NotFound desc = could not find container \"ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db\": container with ID starting with ce4bee2d0d62b1d16d7e72994fa984a84232dd2d9e5dec83b49910a63ef2b4db not found: ID does not exist" Jun 03 08:59:45.134215 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.134193 2561 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f94f8fbbf-f8hsl"] Jun 03 08:59:45.137523 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.137502 2561 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f94f8fbbf-f8hsl"] Jun 03 08:59:45.837659 ip-10-0-138-22 kubenswrapper[2561]: I0603 08:59:45.837617 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98503101-cb97-4dd7-9a60-7c65c69e1899" path="/var/lib/kubelet/pods/98503101-cb97-4dd7-9a60-7c65c69e1899/volumes" Jun 03 09:00:06.703021 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.702982 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk"] Jun 03 09:00:06.703609 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.703588 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98503101-cb97-4dd7-9a60-7c65c69e1899" containerName="authorino" Jun 03 09:00:06.703692 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.703611 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="98503101-cb97-4dd7-9a60-7c65c69e1899" containerName="authorino" Jun 03 09:00:06.703747 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.703740 2561 memory_manager.go:356] "RemoveStaleState removing state" podUID="98503101-cb97-4dd7-9a60-7c65c69e1899" containerName="authorino" Jun 03 09:00:06.708478 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.708455 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.716896 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.715037 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 09:00:06.717749 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.717533 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 09:00:06.717749 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.717543 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 09:00:06.717749 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.717647 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rl8m2\"" Jun 03 09:00:06.719944 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.719902 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk"] Jun 03 09:00:06.822898 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.822865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.822898 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.822901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.823122 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.822923 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.823122 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.823019 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.823122 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.823048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.823122 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.823077 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtls2\" (UniqueName: \"kubernetes.io/projected/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-kube-api-access-wtls2\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924294 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924257 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924294 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924305 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924532 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924423 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wtls2\" (UniqueName: \"kubernetes.io/projected/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-kube-api-access-wtls2\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924532 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924508 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924620 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924537 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924620 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924566 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924757 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924819 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.924903 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.924880 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.927018 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.926997 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.927222 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.927201 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:06.933000 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:06.932977 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtls2\" (UniqueName: \"kubernetes.io/projected/ac2f7aea-8baa-45b3-a1a1-b51ea697fe32-kube-api-access-wtls2\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-22vzk\" (UID: \"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:07.022497 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:07.022399 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" Jun 03 09:00:07.182239 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:07.161843 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk"] Jun 03 09:00:07.182239 ip-10-0-138-22 kubenswrapper[2561]: W0603 09:00:07.163519 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2f7aea_8baa_45b3_a1a1_b51ea697fe32.slice/crio-07b90788f299d198f3ed5f54f997efdddcdf96464989ee993b0d4d4a02cab23e WatchSource:0}: Error finding container 07b90788f299d198f3ed5f54f997efdddcdf96464989ee993b0d4d4a02cab23e: Status 404 returned error can't find the container with id 07b90788f299d198f3ed5f54f997efdddcdf96464989ee993b0d4d4a02cab23e Jun 03 09:00:07.200482 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:07.200451 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" event={"ID":"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32","Type":"ContainerStarted","Data":"07b90788f299d198f3ed5f54f997efdddcdf96464989ee993b0d4d4a02cab23e"} Jun 03 09:00:11.220786 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:11.220747 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-22vzk" event={"ID":"ac2f7aea-8baa-45b3-a1a1-b51ea697fe32","Type":"ContainerStarted","Data":"e7bbcbf13c70ebacea6f275cfdaabb444537adab0dd904a21447894c1d350412"} Jun 03 09:00:25.897168 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:25.897130 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6"] Jun 03 09:00:25.988643 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:25.988609 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6"] Jun 03 09:00:25.988830 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:25.988732 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:25.991593 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:25.991564 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 09:00:26.103310 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.103264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jl7b\" (UniqueName: \"kubernetes.io/projected/5760d1dd-1552-48ab-8109-b9ebbe644ff5-kube-api-access-6jl7b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.103502 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.103363 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.103502 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.103453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5760d1dd-1552-48ab-8109-b9ebbe644ff5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.103587 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.103498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.103587 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.103562 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.103652 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.103603 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204542 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204452 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5760d1dd-1552-48ab-8109-b9ebbe644ff5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204542 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204498 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204542 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204528 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204790 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204557 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204790 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204643 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jl7b\" (UniqueName: \"kubernetes.io/projected/5760d1dd-1552-48ab-8109-b9ebbe644ff5-kube-api-access-6jl7b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204790 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204682 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204936 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204915 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204992 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204958 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.204992 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.204982 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.206961 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.206934 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5760d1dd-1552-48ab-8109-b9ebbe644ff5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.207163 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.207147 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5760d1dd-1552-48ab-8109-b9ebbe644ff5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.212493 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.212468 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jl7b\" (UniqueName: \"kubernetes.io/projected/5760d1dd-1552-48ab-8109-b9ebbe644ff5-kube-api-access-6jl7b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6\" (UID: \"5760d1dd-1552-48ab-8109-b9ebbe644ff5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.299297 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.299262 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:00:26.440964 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:26.440940 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6"] Jun 03 09:00:26.442998 ip-10-0-138-22 kubenswrapper[2561]: W0603 09:00:26.442970 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5760d1dd_1552_48ab_8109_b9ebbe644ff5.slice/crio-c65254df4bc8ce68f360e91e3cba608285c576fa41043e8ca8a995b32973d16a WatchSource:0}: Error finding container c65254df4bc8ce68f360e91e3cba608285c576fa41043e8ca8a995b32973d16a: Status 404 returned error can't find the container with id c65254df4bc8ce68f360e91e3cba608285c576fa41043e8ca8a995b32973d16a Jun 03 09:00:27.294063 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:27.294016 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" event={"ID":"5760d1dd-1552-48ab-8109-b9ebbe644ff5","Type":"ContainerStarted","Data":"d8707e6107db3c903022b97bdbe59a582ef67c4e86619542f15d56dfa8b2a9a7"} Jun 03 09:00:27.294063 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:27.294068 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" event={"ID":"5760d1dd-1552-48ab-8109-b9ebbe644ff5","Type":"ContainerStarted","Data":"c65254df4bc8ce68f360e91e3cba608285c576fa41043e8ca8a995b32973d16a"} Jun 03 09:00:42.117254 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.117060 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m"] Jun 03 09:00:42.124348 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.124313 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.128451 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.128425 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 09:00:42.131212 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.131180 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m"] Jun 03 09:00:42.252887 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.252852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2dqz\" (UniqueName: \"kubernetes.io/projected/f5eb279e-527a-41ae-a155-63d275e1897e-kube-api-access-f2dqz\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.253065 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.252911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.253065 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.252932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.253065 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.253008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.253065 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.253041 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.253209 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.253078 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5eb279e-527a-41ae-a155-63d275e1897e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.354292 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354253 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5eb279e-527a-41ae-a155-63d275e1897e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.354511 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354355 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f2dqz\" (UniqueName: \"kubernetes.io/projected/f5eb279e-527a-41ae-a155-63d275e1897e-kube-api-access-f2dqz\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.354511 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354480 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.354636 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354514 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.354636 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354553 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.354636 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354587 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.354968 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354941 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.355062 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.354981 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.355130 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.355113 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.356916 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.356898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5eb279e-527a-41ae-a155-63d275e1897e-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.357062 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.357040 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5eb279e-527a-41ae-a155-63d275e1897e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.363700 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.363669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2dqz\" (UniqueName: \"kubernetes.io/projected/f5eb279e-527a-41ae-a155-63d275e1897e-kube-api-access-f2dqz\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m\" (UID: \"f5eb279e-527a-41ae-a155-63d275e1897e\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.440395 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.440295 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:00:42.580044 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:42.580011 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m"] Jun 03 09:00:42.581505 ip-10-0-138-22 kubenswrapper[2561]: W0603 09:00:42.581477 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5eb279e_527a_41ae_a155_63d275e1897e.slice/crio-70b454a7e8c454581a24febb99b4bc790a67a62a113c6c42c2f626bb4c7a67cd WatchSource:0}: Error finding container 70b454a7e8c454581a24febb99b4bc790a67a62a113c6c42c2f626bb4c7a67cd: Status 404 returned error can't find the container with id 70b454a7e8c454581a24febb99b4bc790a67a62a113c6c42c2f626bb4c7a67cd Jun 03 09:00:43.360804 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:43.360769 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" event={"ID":"f5eb279e-527a-41ae-a155-63d275e1897e","Type":"ContainerStarted","Data":"c921d99f74da2bd1f0f0fa6fefb40723932ed9c9c059a44eb9ccb77994bd33e3"} Jun 03 09:00:43.360804 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:43.360807 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" event={"ID":"f5eb279e-527a-41ae-a155-63d275e1897e","Type":"ContainerStarted","Data":"70b454a7e8c454581a24febb99b4bc790a67a62a113c6c42c2f626bb4c7a67cd"} Jun 03 09:00:44.365776 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:44.365747 2561 generic.go:358] "Generic (PLEG): container finished" podID="f5eb279e-527a-41ae-a155-63d275e1897e" containerID="c921d99f74da2bd1f0f0fa6fefb40723932ed9c9c059a44eb9ccb77994bd33e3" exitCode=0 Jun 03 09:00:44.366170 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:00:44.365839 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" event={"ID":"f5eb279e-527a-41ae-a155-63d275e1897e","Type":"ContainerDied","Data":"c921d99f74da2bd1f0f0fa6fefb40723932ed9c9c059a44eb9ccb77994bd33e3"} Jun 03 09:01:26.546443 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:01:26.546371 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" event={"ID":"f5eb279e-527a-41ae-a155-63d275e1897e","Type":"ContainerStarted","Data":"963d69cc0680d20a61302d7cc9dca8d96e2d01a5a9868923b3772f640b42e51e"} Jun 03 09:01:26.567872 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:01:26.567822 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" podStartSLOduration=3.427528179 podStartE2EDuration="44.567807509s" podCreationTimestamp="2026-06-03 09:00:42 +0000 UTC" firstStartedPulling="2026-06-03 09:00:44.366320684 +0000 UTC m=+977.143816300" lastFinishedPulling="2026-06-03 09:01:25.506600013 +0000 UTC m=+1018.284095630" observedRunningTime="2026-06-03 09:01:26.564170235 +0000 UTC m=+1019.341665875" watchObservedRunningTime="2026-06-03 09:01:26.567807509 +0000 UTC m=+1019.345303147" Jun 03 09:01:32.441371 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:01:32.441325 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:01:32.441371 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:01:32.441393 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:01:32.454186 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:01:32.454150 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:01:32.585101 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:01:32.585072 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m" Jun 03 09:02:34.833894 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:34.833862 2561 generic.go:358] "Generic (PLEG): container finished" podID="5760d1dd-1552-48ab-8109-b9ebbe644ff5" containerID="d8707e6107db3c903022b97bdbe59a582ef67c4e86619542f15d56dfa8b2a9a7" exitCode=0 Jun 03 09:02:34.834439 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:34.833938 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" event={"ID":"5760d1dd-1552-48ab-8109-b9ebbe644ff5","Type":"ContainerDied","Data":"d8707e6107db3c903022b97bdbe59a582ef67c4e86619542f15d56dfa8b2a9a7"} Jun 03 09:02:34.834558 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:34.834540 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 09:02:35.844922 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:35.844884 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" event={"ID":"5760d1dd-1552-48ab-8109-b9ebbe644ff5","Type":"ContainerStarted","Data":"4a98263060b7bf544eed10796cb1c577e2c0cf44a12f0be13d0659dd1da6a8ac"} Jun 03 09:02:35.866467 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:35.866408 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" podStartSLOduration=130.388417347 podStartE2EDuration="2m10.86639283s" podCreationTimestamp="2026-06-03 09:00:25 +0000 UTC" firstStartedPulling="2026-06-03 09:02:34.834660346 +0000 UTC m=+1087.612155962" lastFinishedPulling="2026-06-03 09:02:35.312635826 +0000 UTC m=+1088.090131445" observedRunningTime="2026-06-03 09:02:35.864644185 +0000 UTC m=+1088.642139835" watchObservedRunningTime="2026-06-03 09:02:35.86639283 +0000 UTC m=+1088.643888462" Jun 03 09:02:36.299868 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:36.299774 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:02:36.299868 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:36.299824 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:02:36.312830 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:36.312797 2561 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:02:36.860719 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:02:36.860692 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6" Jun 03 09:04:27.848174 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:04:27.848142 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 09:04:27.850257 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:04:27.850236 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 09:04:27.854475 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:04:27.854453 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 09:04:27.856314 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:04:27.856297 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 09:06:45.433693 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:45.433611 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c68945bf9-gx7fr_d995dfbc-bad9-4c86-ae37-3de6863b8c12/nginx/0.log" Jun 03 09:06:46.607908 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:46.607873 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-f8lzd_c523232a-6fde-4352-b45e-4e34c477ec48/copy-manifests/0.log" Jun 03 09:06:46.628179 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:46.628149 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-f8lzd_c523232a-6fde-4352-b45e-4e34c477ec48/manager/0.log" Jun 03 09:06:46.908549 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:46.908461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wtssf_7efaa06d-a041-41c8-ab8b-1768fe1935a8/postgres/0.log" Jun 03 09:06:48.852059 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:48.852026 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp_53ee66c0-887d-48c1-81b8-b007b5bbcd1e/util/0.log" Jun 03 09:06:48.862650 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:48.862625 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp_53ee66c0-887d-48c1-81b8-b007b5bbcd1e/pull/0.log" Jun 03 09:06:48.869540 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:48.869509 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp_53ee66c0-887d-48c1-81b8-b007b5bbcd1e/extract/0.log" Jun 03 09:06:48.990944 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:48.990913 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5_c4656c86-3ee8-41a6-90b7-f2b56f58a9fc/util/0.log" Jun 03 09:06:48.998140 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:48.998103 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5_c4656c86-3ee8-41a6-90b7-f2b56f58a9fc/pull/0.log" Jun 03 09:06:49.005357 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.005337 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5_c4656c86-3ee8-41a6-90b7-f2b56f58a9fc/extract/0.log" Jun 03 09:06:49.128918 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.128841 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl_8ed4ded8-6993-497b-8ac6-17c4ce1ea827/util/0.log" Jun 03 09:06:49.135567 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.135536 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl_8ed4ded8-6993-497b-8ac6-17c4ce1ea827/pull/0.log" Jun 03 09:06:49.143053 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.143029 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl_8ed4ded8-6993-497b-8ac6-17c4ce1ea827/extract/0.log" Jun 03 09:06:49.284493 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.284461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6_e55faaf2-7418-4f44-af4d-f754ce36e4ca/util/0.log" Jun 03 09:06:49.292051 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.292032 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6_e55faaf2-7418-4f44-af4d-f754ce36e4ca/pull/0.log" Jun 03 09:06:49.298961 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.298939 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6_e55faaf2-7418-4f44-af4d-f754ce36e4ca/extract/0.log" Jun 03 09:06:49.699517 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.699467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-w9pjw_68cdcdba-40ce-4067-91db-fc7ad81d4ef4/manager/0.log" Jun 03 09:06:49.953956 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:49.953861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dd9pj_92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b/registry-server/0.log" Jun 03 09:06:50.100724 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:50.100695 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-zqc9c_80824cc5-1940-4405-92cf-26eb7553be33/manager/0.log" Jun 03 09:06:51.301183 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:51.301146 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-vsgz5_241f365a-c5e3-4c34-a1e8-f6683fcd270b/istio-proxy/0.log" Jun 03 09:06:52.081883 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:52.081851 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-22vzk_ac2f7aea-8baa-45b3-a1a1-b51ea697fe32/storage-initializer/0.log" Jun 03 09:06:52.358235 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:52.358125 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6_5760d1dd-1552-48ab-8109-b9ebbe644ff5/main/0.log" Jun 03 09:06:52.368754 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:52.368733 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f97spq6_5760d1dd-1552-48ab-8109-b9ebbe644ff5/storage-initializer/0.log" Jun 03 09:06:52.495246 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:52.495208 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m_f5eb279e-527a-41ae-a155-63d275e1897e/main/0.log" Jun 03 09:06:52.502899 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:06:52.502873 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-59n9m_f5eb279e-527a-41ae-a155-63d275e1897e/storage-initializer/0.log" Jun 03 09:07:00.590838 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:00.590804 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8rv8s_7c6b615d-cddd-4288-aa28-7563a3312fe8/global-pull-secret-syncer/0.log" Jun 03 09:07:00.789283 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:00.789253 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mfh47_4a46fbf0-b72f-4030-a103-04e9de0650c8/konnectivity-agent/0.log" Jun 03 09:07:00.955965 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:00.955859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-22.ec2.internal_59c1ea0db4c1eed4c8a1ee0ed3fb18d2/haproxy/0.log" Jun 03 09:07:05.129366 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.129331 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp_53ee66c0-887d-48c1-81b8-b007b5bbcd1e/extract/0.log" Jun 03 09:07:05.154201 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.154161 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp_53ee66c0-887d-48c1-81b8-b007b5bbcd1e/util/0.log" Jun 03 09:07:05.201965 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.201936 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wsrsp_53ee66c0-887d-48c1-81b8-b007b5bbcd1e/pull/0.log" Jun 03 09:07:05.262066 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.262036 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5_c4656c86-3ee8-41a6-90b7-f2b56f58a9fc/extract/0.log" Jun 03 09:07:05.291913 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.291881 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5_c4656c86-3ee8-41a6-90b7-f2b56f58a9fc/util/0.log" Jun 03 09:07:05.322322 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.322290 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e06pwb5_c4656c86-3ee8-41a6-90b7-f2b56f58a9fc/pull/0.log" Jun 03 09:07:05.355833 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.355811 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl_8ed4ded8-6993-497b-8ac6-17c4ce1ea827/extract/0.log" Jun 03 09:07:05.390014 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.389947 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl_8ed4ded8-6993-497b-8ac6-17c4ce1ea827/util/0.log" Jun 03 09:07:05.422301 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.422274 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7372nwl_8ed4ded8-6993-497b-8ac6-17c4ce1ea827/pull/0.log" Jun 03 09:07:05.449006 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.448981 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6_e55faaf2-7418-4f44-af4d-f754ce36e4ca/extract/0.log" Jun 03 09:07:05.473569 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.473544 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6_e55faaf2-7418-4f44-af4d-f754ce36e4ca/util/0.log" Jun 03 09:07:05.503169 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.503145 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjcf6_e55faaf2-7418-4f44-af4d-f754ce36e4ca/pull/0.log" Jun 03 09:07:05.600724 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.600694 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-w9pjw_68cdcdba-40ce-4067-91db-fc7ad81d4ef4/manager/0.log" Jun 03 09:07:05.663614 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.663538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-dd9pj_92c35e43-a1a7-4b47-8d9b-49a5f5b2c86b/registry-server/0.log" Jun 03 09:07:05.725313 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:05.725278 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-zqc9c_80824cc5-1940-4405-92cf-26eb7553be33/manager/0.log" Jun 03 09:07:07.422743 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:07.422699 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tvrjr_ad75032a-57e6-4cb2-bfd3-0cffdfb25e44/kube-state-metrics/0.log" Jun 03 09:07:07.437597 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:07.437564 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tvrjr_ad75032a-57e6-4cb2-bfd3-0cffdfb25e44/kube-rbac-proxy-main/0.log" Jun 03 09:07:07.455334 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:07.455306 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-tvrjr_ad75032a-57e6-4cb2-bfd3-0cffdfb25e44/kube-rbac-proxy-self/0.log" Jun 03 09:07:07.510452 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:07.510407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-cz6ng_1d83a2c3-397f-4cd8-ace2-0ad0e89c7d8c/monitoring-plugin/0.log" Jun 03 09:07:07.708945 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:07.708863 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sv796_66782d44-0b01-4ebf-8081-3271f2e5bd9f/node-exporter/0.log" Jun 03 09:07:07.727650 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:07.727624 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sv796_66782d44-0b01-4ebf-8081-3271f2e5bd9f/kube-rbac-proxy/0.log" Jun 03 09:07:07.760999 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:07.760977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sv796_66782d44-0b01-4ebf-8081-3271f2e5bd9f/init-textfile/0.log" Jun 03 09:07:09.960293 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.960257 2561 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z"] Jun 03 09:07:09.964922 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.964899 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:09.968587 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.968559 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wkfg\"/\"kube-root-ca.crt\"" Jun 03 09:07:09.968740 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.968609 2561 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wkfg\"/\"openshift-service-ca.crt\"" Jun 03 09:07:09.970747 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.970721 2561 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9wkfg\"/\"default-dockercfg-2x4qf\"" Jun 03 09:07:09.971230 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.971199 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z"] Jun 03 09:07:09.984801 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.984772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-proc\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:09.984974 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.984815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-sys\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:09.984974 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.984837 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-lib-modules\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:09.984974 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.984862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm4sr\" (UniqueName: \"kubernetes.io/projected/239fbb16-f9fa-44e1-9382-0d59b845fbe3-kube-api-access-pm4sr\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:09.984974 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:09.984957 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-podres\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.063739 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.063709 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/2.log" Jun 03 09:07:10.070519 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.070493 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-fflk7_a921e6ac-45f3-4eda-bdd2-2303eb26b521/console-operator/3.log" Jun 03 09:07:10.086100 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086072 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-lib-modules\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086213 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086110 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pm4sr\" (UniqueName: \"kubernetes.io/projected/239fbb16-f9fa-44e1-9382-0d59b845fbe3-kube-api-access-pm4sr\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086213 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086165 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-podres\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086285 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086240 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-proc\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086325 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086282 2561 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-sys\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086371 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086358 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-proc\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086445 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086398 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-lib-modules\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086445 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086407 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-podres\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.086445 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.086409 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239fbb16-f9fa-44e1-9382-0d59b845fbe3-sys\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.095200 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.095177 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm4sr\" (UniqueName: \"kubernetes.io/projected/239fbb16-f9fa-44e1-9382-0d59b845fbe3-kube-api-access-pm4sr\") pod \"perf-node-gather-daemonset-kmr9z\" (UID: \"239fbb16-f9fa-44e1-9382-0d59b845fbe3\") " pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.279145 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.279065 2561 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.411964 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.411936 2561 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z"] Jun 03 09:07:10.413482 ip-10-0-138-22 kubenswrapper[2561]: W0603 09:07:10.413454 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod239fbb16_f9fa_44e1_9382_0d59b845fbe3.slice/crio-c09ab290a3bbd98017ec1f750d85b061decf7034e28065827721f0efb4f209d1 WatchSource:0}: Error finding container c09ab290a3bbd98017ec1f750d85b061decf7034e28065827721f0efb4f209d1: Status 404 returned error can't find the container with id c09ab290a3bbd98017ec1f750d85b061decf7034e28065827721f0efb4f209d1 Jun 03 09:07:10.596397 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.596352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8576dbc8df-wbpc5_3c8cf9aa-f318-470f-8131-1642bc188636/console/0.log" Jun 03 09:07:10.622829 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.622801 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-vg4x9_edd1698c-9075-4887-891d-45e96a973292/download-server/0.log" Jun 03 09:07:10.961218 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.961179 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" event={"ID":"239fbb16-f9fa-44e1-9382-0d59b845fbe3","Type":"ContainerStarted","Data":"08a2d7a76da992c106e18ed17df1ab947da4031987284bac3c1b4fd6c9e623e7"} Jun 03 09:07:10.961218 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.961220 2561 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" event={"ID":"239fbb16-f9fa-44e1-9382-0d59b845fbe3","Type":"ContainerStarted","Data":"c09ab290a3bbd98017ec1f750d85b061decf7034e28065827721f0efb4f209d1"} Jun 03 09:07:10.961679 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.961269 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:10.982282 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:10.982234 2561 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" podStartSLOduration=1.9822217530000001 podStartE2EDuration="1.982221753s" podCreationTimestamp="2026-06-03 09:07:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 09:07:10.979342048 +0000 UTC m=+1363.756837697" watchObservedRunningTime="2026-06-03 09:07:10.982221753 +0000 UTC m=+1363.759717391" Jun 03 09:07:11.119753 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:11.119726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-zbwmt_c0aad718-1000-4ab8-9e27-f7d088e3be32/volume-data-source-validator/0.log" Jun 03 09:07:11.979290 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:11.979259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zwpb7_9285be91-f419-4043-89c1-b29c044bc09a/dns/0.log" Jun 03 09:07:11.995731 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:11.995701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zwpb7_9285be91-f419-4043-89c1-b29c044bc09a/kube-rbac-proxy/0.log" Jun 03 09:07:12.059701 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:12.059678 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s5l7r_71bfcc55-0169-4fb1-b546-4839143aa713/dns-node-resolver/0.log" Jun 03 09:07:12.572779 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:12.572725 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-78878d788c-2c8rf_fecc3687-291a-43b4-ba39-f28b948012a5/registry/0.log" Jun 03 09:07:12.593208 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:12.593176 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5zl66_883f2d62-d81c-4308-808a-28ce50f3e7aa/node-ca/0.log" Jun 03 09:07:13.637569 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:13.637517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-vsgz5_241f365a-c5e3-4c34-a1e8-f6683fcd270b/istio-proxy/0.log" Jun 03 09:07:14.172291 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:14.172258 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4469f_26932fb2-d30f-4b60-8195-f92cd29aea4d/serve-healthcheck-canary/0.log" Jun 03 09:07:14.685947 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:14.685919 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-2fhnj_6770ff4a-0374-417d-924c-c0ab14114b3b/insights-operator/0.log" Jun 03 09:07:14.686350 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:14.686016 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-2fhnj_6770ff4a-0374-417d-924c-c0ab14114b3b/insights-operator/1.log" Jun 03 09:07:14.709010 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:14.708985 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4v6l_c8329638-ae1d-422e-a3c2-3c3dd311d788/kube-rbac-proxy/0.log" Jun 03 09:07:14.728922 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:14.728894 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4v6l_c8329638-ae1d-422e-a3c2-3c3dd311d788/exporter/0.log" Jun 03 09:07:14.754001 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:14.753979 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h4v6l_c8329638-ae1d-422e-a3c2-3c3dd311d788/extractor/0.log" Jun 03 09:07:16.926739 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:16.926707 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5c68945bf9-gx7fr_d995dfbc-bad9-4c86-ae37-3de6863b8c12/nginx/0.log" Jun 03 09:07:16.975272 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:16.975247 2561 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9wkfg/perf-node-gather-daemonset-kmr9z" Jun 03 09:07:17.308687 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:17.308644 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-f8lzd_c523232a-6fde-4352-b45e-4e34c477ec48/manager/0.log" Jun 03 09:07:17.327888 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:17.327867 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d95b9c768-f8lzd_c523232a-6fde-4352-b45e-4e34c477ec48/copy-manifests/0.log" Jun 03 09:07:17.400738 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:17.400703 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-wtssf_7efaa06d-a041-41c8-ab8b-1768fe1935a8/postgres/0.log" Jun 03 09:07:18.697401 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:18.697216 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-947794d7f-gll75_572c214c-8cda-456f-a539-696866db80b9/manager/0.log" Jun 03 09:07:18.719876 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:18.719850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-whgc6_73b8f46a-6d5a-41d8-b53b-ce30269bed06/openshift-lws-operator/0.log" Jun 03 09:07:23.517678 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:23.517642 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-ctmp4_7bca4d87-88ea-4acd-8a96-224acf268936/migrator/0.log" Jun 03 09:07:23.537004 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:23.536979 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-ctmp4_7bca4d87-88ea-4acd-8a96-224acf268936/graceful-termination/0.log" Jun 03 09:07:25.321213 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.321171 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msk8b_2595419f-cc17-491b-b4da-f0b2fb8e46cd/kube-multus-additional-cni-plugins/0.log" Jun 03 09:07:25.352842 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.352785 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msk8b_2595419f-cc17-491b-b4da-f0b2fb8e46cd/egress-router-binary-copy/0.log" Jun 03 09:07:25.380250 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.380221 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msk8b_2595419f-cc17-491b-b4da-f0b2fb8e46cd/cni-plugins/0.log" Jun 03 09:07:25.411777 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.411749 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msk8b_2595419f-cc17-491b-b4da-f0b2fb8e46cd/bond-cni-plugin/0.log" Jun 03 09:07:25.452521 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.452483 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msk8b_2595419f-cc17-491b-b4da-f0b2fb8e46cd/routeoverride-cni/0.log" Jun 03 09:07:25.486628 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.486595 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msk8b_2595419f-cc17-491b-b4da-f0b2fb8e46cd/whereabouts-cni-bincopy/0.log" Jun 03 09:07:25.520977 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.520949 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-msk8b_2595419f-cc17-491b-b4da-f0b2fb8e46cd/whereabouts-cni/0.log" Jun 03 09:07:25.590165 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.590097 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n27pg_3bbfaf1b-c060-48b7-8458-203eb93931a7/kube-multus/0.log" Jun 03 09:07:25.823350 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.823314 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q9mnc_d130f311-edd0-4255-869f-453deb319458/network-metrics-daemon/0.log" Jun 03 09:07:25.851340 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:25.851258 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-q9mnc_d130f311-edd0-4255-869f-453deb319458/kube-rbac-proxy/0.log" Jun 03 09:07:26.651117 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.651084 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-controller/0.log" Jun 03 09:07:26.669747 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.669714 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/0.log" Jun 03 09:07:26.684347 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.684318 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovn-acl-logging/1.log" Jun 03 09:07:26.707522 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.707454 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/kube-rbac-proxy-node/0.log" Jun 03 09:07:26.729588 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.729560 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 09:07:26.748993 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.748955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/northd/0.log" Jun 03 09:07:26.767064 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.767026 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/nbdb/0.log" Jun 03 09:07:26.788261 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.788235 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/sbdb/0.log" Jun 03 09:07:26.958110 ip-10-0-138-22 kubenswrapper[2561]: I0603 09:07:26.958024 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qbwn_a2e9e692-0e48-4cb3-8feb-82903feb8c8d/ovnkube-controller/0.log"