Jun 10 13:01:02.303392 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 13:01:02.303404 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 13:01:02.303411 ip-10-0-138-87 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 13:01:02.303550 ip-10-0-138-87 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 13:01:12.515762 ip-10-0-138-87 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 13:01:12.515777 ip-10-0-138-87 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 89c2f4fa265649119a94e9f839edd450 -- Jun 10 13:03:47.483628 ip-10-0-138-87 systemd[1]: Starting Kubernetes Kubelet... Jun 10 13:03:47.824051 ip-10-0-138-87 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:03:47.824051 ip-10-0-138-87 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 13:03:47.824051 ip-10-0-138-87 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:03:47.824051 ip-10-0-138-87 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 13:03:47.824051 ip-10-0-138-87 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 13:03:47.825661 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.825592 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 13:03:47.831371 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831357 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:47.831371 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831371 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831374 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831378 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831381 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831384 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831387 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831390 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831393 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831396 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831399 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831407 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831410 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831412 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831415 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831417 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831422 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831424 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831427 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831430 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831432 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:47.831434 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831435 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831438 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831441 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831443 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831446 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831449 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831452 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831455 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831457 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831460 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831463 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831465 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831468 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831470 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831473 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831475 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831478 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831480 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831483 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:47.831906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831485 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831489 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831493 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831496 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831499 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831501 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831504 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831506 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831509 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831511 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831514 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831517 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831519 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831522 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831524 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831527 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831530 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831533 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831535 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:47.832614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831538 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831542 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831545 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831548 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831551 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831554 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831557 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831560 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831562 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831565 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831567 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831570 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831573 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831575 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831578 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831580 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831583 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831586 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831589 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:47.833087 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831592 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831595 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831597 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831600 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831602 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831607 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831610 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831613 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831617 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831620 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831623 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831626 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831628 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831631 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831634 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831636 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831639 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831641 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831644 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831647 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:47.833735 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.831649 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:47.834279 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834250 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:47.834279 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834278 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834282 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834286 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834289 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834292 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834295 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834297 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834300 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834303 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834306 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834308 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834311 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834313 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834316 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834319 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834321 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834324 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834326 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834331 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834339 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:47.834344 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834342 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834345 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834348 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834350 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834353 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834356 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834359 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834361 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834364 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834366 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834369 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834372 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834374 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834377 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834381 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834384 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834387 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834390 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834392 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834395 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:47.834820 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834397 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834400 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834402 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834405 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834408 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834412 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834414 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834417 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834420 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834429 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834432 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834435 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834437 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834440 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834443 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834446 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834448 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834451 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834455 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:47.835318 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834458 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834461 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834463 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834467 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834470 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834472 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834475 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834478 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834480 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834483 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834485 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834488 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834490 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834494 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834498 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834501 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834503 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834506 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834509 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834511 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:47.835784 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834514 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834516 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834519 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834527 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834530 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834533 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834535 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834538 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834540 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834543 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834545 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834548 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834551 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834553 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834556 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834558 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834561 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834564 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834567 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834971 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:47.836299 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834976 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834979 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834982 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834985 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834987 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834990 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834993 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834996 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.834999 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835001 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835004 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835007 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835009 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835012 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835015 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835023 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835026 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835029 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835032 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835034 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:47.836785 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835037 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835040 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835044 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835048 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835051 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835054 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835056 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835059 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835062 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835064 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835067 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835070 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835072 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835075 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835077 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835080 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835083 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835085 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835087 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:47.837260 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835090 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835093 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835095 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835098 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835100 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835103 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835106 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835108 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835111 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835120 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835122 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835125 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835128 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835130 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835135 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835138 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835141 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835143 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835146 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:47.837794 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835148 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835151 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835153 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835156 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835158 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835161 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835163 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835168 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835170 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835172 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835175 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835178 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835181 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835184 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835187 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835189 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835192 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835194 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835197 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835199 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:47.838241 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835203 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835205 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835208 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835216 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835218 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835221 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835224 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835226 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835229 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835231 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835234 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835236 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835239 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835241 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835244 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835246 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835249 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835253 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835256 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:47.838745 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.835259 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835347 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835354 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835372 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835377 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835381 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835385 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835388 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835392 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835395 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835398 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835402 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835405 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835408 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835411 2558 flags.go:64] FLAG: --cgroup-root="" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835414 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835418 2558 flags.go:64] FLAG: --client-ca-file="" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835427 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835430 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835437 2558 flags.go:64] FLAG: --cluster-domain="" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835440 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835443 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835446 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835450 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 13:03:47.839231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835453 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835456 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835459 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835463 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835468 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835471 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835474 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835477 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835480 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835484 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835487 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835490 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835492 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835495 2558 flags.go:64] FLAG: --enable-server="true" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835498 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835506 2558 flags.go:64] FLAG: --event-burst="100" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835509 2558 flags.go:64] FLAG: --event-qps="50" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835512 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835515 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835518 2558 flags.go:64] FLAG: --eviction-hard="" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835522 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835525 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835528 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835531 2558 flags.go:64] FLAG: --eviction-soft="" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835534 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 13:03:47.839836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835536 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835545 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835548 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835551 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835554 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835557 2558 flags.go:64] FLAG: --feature-gates="" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835560 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835563 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835566 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835569 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835572 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835579 2558 flags.go:64] FLAG: --help="false" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835582 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-87.ec2.internal" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835585 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835588 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835591 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835594 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835597 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835600 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835603 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835605 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835608 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835611 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835615 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 13:03:47.840461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835618 2558 flags.go:64] FLAG: --kube-reserved="" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835620 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835623 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835627 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835630 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835633 2558 flags.go:64] FLAG: --lock-file="" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835636 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835639 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835642 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835647 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835656 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835659 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835662 2558 flags.go:64] FLAG: --logging-format="text" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835665 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835668 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835671 2558 flags.go:64] FLAG: --manifest-url="" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835674 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835678 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835681 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835687 2558 flags.go:64] FLAG: --max-pods="110" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835690 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835693 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835696 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835698 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835701 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 13:03:47.841045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835704 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835708 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835714 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835717 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835720 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835723 2558 flags.go:64] FLAG: --pod-cidr="" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835726 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835732 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835735 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835738 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835740 2558 flags.go:64] FLAG: --port="10250" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835743 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835746 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09ae9207497b0c4e3" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835749 2558 flags.go:64] FLAG: --qos-reserved="" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835752 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835754 2558 flags.go:64] FLAG: --register-node="true" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835757 2558 flags.go:64] FLAG: --register-with-taints="" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835761 2558 flags.go:64] FLAG: --registry-burst="10" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835769 2558 flags.go:64] FLAG: --registry-qps="5" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835773 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835775 2558 flags.go:64] FLAG: --reserved-memory="" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835779 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835782 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835785 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835787 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 13:03:47.841690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835790 2558 flags.go:64] FLAG: --runonce="false" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835795 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835798 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835801 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835803 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835806 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835809 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835812 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835815 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835818 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835820 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835823 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835826 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835829 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835832 2558 flags.go:64] FLAG: --system-cgroups="" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835834 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835840 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835843 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835845 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835853 2558 flags.go:64] FLAG: --tls-min-version="" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835855 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835858 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835861 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835863 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835866 2558 flags.go:64] FLAG: --v="2" Jun 10 13:03:47.842320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835870 2558 flags.go:64] FLAG: --version="false" Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835879 2558 flags.go:64] FLAG: --vmodule="" Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835883 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.835887 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836017 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836021 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836025 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836028 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836031 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836034 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836037 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836040 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836043 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836046 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836049 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836052 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836055 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836058 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836060 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836063 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836066 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:47.842919 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836068 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836071 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836073 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836076 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836080 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836084 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836088 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836092 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836094 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836097 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836100 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836102 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836105 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836108 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836110 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836113 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836115 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836118 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836120 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:47.843438 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836123 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836125 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836128 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836130 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836133 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836135 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836138 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836140 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836143 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836145 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836148 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836151 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836154 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836156 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836159 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836161 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836164 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836166 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836169 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836172 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:47.843895 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836175 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836177 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836180 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836182 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836185 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836187 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836190 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836193 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836195 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836198 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836200 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836203 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836205 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836210 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836213 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836215 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836219 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836223 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836226 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:47.844396 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836228 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836231 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836234 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836236 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836239 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836242 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836245 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836248 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836250 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836280 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836285 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836288 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836291 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836294 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836297 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836299 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836302 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836305 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836307 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836310 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:47.844856 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836313 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836316 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836319 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.836322 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.837050 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.843214 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.843326 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.843954 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.843961 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844029 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844034 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844038 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844041 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844043 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844046 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:47.845349 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844049 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844053 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844055 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844058 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844060 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844063 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844066 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844069 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844072 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844074 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844077 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844080 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844082 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844084 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844087 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844089 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844092 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844095 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844097 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844100 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:47.845711 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844102 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844105 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844107 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844111 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844114 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844118 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844122 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844125 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844127 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844130 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844133 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844136 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844138 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844141 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844144 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844146 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844149 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844151 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844154 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844156 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:47.846202 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844159 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844162 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844165 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844168 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844170 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844173 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844175 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844178 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844180 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844183 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844186 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844188 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844191 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844193 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844196 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844199 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844202 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844204 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844207 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:47.846777 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844209 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844212 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844214 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844217 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844219 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844222 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844227 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844230 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844233 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844236 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844239 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844241 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844244 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844247 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844250 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844253 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844256 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844258 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844261 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:47.847291 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844278 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844281 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844284 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844286 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844289 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844293 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844296 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844299 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844302 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844305 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844308 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844315 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844318 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844321 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844324 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:47.847747 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.844329 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844441 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844446 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844449 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844452 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844455 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844457 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844460 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844463 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844465 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844468 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844470 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844473 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844475 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844478 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844480 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844483 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844485 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844488 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844490 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 13:03:47.848109 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844493 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844495 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844498 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844501 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844503 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844505 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844508 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844512 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844516 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844520 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844522 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844525 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844528 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844531 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844533 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844535 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844539 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844542 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844545 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 13:03:47.848620 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844547 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844550 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844553 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844555 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844558 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844560 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844563 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844565 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844568 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844570 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844573 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844575 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844578 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844580 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844583 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844585 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844588 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844590 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844593 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 13:03:47.849085 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844596 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844599 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844601 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844604 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844607 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844609 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844612 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844614 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844617 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844619 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844622 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844624 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844627 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844629 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844631 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844634 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844638 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844641 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844644 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844647 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 13:03:47.849654 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844650 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844653 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844656 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844659 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844662 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844665 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844667 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844670 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844673 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844675 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844678 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844680 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844683 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844685 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844688 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844690 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844692 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844695 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844698 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844700 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 13:03:47.850142 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844703 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:47.844706 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.844713 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.844808 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.846857 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.848035 2558 server.go:1019] "Starting client certificate rotation" Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.848134 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.848172 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 13:03:47.850648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.850252 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:03:47.851778 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.851644 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 13:03:47.862872 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.862856 2558 log.go:25] "Validated CRI v1 runtime API" Jun 10 13:03:47.865588 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.865574 2558 log.go:25] "Validated CRI v1 image API" Jun 10 13:03:47.866484 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.866470 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 13:03:47.869476 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.869458 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b75ec2ab-d1b2-4016-9909-364d670be366:/dev/nvme0n1p4 e9bcae20-4030-4170-aab4-16ec837ed984:/dev/nvme0n1p3] Jun 10 13:03:47.869524 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.869476 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 13:03:47.874622 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.874513 2558 manager.go:216] Machine: {Timestamp:2026-06-10 13:03:47.873200392 +0000 UTC m=+0.284594966 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101746 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e2a649bdedd91dd9f9cf9c6c4d49 SystemUUID:ec26e2a6-49bd-edd9-1dd9-f9cf9c6c4d49 BootID:89c2f4fa-2656-4911-9a94-e9f839edd450 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:24:30:88:38:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:24:30:88:38:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:46:b1:9f:1b:1f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 13:03:47.874622 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.874618 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 13:03:47.874739 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.874688 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 13:03:47.876894 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.876870 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 13:03:47.877072 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.876895 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-87.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 13:03:47.877122 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.877096 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:03:47.878128 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.878117 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 13:03:47.878160 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.878131 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 13:03:47.878160 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.878143 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:03:47.878729 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.878719 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 13:03:47.879586 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.879576 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 13:03:47.882253 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882241 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:03:47.882376 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882367 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 13:03:47.882412 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882396 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 10 13:03:47.882412 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882412 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 13:03:47.882512 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882429 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 13:03:47.882512 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882440 2558 kubelet.go:398] "Adding apiserver pod source" Jun 10 13:03:47.882512 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882451 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 13:03:47.882769 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882757 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:03:47.882822 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.882776 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 13:03:47.884626 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.884612 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 13:03:47.886448 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.886434 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 13:03:47.886516 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.886464 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 13:03:47.887436 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887426 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 13:03:47.887473 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887440 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 13:03:47.887473 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887447 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 13:03:47.887473 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887452 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 13:03:47.887473 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887461 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 13:03:47.887581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887478 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 13:03:47.887581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887488 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 13:03:47.887581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887493 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 13:03:47.887581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887499 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 13:03:47.887581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887504 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 13:03:47.887581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887520 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 13:03:47.887581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.887525 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 13:03:47.888715 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.888702 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 13:03:47.888715 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.888716 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 13:03:47.891673 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.891655 2558 server.go:1268] "Started kubelet" Jun 10 13:03:47.891801 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.891756 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 13:03:47.891860 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.891846 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 13:03:47.892104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.892078 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 13:03:47.892529 ip-10-0-138-87 systemd[1]: Started Kubernetes Kubelet. Jun 10 13:03:47.894465 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.894438 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 13:03:47.896790 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.896556 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-87.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 13:03:47.897436 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.897257 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 13:03:47.897910 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.897886 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 10 13:03:47.899152 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.899131 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 13:03:47.899452 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.899434 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7dx6c" Jun 10 13:03:47.901223 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.901205 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 13:03:47.902435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.902417 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 13:03:47.902523 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.902419 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 13:03:47.902577 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.902525 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:47.903041 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903025 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 13:03:47.903041 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903041 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 13:03:47.903190 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903025 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 13:03:47.903190 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903161 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 10 13:03:47.903190 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903168 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 10 13:03:47.903341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903245 2558 factory.go:55] Registering systemd factory Jun 10 13:03:47.903341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903261 2558 factory.go:223] Registration of the systemd container factory successfully Jun 10 13:03:47.903828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903813 2558 factory.go:153] Registering CRI-O factory Jun 10 13:03:47.903828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903827 2558 factory.go:223] Registration of the crio container factory successfully Jun 10 13:03:47.903941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903880 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 13:03:47.903941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903903 2558 factory.go:103] Registering Raw factory Jun 10 13:03:47.903941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.903918 2558 manager.go:1196] Started watching for new ooms in manager Jun 10 13:03:47.904374 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.904353 2558 manager.go:349] Starting recovery of all containers Jun 10 13:03:47.907443 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.907417 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 13:03:47.907734 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.907713 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7dx6c" Jun 10 13:03:47.908003 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.907983 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-87.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 13:03:47.908523 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.907572 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-87.ec2.internal.18b7b9f248206f9f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-87.ec2.internal,UID:ip-10-0-138-87.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-87.ec2.internal,},FirstTimestamp:2026-06-10 13:03:47.891629983 +0000 UTC m=+0.303024559,LastTimestamp:2026-06-10 13:03:47.891629983 +0000 UTC m=+0.303024559,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-87.ec2.internal,}" Jun 10 13:03:47.915899 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.915883 2558 manager.go:354] Recovery completed Jun 10 13:03:47.920141 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.920130 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:47.921860 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.921846 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:47.921934 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.921873 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:47.921934 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.921883 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:47.922337 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.922323 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:47.922420 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.922323 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 13:03:47.922420 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.922387 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 13:03:47.922420 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.922405 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 10 13:03:47.923012 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.922996 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:47.923074 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.923023 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:47.923074 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.923033 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:47.923396 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.923384 2558 policy_none.go:49] "None policy: Start" Jun 10 13:03:47.923446 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.923401 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 13:03:47.923446 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.923415 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 13:03:47.924354 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.924341 2558 policy_none.go:47] "Start" Jun 10 13:03:47.971872 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.971858 2558 manager.go:337] "Starting Device Plugin manager" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.971894 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.971904 2558 server.go:87] "Starting device plugin registration server" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.972128 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.972141 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.972230 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.972327 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.972336 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.972999 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.973044 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.976866 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.977929 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.977966 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.977984 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 13:03:47.978165 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:47.978013 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 13:03:47.979653 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:47.979630 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:48.072728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.072708 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:48.073547 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.073529 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:48.073613 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.073566 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:48.073613 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.073583 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:48.073613 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.073606 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.078283 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.078232 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal"] Jun 10 13:03:48.078350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.078294 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:48.079874 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.079859 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.079952 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.079881 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-87.ec2.internal\": node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.080908 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.080896 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:48.080960 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.080919 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:48.080960 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.080929 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:48.083296 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083282 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:48.083385 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.083433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083397 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:48.083932 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083917 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:48.083932 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083925 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:48.084056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083948 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:48.084056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083968 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:48.084056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.083949 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:48.084056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.084021 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:48.086095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.086079 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.086169 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.086108 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 13:03:48.086705 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.086686 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientMemory" Jun 10 13:03:48.086787 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.086716 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 13:03:48.086787 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.086730 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeHasSufficientPID" Jun 10 13:03:48.093245 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.093230 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.104259 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.104238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fb07b914d529e0d28e0b79b4f8456ed-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"2fb07b914d529e0d28e0b79b4f8456ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.104329 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.104260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.104329 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.104292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.107805 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.107792 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-87.ec2.internal\" not found" node="ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.112052 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.112035 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-87.ec2.internal\" not found" node="ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.193311 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.193291 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.204662 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.204646 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fb07b914d529e0d28e0b79b4f8456ed-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"2fb07b914d529e0d28e0b79b4f8456ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.204731 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.204668 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.204731 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.204685 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.204802 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.204735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.204802 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.204752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2fb07b914d529e0d28e0b79b4f8456ed-config\") pod \"kube-apiserver-proxy-ip-10-0-138-87.ec2.internal\" (UID: \"2fb07b914d529e0d28e0b79b4f8456ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.204802 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.204763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d39722b944d26a5edbc396c94a76c862-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal\" (UID: \"d39722b944d26a5edbc396c94a76c862\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.294238 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.294219 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.394966 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.394913 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.414418 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.414402 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.419176 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.418807 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 10 13:03:48.495018 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.494998 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.595487 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.595462 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.695971 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.695918 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.794752 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.794728 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:48.796385 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.796368 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.847846 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.847828 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 13:03:48.848407 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.847937 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:03:48.848407 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.847992 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 13:03:48.897275 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.897242 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:48.910418 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.910379 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 12:58:47 +0000 UTC" deadline="2028-01-09 00:21:16.994385592 +0000 UTC" Jun 10 13:03:48.910418 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:48.910416 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13859h17m28.083973304s" Jun 10 13:03:48.997682 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:48.997663 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:49.007822 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:49.007800 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39722b944d26a5edbc396c94a76c862.slice/crio-f9fba286c9fa113b4317f49b0d74a73571453c466792022f66a8ed6b649511d9 WatchSource:0}: Error finding container f9fba286c9fa113b4317f49b0d74a73571453c466792022f66a8ed6b649511d9: Status 404 returned error can't find the container with id f9fba286c9fa113b4317f49b0d74a73571453c466792022f66a8ed6b649511d9 Jun 10 13:03:49.012742 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.012729 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:03:49.049008 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:49.048989 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb07b914d529e0d28e0b79b4f8456ed.slice/crio-5101cbc8f2faa826f56f7c7b9d1a35e5ee99055180dfe5aa75a352cf6936b5cf WatchSource:0}: Error finding container 5101cbc8f2faa826f56f7c7b9d1a35e5ee99055180dfe5aa75a352cf6936b5cf: Status 404 returned error can't find the container with id 5101cbc8f2faa826f56f7c7b9d1a35e5ee99055180dfe5aa75a352cf6936b5cf Jun 10 13:03:49.098707 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:49.098689 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:49.196922 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.196904 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:49.198953 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:49.198931 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:49.299613 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:49.299548 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:49.400256 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:49.400222 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-87.ec2.internal\" not found" Jun 10 13:03:49.477740 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.477713 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:49.503604 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.503577 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" Jun 10 13:03:49.515401 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.515370 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:03:49.516674 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.516654 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" Jun 10 13:03:49.523732 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.523677 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 13:03:49.883889 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.883852 2558 apiserver.go:52] "Watching apiserver" Jun 10 13:03:49.892083 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.892054 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 13:03:49.893966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.892683 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-xghct","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4","openshift-dns/node-resolver-4n29w","openshift-image-registry/node-ca-nxc4h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal","openshift-multus/network-metrics-daemon-v7qj9","openshift-network-operator/iptables-alerter-7dl7f","openshift-ovn-kubernetes/ovnkube-node-lrmgf","kube-system/global-pull-secret-syncer-pj8zt","kube-system/konnectivity-agent-c2ssx","kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6jwhp","openshift-multus/multus-additional-cni-plugins-bp5zq","openshift-multus/multus-tz85n"] Jun 10 13:03:49.895823 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.895803 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:49.898050 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.898028 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.898971 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.898947 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 13:03:49.899154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.899139 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:03:49.899348 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.899329 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 13:03:49.899463 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.899376 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5qss6\"" Jun 10 13:03:49.901348 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.900616 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:49.901348 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.900818 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 13:03:49.901348 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.901020 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 13:03:49.901583 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.901420 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 13:03:49.901583 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.901546 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-88fnp\"" Jun 10 13:03:49.901688 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.901671 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 13:03:49.901990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.901780 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 13:03:49.901990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.901805 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 13:03:49.902707 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.902686 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:49.903431 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.903236 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 13:03:49.903431 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.903248 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 13:03:49.903431 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.903371 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 13:03:49.903662 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.903624 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hqx5z\"" Jun 10 13:03:49.905681 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.904953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:49.905681 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:49.905018 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:03:49.905681 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.905416 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gp4pg\"" Jun 10 13:03:49.905681 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.905418 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 13:03:49.905871 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.905833 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 13:03:49.905871 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.905844 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 13:03:49.907715 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.907697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:49.907805 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:49.907770 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:03:49.911584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.911567 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:49.911679 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:49.911641 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:03:49.913533 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913514 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:49.913863 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-node-log\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.913947 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-cni-bin\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.913947 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-ovnkube-script-lib\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.913947 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913927 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75815153-68d2-46a9-92f6-0c997d983cbe-hosts-file\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:49.914095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c61d86b-d255-405a-923b-0d6c54c4fc02-iptables-alerter-script\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:49.914095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-log-socket\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.913998 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-cni-netd\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-ovnkube-config\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914085 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04b546b1-6628-469e-a3ff-069e3eb95876-ovn-node-metrics-cert\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7v2z\" (UniqueName: \"kubernetes.io/projected/04b546b1-6628-469e-a3ff-069e3eb95876-kube-api-access-l7v2z\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75815153-68d2-46a9-92f6-0c997d983cbe-tmp-dir\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-run-netns\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914216 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wn4\" (UniqueName: \"kubernetes.io/projected/75815153-68d2-46a9-92f6-0c997d983cbe-kube-api-access-86wn4\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914252 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9ng8\" (UniqueName: \"kubernetes.io/projected/5c61d86b-d255-405a-923b-0d6c54c4fc02-kube-api-access-w9ng8\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914290 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-kubelet\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914323 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qtt\" (UniqueName: \"kubernetes.io/projected/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-kube-api-access-j2qtt\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-env-overrides\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-host\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-systemd-units\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c61d86b-d255-405a-923b-0d6c54c4fc02-host-slash\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-slash\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-systemd\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-var-lib-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-etc-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914614 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-serviceca\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914638 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:49.914851 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.914701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-ovn\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:49.915830 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.915811 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:49.916231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.916118 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 13:03:49.916659 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.916554 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 13:03:49.916659 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.916560 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 13:03:49.916804 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.916757 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 13:03:49.916804 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.916788 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 13:03:49.916903 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.916829 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bnjj\"" Jun 10 13:03:49.918616 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.918196 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:49.918616 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.918473 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-28rbg\"" Jun 10 13:03:49.918905 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.918804 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 13:03:49.918905 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.918895 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 13:03:49.919075 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.918900 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 13:03:49.919075 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.919004 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 13:03:49.921104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.920899 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tz85n" Jun 10 13:03:49.921680 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.921661 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 13:03:49.921822 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.921778 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 13:03:49.922004 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.921970 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-frf67\"" Jun 10 13:03:49.927071 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.923766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:49.927071 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.925114 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 13:03:49.927071 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.925467 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6gvql\"" Jun 10 13:03:49.927250 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.927098 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:03:49.928023 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.928004 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j46nh\"" Jun 10 13:03:49.928152 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.928062 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 13:03:49.943620 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.943601 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nnkp5" Jun 10 13:03:49.951126 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.951107 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nnkp5" Jun 10 13:03:49.982872 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.982826 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" event={"ID":"2fb07b914d529e0d28e0b79b4f8456ed","Type":"ContainerStarted","Data":"5101cbc8f2faa826f56f7c7b9d1a35e5ee99055180dfe5aa75a352cf6936b5cf"} Jun 10 13:03:49.984157 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:49.984132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"d39722b944d26a5edbc396c94a76c862","Type":"ContainerStarted","Data":"f9fba286c9fa113b4317f49b0d74a73571453c466792022f66a8ed6b649511d9"} Jun 10 13:03:50.004568 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.004541 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 13:03:50.015507 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-conf-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.015600 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-ovn\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015600 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-ovnkube-script-lib\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015600 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.015733 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015607 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysctl-d\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.015733 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015633 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-ovn\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015733 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015672 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-tuned\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.015733 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-log-socket\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015733 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-cni-netd\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015761 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-log-socket\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015759 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-ovnkube-config\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-cni-netd\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04b546b1-6628-469e-a3ff-069e3eb95876-ovn-node-metrics-cert\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.015911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-system-cni-dir\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.015911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.015911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-registration-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015926 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-os-release\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.015971 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75815153-68d2-46a9-92f6-0c997d983cbe-tmp-dir\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab-agent-certs\") pod \"konnectivity-agent-c2ssx\" (UID: \"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab\") " pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016029 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab-konnectivity-ca\") pod \"konnectivity-agent-c2ssx\" (UID: \"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab\") " pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-run-netns\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-cni-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d07f9d-bbdc-49e0-b342-92e4bed30321-cni-binary-copy\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016188 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-hostroot\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-run\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.016257 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-ovnkube-script-lib\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9ng8\" (UniqueName: \"kubernetes.io/projected/5c61d86b-d255-405a-923b-0d6c54c4fc02-kube-api-access-w9ng8\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-ovnkube-config\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016323 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsr8f\" (UniqueName: \"kubernetes.io/projected/3e749ed5-22cf-42a3-ac31-798f3978f9db-kube-api-access-hsr8f\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75815153-68d2-46a9-92f6-0c997d983cbe-tmp-dir\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92svs\" (UniqueName: \"kubernetes.io/projected/fbdb3360-ceb4-454a-b2b7-c042c665efbf-kube-api-access-92svs\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-host\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-run-netns\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016470 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016506 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016530 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-host\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4zpn\" (UniqueName: \"kubernetes.io/projected/be680182-961b-404d-bbcd-48e9488556ab-kube-api-access-q4zpn\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-cni-multus\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysconfig\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-var-lib-kubelet\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016739 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-etc-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.016924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-serviceca\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016797 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-etc-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-socket-dir-parent\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-daemon-config\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.016986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-host\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-node-log\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017303 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-cni-bin\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75815153-68d2-46a9-92f6-0c997d983cbe-hosts-file\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017116 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-node-log\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-serviceca\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-os-release\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017392 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-cni-bin\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017436 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/75815153-68d2-46a9-92f6-0c997d983cbe-hosts-file\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017443 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqtnm\" (UniqueName: \"kubernetes.io/projected/69d07f9d-bbdc-49e0-b342-92e4bed30321-kube-api-access-mqtnm\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c61d86b-d255-405a-923b-0d6c54c4fc02-iptables-alerter-script\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017505 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.017711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017575 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-run-ovn-kubernetes\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-netns\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-cni-bin\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-etc-kubernetes\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-kubernetes\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7v2z\" (UniqueName: \"kubernetes.io/projected/04b546b1-6628-469e-a3ff-069e3eb95876-kube-api-access-l7v2z\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-device-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-system-cni-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-k8s-cni-cncf-io\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86wn4\" (UniqueName: \"kubernetes.io/projected/75815153-68d2-46a9-92f6-0c997d983cbe-kube-api-access-86wn4\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-kubelet\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-multus-certs\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017935 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysctl-conf\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.017959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbdb3360-ceb4-454a-b2b7-c042c665efbf-tmp\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c61d86b-d255-405a-923b-0d6c54c4fc02-iptables-alerter-script\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:50.018435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018072 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-kubelet\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qtt\" (UniqueName: \"kubernetes.io/projected/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-kube-api-access-j2qtt\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018118 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-kubelet\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018160 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-sys-fs\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-modprobe-d\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-env-overrides\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018235 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z95k\" (UniqueName: \"kubernetes.io/projected/104639b3-1c70-4ec1-897d-c8abf5be1dd3-kube-api-access-7z95k\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d19bf21-6f90-411e-8268-61e8d42366be-kubelet-config\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d19bf21-6f90-411e-8268-61e8d42366be-dbus\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018372 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-systemd\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018416 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-lib-modules\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018447 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-systemd-units\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-cnibin\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-systemd-units\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-socket-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-sys\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.019197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c61d86b-d255-405a-923b-0d6c54c4fc02-host-slash\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018615 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04b546b1-6628-469e-a3ff-069e3eb95876-env-overrides\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-slash\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018650 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c61d86b-d255-405a-923b-0d6c54c4fc02-host-slash\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-systemd\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018667 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-slash\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-var-lib-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018709 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-run-systemd\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-var-lib-openvswitch\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018781 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-cnibin\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.019943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.018841 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04b546b1-6628-469e-a3ff-069e3eb95876-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.020427 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.020032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04b546b1-6628-469e-a3ff-069e3eb95876-ovn-node-metrics-cert\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.025767 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.025739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9ng8\" (UniqueName: \"kubernetes.io/projected/5c61d86b-d255-405a-923b-0d6c54c4fc02-kube-api-access-w9ng8\") pod \"iptables-alerter-7dl7f\" (UID: \"5c61d86b-d255-405a-923b-0d6c54c4fc02\") " pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:50.026797 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.026780 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7v2z\" (UniqueName: \"kubernetes.io/projected/04b546b1-6628-469e-a3ff-069e3eb95876-kube-api-access-l7v2z\") pod \"ovnkube-node-lrmgf\" (UID: \"04b546b1-6628-469e-a3ff-069e3eb95876\") " pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.027927 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.027909 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:50.028004 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.027932 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:50.028004 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.027945 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dk8hh for pod openshift-network-diagnostics/network-check-target-xghct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:50.028088 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.028028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh podName:ef2fddae-c747-4edc-a347-5e48608f2b78 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:50.52799305 +0000 UTC m=+2.939387627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dk8hh" (UniqueName: "kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh") pod "network-check-target-xghct" (UID: "ef2fddae-c747-4edc-a347-5e48608f2b78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:50.030171 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.030140 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qtt\" (UniqueName: \"kubernetes.io/projected/7f59a632-66ab-4eeb-b763-dcd0d57fbf67-kube-api-access-j2qtt\") pod \"node-ca-nxc4h\" (UID: \"7f59a632-66ab-4eeb-b763-dcd0d57fbf67\") " pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:50.030260 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.030206 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wn4\" (UniqueName: \"kubernetes.io/projected/75815153-68d2-46a9-92f6-0c997d983cbe-kube-api-access-86wn4\") pod \"node-resolver-4n29w\" (UID: \"75815153-68d2-46a9-92f6-0c997d983cbe\") " pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:50.119540 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-netns\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-cni-bin\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-etc-kubernetes\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119600 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-kubernetes\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-netns\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119644 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-cni-bin\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-device-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-device-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-etc-kubernetes\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.119711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119708 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-system-cni-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119730 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-kubernetes\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-k8s-cni-cncf-io\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-kubelet\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-multus-certs\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysctl-conf\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbdb3360-ceb4-454a-b2b7-c042c665efbf-tmp\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119844 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-kubelet\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-k8s-cni-cncf-io\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-sys-fs\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-modprobe-d\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119945 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-sys-fs\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119955 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z95k\" (UniqueName: \"kubernetes.io/projected/104639b3-1c70-4ec1-897d-c8abf5be1dd3-kube-api-access-7z95k\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119974 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-run-multus-certs\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d19bf21-6f90-411e-8268-61e8d42366be-kubelet-config\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d19bf21-6f90-411e-8268-61e8d42366be-dbus\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.120154 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-systemd\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-lib-modules\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysctl-conf\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.119811 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-system-cni-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120075 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-cnibin\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-socket-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120123 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-sys\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-cnibin\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-conf-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysctl-d\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-tuned\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-system-cni-dir\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120365 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-cnibin\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120366 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-registration-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.120921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2d19bf21-6f90-411e-8268-61e8d42366be-kubelet-config\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120438 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120485 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-socket-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120487 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-sys\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120524 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-cnibin\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-modprobe-d\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysctl-d\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-systemd\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120571 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-conf-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3e749ed5-22cf-42a3-ac31-798f3978f9db-registration-dir\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-system-cni-dir\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-os-release\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120616 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-lib-modules\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab-agent-certs\") pod \"konnectivity-agent-c2ssx\" (UID: \"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab\") " pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab-konnectivity-ca\") pod \"konnectivity-agent-c2ssx\" (UID: \"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab\") " pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-cni-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d07f9d-bbdc-49e0-b342-92e4bed30321-cni-binary-copy\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.121845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120730 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-os-release\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-hostroot\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-run\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsr8f\" (UniqueName: \"kubernetes.io/projected/3e749ed5-22cf-42a3-ac31-798f3978f9db-kube-api-access-hsr8f\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92svs\" (UniqueName: \"kubernetes.io/projected/fbdb3360-ceb4-454a-b2b7-c042c665efbf-kube-api-access-92svs\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120823 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2d19bf21-6f90-411e-8268-61e8d42366be-dbus\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120844 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120868 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4zpn\" (UniqueName: \"kubernetes.io/projected/be680182-961b-404d-bbcd-48e9488556ab-kube-api-access-q4zpn\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-cni-multus\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysconfig\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-var-lib-kubelet\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-socket-dir-parent\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.120990 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-daemon-config\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-host\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121079 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-os-release\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121136 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqtnm\" (UniqueName: \"kubernetes.io/projected/69d07f9d-bbdc-49e0-b342-92e4bed30321-kube-api-access-mqtnm\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.122745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121145 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121164 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121199 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121214 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-host-var-lib-cni-multus\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-run\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121345 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab-konnectivity-ca\") pod \"konnectivity-agent-c2ssx\" (UID: \"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab\") " pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-cni-dir\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-hostroot\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-var-lib-kubelet\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121568 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-socket-dir-parent\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121704 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/be680182-961b-404d-bbcd-48e9488556ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121763 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/be680182-961b-404d-bbcd-48e9488556ab-os-release\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121766 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-sysconfig\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbdb3360-ceb4-454a-b2b7-c042c665efbf-host\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.121846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69d07f9d-bbdc-49e0-b342-92e4bed30321-cni-binary-copy\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.121852 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:50.123564 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.121859 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:50.124338 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.121935 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret podName:2d19bf21-6f90-411e-8268-61e8d42366be nodeName:}" failed. No retries permitted until 2026-06-10 13:03:50.621916583 +0000 UTC m=+3.033311166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret") pod "global-pull-secret-syncer-pj8zt" (UID: "2d19bf21-6f90-411e-8268-61e8d42366be") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:50.124338 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.122005 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs podName:104639b3-1c70-4ec1-897d-c8abf5be1dd3 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:50.621987931 +0000 UTC m=+3.033382492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs") pod "network-metrics-daemon-v7qj9" (UID: "104639b3-1c70-4ec1-897d-c8abf5be1dd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:50.124338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.122034 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69d07f9d-bbdc-49e0-b342-92e4bed30321-multus-daemon-config\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.124338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.123389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbdb3360-ceb4-454a-b2b7-c042c665efbf-etc-tuned\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.124338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.123392 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab-agent-certs\") pod \"konnectivity-agent-c2ssx\" (UID: \"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab\") " pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:50.124338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.124043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbdb3360-ceb4-454a-b2b7-c042c665efbf-tmp\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.131894 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.131836 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z95k\" (UniqueName: \"kubernetes.io/projected/104639b3-1c70-4ec1-897d-c8abf5be1dd3-kube-api-access-7z95k\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:50.132959 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.132867 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsr8f\" (UniqueName: \"kubernetes.io/projected/3e749ed5-22cf-42a3-ac31-798f3978f9db-kube-api-access-hsr8f\") pod \"aws-ebs-csi-driver-node-5sxt4\" (UID: \"3e749ed5-22cf-42a3-ac31-798f3978f9db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.133577 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.133555 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92svs\" (UniqueName: \"kubernetes.io/projected/fbdb3360-ceb4-454a-b2b7-c042c665efbf-kube-api-access-92svs\") pod \"tuned-6jwhp\" (UID: \"fbdb3360-ceb4-454a-b2b7-c042c665efbf\") " pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.134008 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.133878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4zpn\" (UniqueName: \"kubernetes.io/projected/be680182-961b-404d-bbcd-48e9488556ab-kube-api-access-q4zpn\") pod \"multus-additional-cni-plugins-bp5zq\" (UID: \"be680182-961b-404d-bbcd-48e9488556ab\") " pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.135037 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.135013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqtnm\" (UniqueName: \"kubernetes.io/projected/69d07f9d-bbdc-49e0-b342-92e4bed30321-kube-api-access-mqtnm\") pod \"multus-tz85n\" (UID: \"69d07f9d-bbdc-49e0-b342-92e4bed30321\") " pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.210688 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.210658 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7dl7f" Jun 10 13:03:50.219515 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.219494 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:03:50.230138 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.230121 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4n29w" Jun 10 13:03:50.235759 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.235743 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nxc4h" Jun 10 13:03:50.243420 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.243404 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" Jun 10 13:03:50.250998 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.250980 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" Jun 10 13:03:50.258505 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.258489 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:03:50.266987 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.266966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tz85n" Jun 10 13:03:50.273541 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.273524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" Jun 10 13:03:50.430179 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.430098 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:50.623561 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.623531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:50.623708 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.623584 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:50.623708 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.623616 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:50.623708 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623667 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:50.623708 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623694 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:50.623708 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623709 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dk8hh for pod openshift-network-diagnostics/network-check-target-xghct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:50.623950 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623718 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:50.623950 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623733 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:50.623950 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623762 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh podName:ef2fddae-c747-4edc-a347-5e48608f2b78 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:51.623748755 +0000 UTC m=+4.035143321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dk8hh" (UniqueName: "kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh") pod "network-check-target-xghct" (UID: "ef2fddae-c747-4edc-a347-5e48608f2b78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:50.623950 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623787 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret podName:2d19bf21-6f90-411e-8268-61e8d42366be nodeName:}" failed. No retries permitted until 2026-06-10 13:03:51.62377088 +0000 UTC m=+4.035165456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret") pod "global-pull-secret-syncer-pj8zt" (UID: "2d19bf21-6f90-411e-8268-61e8d42366be") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:50.623950 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:50.623806 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs podName:104639b3-1c70-4ec1-897d-c8abf5be1dd3 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:51.623796289 +0000 UTC m=+4.035190857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs") pod "network-metrics-daemon-v7qj9" (UID: "104639b3-1c70-4ec1-897d-c8abf5be1dd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:50.709875 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.709811 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 13:03:50.835959 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.835933 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b546b1_6628_469e_a3ff_069e3eb95876.slice/crio-726c836fe0273ca2882f6b26712d94e46e611f8260ef663451027d9c7a734ba3 WatchSource:0}: Error finding container 726c836fe0273ca2882f6b26712d94e46e611f8260ef663451027d9c7a734ba3: Status 404 returned error can't find the container with id 726c836fe0273ca2882f6b26712d94e46e611f8260ef663451027d9c7a734ba3 Jun 10 13:03:50.837614 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.837574 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdb3360_ceb4_454a_b2b7_c042c665efbf.slice/crio-7b7af3fa3438667064858117b52c0ac8ebe3ba6c43bd94ec600cda75f7a63a15 WatchSource:0}: Error finding container 7b7af3fa3438667064858117b52c0ac8ebe3ba6c43bd94ec600cda75f7a63a15: Status 404 returned error can't find the container with id 7b7af3fa3438667064858117b52c0ac8ebe3ba6c43bd94ec600cda75f7a63a15 Jun 10 13:03:50.839065 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.839011 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75815153_68d2_46a9_92f6_0c997d983cbe.slice/crio-ce4cdc75165e8db84997788d123ccfe3141acafa08144fd33cdf0ac34c9b2511 WatchSource:0}: Error finding container ce4cdc75165e8db84997788d123ccfe3141acafa08144fd33cdf0ac34c9b2511: Status 404 returned error can't find the container with id ce4cdc75165e8db84997788d123ccfe3141acafa08144fd33cdf0ac34c9b2511 Jun 10 13:03:50.842561 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.842541 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f59a632_66ab_4eeb_b763_dcd0d57fbf67.slice/crio-214ea609f95de882299dd09323fb2d9cbc841de5f58a9bd52922aef14dba17c5 WatchSource:0}: Error finding container 214ea609f95de882299dd09323fb2d9cbc841de5f58a9bd52922aef14dba17c5: Status 404 returned error can't find the container with id 214ea609f95de882299dd09323fb2d9cbc841de5f58a9bd52922aef14dba17c5 Jun 10 13:03:50.845223 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.845205 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d07f9d_bbdc_49e0_b342_92e4bed30321.slice/crio-fd2e46299720d068c878bda4567d33301ca1d653cceb7f9cd24b4d2601cb3f4c WatchSource:0}: Error finding container fd2e46299720d068c878bda4567d33301ca1d653cceb7f9cd24b4d2601cb3f4c: Status 404 returned error can't find the container with id fd2e46299720d068c878bda4567d33301ca1d653cceb7f9cd24b4d2601cb3f4c Jun 10 13:03:50.867617 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.867576 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717b46a7_f2c5_4d2b_9e9e_0bda2f1601ab.slice/crio-6ab979bbfec30d0ed4aacae3717a9dcb3ff9666757384bbc84ed3a127db0ef39 WatchSource:0}: Error finding container 6ab979bbfec30d0ed4aacae3717a9dcb3ff9666757384bbc84ed3a127db0ef39: Status 404 returned error can't find the container with id 6ab979bbfec30d0ed4aacae3717a9dcb3ff9666757384bbc84ed3a127db0ef39 Jun 10 13:03:50.868416 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.868366 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c61d86b_d255_405a_923b_0d6c54c4fc02.slice/crio-7cfb3d3c2da1a79b83e70356c37fc4d13cb9ed8bbca9b4b7bc2354e352d63eb3 WatchSource:0}: Error finding container 7cfb3d3c2da1a79b83e70356c37fc4d13cb9ed8bbca9b4b7bc2354e352d63eb3: Status 404 returned error can't find the container with id 7cfb3d3c2da1a79b83e70356c37fc4d13cb9ed8bbca9b4b7bc2354e352d63eb3 Jun 10 13:03:50.869102 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.869073 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e749ed5_22cf_42a3_ac31_798f3978f9db.slice/crio-e54c1044f235d3356300491d36f46aa19b36632db08a260106d8dbbe10f74c48 WatchSource:0}: Error finding container e54c1044f235d3356300491d36f46aa19b36632db08a260106d8dbbe10f74c48: Status 404 returned error can't find the container with id e54c1044f235d3356300491d36f46aa19b36632db08a260106d8dbbe10f74c48 Jun 10 13:03:50.869688 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:03:50.869668 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe680182_961b_404d_bbcd_48e9488556ab.slice/crio-3f47cb2d3ffe833cf9777c1f14c72f0eee6782e39a6af017d067a0ee80f8c54a WatchSource:0}: Error finding container 3f47cb2d3ffe833cf9777c1f14c72f0eee6782e39a6af017d067a0ee80f8c54a: Status 404 returned error can't find the container with id 3f47cb2d3ffe833cf9777c1f14c72f0eee6782e39a6af017d067a0ee80f8c54a Jun 10 13:03:50.955357 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.955325 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:58:49 +0000 UTC" deadline="2028-03-24 03:23:45.69439593 +0000 UTC" Jun 10 13:03:50.955357 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.955352 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15662h19m54.739047527s" Jun 10 13:03:50.987724 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.987692 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" event={"ID":"2fb07b914d529e0d28e0b79b4f8456ed","Type":"ContainerStarted","Data":"1cdb10925aca664e45297023a1c4bd333bc94aeec3399f19f2885a28eb391a92"} Jun 10 13:03:50.988957 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.988930 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerStarted","Data":"3f47cb2d3ffe833cf9777c1f14c72f0eee6782e39a6af017d067a0ee80f8c54a"} Jun 10 13:03:50.990101 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.990078 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" event={"ID":"3e749ed5-22cf-42a3-ac31-798f3978f9db","Type":"ContainerStarted","Data":"e54c1044f235d3356300491d36f46aa19b36632db08a260106d8dbbe10f74c48"} Jun 10 13:03:50.991139 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.991116 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c2ssx" event={"ID":"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab","Type":"ContainerStarted","Data":"6ab979bbfec30d0ed4aacae3717a9dcb3ff9666757384bbc84ed3a127db0ef39"} Jun 10 13:03:50.992433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.992411 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tz85n" event={"ID":"69d07f9d-bbdc-49e0-b342-92e4bed30321","Type":"ContainerStarted","Data":"fd2e46299720d068c878bda4567d33301ca1d653cceb7f9cd24b4d2601cb3f4c"} Jun 10 13:03:50.993656 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.993633 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nxc4h" event={"ID":"7f59a632-66ab-4eeb-b763-dcd0d57fbf67","Type":"ContainerStarted","Data":"214ea609f95de882299dd09323fb2d9cbc841de5f58a9bd52922aef14dba17c5"} Jun 10 13:03:50.994719 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.994697 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4n29w" event={"ID":"75815153-68d2-46a9-92f6-0c997d983cbe","Type":"ContainerStarted","Data":"ce4cdc75165e8db84997788d123ccfe3141acafa08144fd33cdf0ac34c9b2511"} Jun 10 13:03:50.995940 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.995914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7dl7f" event={"ID":"5c61d86b-d255-405a-923b-0d6c54c4fc02","Type":"ContainerStarted","Data":"7cfb3d3c2da1a79b83e70356c37fc4d13cb9ed8bbca9b4b7bc2354e352d63eb3"} Jun 10 13:03:50.997103 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.997084 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" event={"ID":"fbdb3360-ceb4-454a-b2b7-c042c665efbf","Type":"ContainerStarted","Data":"7b7af3fa3438667064858117b52c0ac8ebe3ba6c43bd94ec600cda75f7a63a15"} Jun 10 13:03:50.998302 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:50.998258 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"726c836fe0273ca2882f6b26712d94e46e611f8260ef663451027d9c7a734ba3"} Jun 10 13:03:51.014568 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.014498 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-87.ec2.internal" podStartSLOduration=2.014481357 podStartE2EDuration="2.014481357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:51.013979361 +0000 UTC m=+3.425373946" watchObservedRunningTime="2026-06-10 13:03:51.014481357 +0000 UTC m=+3.425875940" Jun 10 13:03:51.630653 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.630518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:51.630653 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.630568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:51.630653 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.630622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:51.630935 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.630781 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:51.630935 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.630802 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:51.630935 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.630815 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dk8hh for pod openshift-network-diagnostics/network-check-target-xghct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:51.630935 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.630871 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh podName:ef2fddae-c747-4edc-a347-5e48608f2b78 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:53.630855656 +0000 UTC m=+6.042250223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dk8hh" (UniqueName: "kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh") pod "network-check-target-xghct" (UID: "ef2fddae-c747-4edc-a347-5e48608f2b78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:51.630935 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.630936 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:51.631177 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.630970 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret podName:2d19bf21-6f90-411e-8268-61e8d42366be nodeName:}" failed. No retries permitted until 2026-06-10 13:03:53.630959028 +0000 UTC m=+6.042353603 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret") pod "global-pull-secret-syncer-pj8zt" (UID: "2d19bf21-6f90-411e-8268-61e8d42366be") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:51.631177 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.631024 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:51.631177 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.631055 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs podName:104639b3-1c70-4ec1-897d-c8abf5be1dd3 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:53.631044326 +0000 UTC m=+6.042438892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs") pod "network-metrics-daemon-v7qj9" (UID: "104639b3-1c70-4ec1-897d-c8abf5be1dd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:51.956232 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.956127 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 12:58:49 +0000 UTC" deadline="2027-12-24 15:19:01.263841563 +0000 UTC" Jun 10 13:03:51.956232 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.956184 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13490h15m9.307661808s" Jun 10 13:03:51.981256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.981223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:51.981429 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.981358 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:03:51.981494 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.981450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:51.981544 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.981527 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:03:51.981636 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:51.981606 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:51.981760 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:51.981705 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:03:52.011439 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:52.010782 2558 generic.go:356] "Generic (PLEG): container finished" podID="d39722b944d26a5edbc396c94a76c862" containerID="276a6f9fd964620056e026cfe50436580b3017e4db1cadd1d1f6081ac27bc948" exitCode=0 Jun 10 13:03:52.011439 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:52.010923 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"d39722b944d26a5edbc396c94a76c862","Type":"ContainerDied","Data":"276a6f9fd964620056e026cfe50436580b3017e4db1cadd1d1f6081ac27bc948"} Jun 10 13:03:53.017679 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:53.017640 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" event={"ID":"d39722b944d26a5edbc396c94a76c862","Type":"ContainerStarted","Data":"7243044a6a649f6d8ab2ed553662510ae3ff33b6b8d3c8d501993034c29fc9b2"} Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:53.647546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:53.647632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:53.647661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647737 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647765 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647769 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647778 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dk8hh for pod openshift-network-diagnostics/network-check-target-xghct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647805 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647831 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh podName:ef2fddae-c747-4edc-a347-5e48608f2b78 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:57.647811419 +0000 UTC m=+10.059205982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dk8hh" (UniqueName: "kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh") pod "network-check-target-xghct" (UID: "ef2fddae-c747-4edc-a347-5e48608f2b78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647848 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret podName:2d19bf21-6f90-411e-8268-61e8d42366be nodeName:}" failed. No retries permitted until 2026-06-10 13:03:57.6478399 +0000 UTC m=+10.059234467 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret") pod "global-pull-secret-syncer-pj8zt" (UID: "2d19bf21-6f90-411e-8268-61e8d42366be") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:53.647886 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.647871 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs podName:104639b3-1c70-4ec1-897d-c8abf5be1dd3 nodeName:}" failed. No retries permitted until 2026-06-10 13:03:57.64786268 +0000 UTC m=+10.059257241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs") pod "network-metrics-daemon-v7qj9" (UID: "104639b3-1c70-4ec1-897d-c8abf5be1dd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:53.980239 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:53.980164 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:53.980419 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.980309 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:03:53.980739 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:53.980718 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:53.980859 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.980834 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:03:53.980916 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:53.980883 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:53.980991 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:53.980970 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:03:55.979424 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:55.979393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:55.979850 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:55.979433 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:55.979850 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:55.979393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:55.979850 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:55.979524 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:03:55.979850 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:55.979594 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:03:55.979850 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:55.979657 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:03:57.683977 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:57.683936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:57.683996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:57.684040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684049 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684132 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret podName:2d19bf21-6f90-411e-8268-61e8d42366be nodeName:}" failed. No retries permitted until 2026-06-10 13:04:05.684107282 +0000 UTC m=+18.095501860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret") pod "global-pull-secret-syncer-pj8zt" (UID: "2d19bf21-6f90-411e-8268-61e8d42366be") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684133 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684151 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684165 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684177 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dk8hh for pod openshift-network-diagnostics/network-check-target-xghct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684188 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs podName:104639b3-1c70-4ec1-897d-c8abf5be1dd3 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:05.68417125 +0000 UTC m=+18.095565826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs") pod "network-metrics-daemon-v7qj9" (UID: "104639b3-1c70-4ec1-897d-c8abf5be1dd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:03:57.684424 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.684213 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh podName:ef2fddae-c747-4edc-a347-5e48608f2b78 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:05.684201934 +0000 UTC m=+18.095596511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dk8hh" (UniqueName: "kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh") pod "network-check-target-xghct" (UID: "ef2fddae-c747-4edc-a347-5e48608f2b78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:03:57.979698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:57.979525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:57.979698 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.979630 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:03:57.979698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:57.979688 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:57.979963 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:57.979740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:57.979963 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.979833 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:03:57.979963 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:57.979921 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:03:59.979338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:59.979126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:03:59.979338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:59.979141 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:03:59.979338 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:59.979253 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:03:59.979338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:03:59.979286 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:03:59.980887 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:59.980850 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:03:59.981006 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:03:59.980930 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:01.978990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:01.978912 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:01.978990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:01.978950 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:01.979466 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:01.979021 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:01.979466 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:01.979063 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:01.979466 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:01.979204 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:01.979466 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:01.979300 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:03.978401 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:03.978326 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:03.978401 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:03.978374 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:03.978401 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:03.978375 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:03.978942 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:03.978472 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:03.978942 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:03.978553 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:03.978942 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:03.978645 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:05.747587 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:05.747544 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:05.747619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:05.747650 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747745 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747759 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747772 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747787 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dk8hh for pod openshift-network-diagnostics/network-check-target-xghct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747822 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs podName:104639b3-1c70-4ec1-897d-c8abf5be1dd3 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:21.747807915 +0000 UTC m=+34.159202475 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs") pod "network-metrics-daemon-v7qj9" (UID: "104639b3-1c70-4ec1-897d-c8abf5be1dd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747759 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747836 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh podName:ef2fddae-c747-4edc-a347-5e48608f2b78 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:21.747830106 +0000 UTC m=+34.159224667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dk8hh" (UniqueName: "kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh") pod "network-check-target-xghct" (UID: "ef2fddae-c747-4edc-a347-5e48608f2b78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:04:05.748056 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.747865 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret podName:2d19bf21-6f90-411e-8268-61e8d42366be nodeName:}" failed. No retries permitted until 2026-06-10 13:04:21.747847958 +0000 UTC m=+34.159242536 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret") pod "global-pull-secret-syncer-pj8zt" (UID: "2d19bf21-6f90-411e-8268-61e8d42366be") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:04:05.978308 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:05.978246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:05.978308 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:05.978303 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:05.978509 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:05.978372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:05.978509 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.978390 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:05.978509 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.978475 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:05.978601 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:05.978580 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:07.979577 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:07.979375 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:07.980031 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:07.979455 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:07.980031 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:07.979656 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:07.980031 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:07.979773 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:07.980031 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:07.979477 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:07.980031 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:07.979863 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:09.978788 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:09.978762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:09.979396 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:09.978897 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:09.979396 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:09.979253 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:09.979396 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:09.979363 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:09.979396 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:09.979391 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:09.979627 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:09.979452 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:10.056240 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.055558 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c2ssx" event={"ID":"717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab","Type":"ContainerStarted","Data":"b336a42108f237d6f5dc38061d4ccf991d9196c325a280ffcfa4eef9914ec9b0"} Jun 10 13:04:10.074462 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.074328 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-87.ec2.internal" podStartSLOduration=21.07430881 podStartE2EDuration="21.07430881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:03:53.037863322 +0000 UTC m=+5.449257905" watchObservedRunningTime="2026-06-10 13:04:10.07430881 +0000 UTC m=+22.485703394" Jun 10 13:04:10.074957 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.074756 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c2ssx" podStartSLOduration=7.827165175 podStartE2EDuration="22.074744111s" totalImagesPullingTime="14.247578936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:10.073556535 +0000 UTC m=+22.484951121" watchObservedRunningTime="2026-06-10 13:04:10.074744111 +0000 UTC m=+22.486138694" Jun 10 13:04:10.409289 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.409093 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:10.486942 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.486904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:10.551380 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.551352 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:10.618474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.618441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:10.719879 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.719850 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:10.820716 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:10.820619 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:11.064675 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.064646 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tz85n" event={"ID":"69d07f9d-bbdc-49e0-b342-92e4bed30321","Type":"ContainerStarted","Data":"d1a64faecc5ec8b161620f531354f2f90259e3ab6c4fd0b15451496da90bc691"} Jun 10 13:04:11.066150 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.066126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nxc4h" event={"ID":"7f59a632-66ab-4eeb-b763-dcd0d57fbf67","Type":"ContainerStarted","Data":"6bd8e864a3d4edc639bdba0a49fa84d6bc6abdafe152c81b66371c10ef38eb73"} Jun 10 13:04:11.067426 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.067405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4n29w" event={"ID":"75815153-68d2-46a9-92f6-0c997d983cbe","Type":"ContainerStarted","Data":"66e1bc07619f07049878563b41cc92700c4a79e608fbc5383b65d587d0fb4d91"} Jun 10 13:04:11.068673 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.068649 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" event={"ID":"fbdb3360-ceb4-454a-b2b7-c042c665efbf","Type":"ContainerStarted","Data":"38e58bf44b33d3bfba1556788e6f6286c1793fc5abead12285e3f09f803e4dfb"} Jun 10 13:04:11.071625 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.071566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"24458b55cc41aa81dca427f773968ca16378fc279368567833a50b9d0ff9fc70"} Jun 10 13:04:11.071625 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.071617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"d0a934ea0d242f6768eccd50e418d079fb3a667154f6628570c9ab0dd34b4052"} Jun 10 13:04:11.071744 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.071658 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"e8a12ff0588c20b8342907ef9b9a1b757c04055a7f199b6d2b6e546853b39156"} Jun 10 13:04:11.071744 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.071699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"bc8ecb67463dec08c812937587c4217bdf58e71b960d0a8bf41300e591833671"} Jun 10 13:04:11.071744 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.071739 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"8cdaa6c547f250c41b471b0e66cc4769af340dae159a57b69c9ac9a3533ec4cf"} Jun 10 13:04:11.071882 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.071774 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"6ddb61ffc1e21affe4702ed75ca4a2126125c4df1c2689e3a2312e0a2b73bc8a"} Jun 10 13:04:11.072949 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.072928 2558 generic.go:356] "Generic (PLEG): container finished" podID="be680182-961b-404d-bbcd-48e9488556ab" containerID="544444d60589d2ca024a38105c9ce951d79b89ad6203c2c871123fe2ab0aa9d0" exitCode=0 Jun 10 13:04:11.073039 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.072969 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerDied","Data":"544444d60589d2ca024a38105c9ce951d79b89ad6203c2c871123fe2ab0aa9d0"} Jun 10 13:04:11.074500 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.074481 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" event={"ID":"3e749ed5-22cf-42a3-ac31-798f3978f9db","Type":"ContainerStarted","Data":"937a40429c7ee4ce3dcc39b54200312969b3d245043cb709f5d6125b17f5dfbd"} Jun 10 13:04:11.085242 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.085199 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tz85n" podStartSLOduration=3.891925095 podStartE2EDuration="23.085187531s" totalImagesPullingTime="19.193262436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:11.084638351 +0000 UTC m=+23.496032934" watchObservedRunningTime="2026-06-10 13:04:11.085187531 +0000 UTC m=+23.496582114" Jun 10 13:04:11.106456 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.106424 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6jwhp" podStartSLOduration=4.059858818 podStartE2EDuration="23.106413067s" totalImagesPullingTime="19.046554249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:11.106246568 +0000 UTC m=+23.517641151" watchObservedRunningTime="2026-06-10 13:04:11.106413067 +0000 UTC m=+23.517807650" Jun 10 13:04:11.124338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.124301 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4n29w" podStartSLOduration=4.096493542 podStartE2EDuration="23.124290512s" totalImagesPullingTime="19.02779697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:11.123859033 +0000 UTC m=+23.535253615" watchObservedRunningTime="2026-06-10 13:04:11.124290512 +0000 UTC m=+23.535685091" Jun 10 13:04:11.171074 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.171030 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nxc4h" podStartSLOduration=4.129802613 podStartE2EDuration="23.171013102s" totalImagesPullingTime="19.041210489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:11.170485248 +0000 UTC m=+23.581879833" watchObservedRunningTime="2026-06-10 13:04:11.171013102 +0000 UTC m=+23.582407687" Jun 10 13:04:11.230865 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.230749 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 13:04:11.272012 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.271984 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:11.346964 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.346902 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:11.413979 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.413952 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:11.743636 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.743606 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:11.801554 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.801519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:11.979400 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.978956 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:11.979400 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.978963 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:11.979400 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:11.979074 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:11.979400 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.979132 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:11.979400 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:11.979223 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:11.979400 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:11.979309 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:11.981203 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.981106 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T13:04:11.230861488Z","UUID":"71f01ce5-19c6-418a-b7a0-67bddc5fb4a8","Handler":null,"Name":"","Endpoint":""} Jun 10 13:04:11.983233 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.983209 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 13:04:11.983374 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:11.983254 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 13:04:12.078579 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.078498 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7dl7f" event={"ID":"5c61d86b-d255-405a-923b-0d6c54c4fc02","Type":"ContainerStarted","Data":"cac354ff594f39ef9dc1a82b35e7628cdb228a5b92e3657c54771c68f7b0e818"} Jun 10 13:04:12.080917 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.080885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" event={"ID":"3e749ed5-22cf-42a3-ac31-798f3978f9db","Type":"ContainerStarted","Data":"330ac848a18c535f0d99650a37653c8f8f562cdb978e6966285388d7e3bb48d7"} Jun 10 13:04:12.336306 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.336258 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:12.385665 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.385628 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:04:12.386452 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.386427 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:04:12.403917 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.403874 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7dl7f" podStartSLOduration=5.390783392 podStartE2EDuration="24.403854965s" totalImagesPullingTime="19.013071573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:12.097105183 +0000 UTC m=+24.508499767" watchObservedRunningTime="2026-06-10 13:04:12.403854965 +0000 UTC m=+24.815249593" Jun 10 13:04:12.418000 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.417954 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:12.473917 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.473891 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:12.546795 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.546760 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:12.601239 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.601155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:12.941004 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:12.940931 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.044896 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.044865 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.085733 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.085697 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" event={"ID":"3e749ed5-22cf-42a3-ac31-798f3978f9db","Type":"ContainerStarted","Data":"c5249af7d923b56bfb3301c68ac86a3a552622db741eeb17058ed4409fafc4ac"} Jun 10 13:04:13.089400 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.089373 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"500976e40bcf10e3eaf10beead7d4ad559909ace8b55d95f966969f22b107605"} Jun 10 13:04:13.089665 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.089642 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:04:13.090373 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.090351 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c2ssx" Jun 10 13:04:13.110394 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.110367 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.123818 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.123782 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5sxt4" podStartSLOduration=4.084612761 podStartE2EDuration="25.123767872s" totalImagesPullingTime="21.039155111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:13.106171989 +0000 UTC m=+25.517566573" watchObservedRunningTime="2026-06-10 13:04:13.123767872 +0000 UTC m=+25.535162455" Jun 10 13:04:13.176377 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.176331 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.481751 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.481714 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.541158 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.541117 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.737007 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.736914 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.839104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.839074 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:13.978539 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.978503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:13.978813 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.978503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:13.978813 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:13.978644 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:13.978813 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:13.978519 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:13.978813 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:13.978742 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:13.978813 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:13.978788 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:14.144551 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:14.144472 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:14.207050 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:14.207017 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:15.097701 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:15.097537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" event={"ID":"04b546b1-6628-469e-a3ff-069e3eb95876","Type":"ContainerStarted","Data":"6cbd058b9664deca6cb38656e4a70978825aa4125134dbc5071eb697aadc4c77"} Jun 10 13:04:15.128849 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:15.128807 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" podStartSLOduration=8.037949045 podStartE2EDuration="27.128793252s" totalImagesPullingTime="19.090844207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:15.12690702 +0000 UTC m=+27.538301602" watchObservedRunningTime="2026-06-10 13:04:15.128793252 +0000 UTC m=+27.540187834" Jun 10 13:04:15.351188 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:15.351164 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:15.405103 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:15.405035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:15.978477 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:15.978446 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:15.978477 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:15.978479 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:15.978670 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:15.978453 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:15.978670 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:15.978546 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:15.978670 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:15.978648 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:15.978787 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:15.978711 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:16.100939 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.100912 2558 generic.go:356] "Generic (PLEG): container finished" podID="be680182-961b-404d-bbcd-48e9488556ab" containerID="a24e87f15ca2f6780a541367aac75a13280b5ab1211c00552ec40fbea077fce6" exitCode=0 Jun 10 13:04:16.101111 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.101006 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerDied","Data":"a24e87f15ca2f6780a541367aac75a13280b5ab1211c00552ec40fbea077fce6"} Jun 10 13:04:16.101391 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.101373 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:04:16.101478 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.101444 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:04:16.101535 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.101499 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:04:16.116753 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.116732 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:04:16.120667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.120650 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:04:16.231935 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:16.231905 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:17.039780 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.039753 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pj8zt"] Jun 10 13:04:17.040356 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.039892 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:17.040356 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:17.039982 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:17.050352 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.050324 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xghct"] Jun 10 13:04:17.050500 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.050419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:17.050543 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:17.050502 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:17.051051 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.051032 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7qj9"] Jun 10 13:04:17.051132 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.051122 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:17.051211 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:17.051195 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:17.100952 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.100895 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:17.104482 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.104455 2558 generic.go:356] "Generic (PLEG): container finished" podID="be680182-961b-404d-bbcd-48e9488556ab" containerID="a0c8b95efa6a1adee2fc8c7c2b5e5d957c53535fbfbe9da227c3951bb53745de" exitCode=0 Jun 10 13:04:17.104599 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.104543 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerDied","Data":"a0c8b95efa6a1adee2fc8c7c2b5e5d957c53535fbfbe9da227c3951bb53745de"} Jun 10 13:04:17.353386 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.353315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:17.419445 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.419412 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:17.530258 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.530209 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:17.630321 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.630223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:17.760918 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:17.760885 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:18.944960 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:18.944930 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:18.978945 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:18.978921 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:18.979060 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:18.978923 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:18.979114 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:18.978923 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:18.979180 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:18.979008 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:18.979234 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:18.979088 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:18.979234 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:18.979204 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:19.048080 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.048057 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:19.111559 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.111530 2558 generic.go:356] "Generic (PLEG): container finished" podID="be680182-961b-404d-bbcd-48e9488556ab" containerID="654b937f904c13f392d200defaf70420c87f4b5d98c736abe33897a164f9f617" exitCode=0 Jun 10 13:04:19.111656 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.111577 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerDied","Data":"654b937f904c13f392d200defaf70420c87f4b5d98c736abe33897a164f9f617"} Jun 10 13:04:19.142522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.142495 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:19.349528 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.349502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:19.551363 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.551332 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:19.773668 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.773636 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:19.839037 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:19.839008 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:20.742283 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:20.742236 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:20.799667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:20.799632 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:20.944464 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:20.944430 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:20.978568 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:20.978513 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:20.978786 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:20.978645 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:20.978786 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:20.978650 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:20.978786 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:20.978682 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:20.979009 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:20.978780 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:20.979009 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:20.978860 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:21.351445 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:21.351412 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:21.549724 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:21.549692 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:21.609323 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:21.609250 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:21.770930 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:21.770897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:21.770930 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:21.770945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:21.770992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771067 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771115 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771137 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771142 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771208 2558 projected.go:196] Error preparing data for projected volume kube-api-access-dk8hh for pod openshift-network-diagnostics/network-check-target-xghct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771138 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret podName:2d19bf21-6f90-411e-8268-61e8d42366be nodeName:}" failed. No retries permitted until 2026-06-10 13:04:53.771118709 +0000 UTC m=+66.182513272 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret") pod "global-pull-secret-syncer-pj8zt" (UID: "2d19bf21-6f90-411e-8268-61e8d42366be") : object "kube-system"/"original-pull-secret" not registered Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771256 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs podName:104639b3-1c70-4ec1-897d-c8abf5be1dd3 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:53.771242928 +0000 UTC m=+66.182637489 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs") pod "network-metrics-daemon-v7qj9" (UID: "104639b3-1c70-4ec1-897d-c8abf5be1dd3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 13:04:21.771417 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:21.771289 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh podName:ef2fddae-c747-4edc-a347-5e48608f2b78 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:53.771261981 +0000 UTC m=+66.182656545 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dk8hh" (UniqueName: "kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh") pod "network-check-target-xghct" (UID: "ef2fddae-c747-4edc-a347-5e48608f2b78") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 13:04:21.942359 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:21.942254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:22.728338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:22.728306 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:22.791937 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:22.791904 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:22.945940 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:22.945897 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:22.978392 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:22.978325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:22.978392 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:22.978346 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:22.978392 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:22.978357 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:22.978628 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:22.978442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:22.978628 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:22.978502 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:22.978628 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:22.978611 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:23.292411 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:23.292205 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:23.395512 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:23.395482 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:23.568508 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:23.568467 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:24.124608 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.124579 2558 generic.go:356] "Generic (PLEG): container finished" podID="be680182-961b-404d-bbcd-48e9488556ab" containerID="3977ed4062d916628c81992ed89e36d6d94135eb6ca90fb07704f70c077ce37b" exitCode=0 Jun 10 13:04:24.124608 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.124612 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerDied","Data":"3977ed4062d916628c81992ed89e36d6d94135eb6ca90fb07704f70c077ce37b"} Jun 10 13:04:24.151351 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.151221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:24.544215 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.544183 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:24.945779 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.945700 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:24.978787 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.978764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:24.978877 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.978854 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:24.978877 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:24.978863 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:24.978974 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:24.978870 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:24.978974 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:24.978921 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:24.979144 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:24.979007 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:25.130056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:25.130026 2558 generic.go:356] "Generic (PLEG): container finished" podID="be680182-961b-404d-bbcd-48e9488556ab" containerID="e3f04c65d1637e4ae3eb6dc7dc8e067746334327df95799c301cf20e36189649" exitCode=0 Jun 10 13:04:25.130423 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:25.130088 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerDied","Data":"e3f04c65d1637e4ae3eb6dc7dc8e067746334327df95799c301cf20e36189649"} Jun 10 13:04:25.147659 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:25.147630 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:25.547508 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:25.547472 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:26.135157 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.135130 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" event={"ID":"be680182-961b-404d-bbcd-48e9488556ab","Type":"ContainerStarted","Data":"c6171d4d9591f9e8ef7862d9f74b37bda522f04b549da8a4cf9efd24eeb81af4"} Jun 10 13:04:26.145144 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.145121 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:26.163665 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.163630 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bp5zq" podStartSLOduration=9.558042402 podStartE2EDuration="38.163615762s" totalImagesPullingTime="28.60557336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:26.163438889 +0000 UTC m=+38.574833473" watchObservedRunningTime="2026-06-10 13:04:26.163615762 +0000 UTC m=+38.575010345" Jun 10 13:04:26.556172 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.556137 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:26.950079 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.950004 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:26.978831 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.978810 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:26.978943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.978909 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:26.978943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:26.978931 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:26.979032 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:26.978906 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:26.979032 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:26.978982 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:26.979103 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:26.979051 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:27.169857 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:27.169821 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:27.268372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:27.268338 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:27.368824 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:27.368797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" limit=1024 Jun 10 13:04:28.979183 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:28.979153 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:28.979183 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:28.979170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:28.979183 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:28.979182 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:28.979706 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:28.979262 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:28.979706 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:28.979350 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:28.979706 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:28.979474 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:30.978603 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:30.978574 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:30.979028 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:30.978660 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:30.979028 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:30.978663 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:30.979028 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:30.978758 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:30.979028 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:30.978789 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:30.979028 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:30.978882 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:32.978761 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:32.978727 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:32.979336 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:32.978826 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:32.979336 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:32.978848 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:32.979336 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:32.978913 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:32.979336 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:32.978831 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:32.979336 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:32.978979 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:34.978252 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:34.978223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:34.978252 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:34.978252 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:34.978647 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:34.978223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:34.978647 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:34.978327 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:34.978647 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:34.978384 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:34.978647 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:34.978458 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:36.978453 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:36.978417 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:36.978902 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:36.978460 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:36.978902 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:36.978503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:36.978902 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:36.978512 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:36.978902 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:36.978603 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:36.978902 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:36.978712 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:38.978502 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:38.978473 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:38.978957 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:38.978577 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:38.978957 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:38.978586 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pj8zt" podUID="2d19bf21-6f90-411e-8268-61e8d42366be" Jun 10 13:04:38.978957 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:38.978602 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:38.978957 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:38.978670 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-v7qj9" podUID="104639b3-1c70-4ec1-897d-c8abf5be1dd3" Jun 10 13:04:38.978957 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:38.978737 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xghct" podUID="ef2fddae-c747-4edc-a347-5e48608f2b78" Jun 10 13:04:39.926406 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:39.926338 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-87.ec2.internal" event="NodeReady" Jun 10 13:04:39.926538 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:39.926430 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 13:04:39.973209 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:39.973182 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56b975f959-8fmls"] Jun 10 13:04:39.997731 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:39.997707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.000463 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.000441 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 13:04:40.000586 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.000517 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 13:04:40.000802 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.000784 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b6twm\"" Jun 10 13:04:40.000887 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.000792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 13:04:40.001906 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.001641 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56b975f959-8fmls"] Jun 10 13:04:40.001906 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.001686 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8bpds"] Jun 10 13:04:40.006552 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.006258 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 13:04:40.013889 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.013873 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/344bb8f7-93f7-4092-a37a-bd564d0c0599-trusted-ca\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.013948 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.013896 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-registry-tls\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.013948 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.013912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/344bb8f7-93f7-4092-a37a-bd564d0c0599-ca-trust-extracted\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.014011 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.013984 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/344bb8f7-93f7-4092-a37a-bd564d0c0599-installation-pull-secrets\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.014047 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.014017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/344bb8f7-93f7-4092-a37a-bd564d0c0599-image-registry-private-configuration\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.014047 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.014035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsdff\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-kube-api-access-xsdff\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.014104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.014066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/344bb8f7-93f7-4092-a37a-bd564d0c0599-registry-certificates\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.014104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.014087 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-bound-sa-token\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.015474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.015457 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bw4nm"] Jun 10 13:04:40.015581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.015566 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.018476 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.018459 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 13:04:40.018598 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.018584 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-np4vc\"" Jun 10 13:04:40.018914 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.018902 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 13:04:40.033726 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.033709 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bpds"] Jun 10 13:04:40.033811 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.033746 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bw4nm"] Jun 10 13:04:40.033863 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.033807 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.036476 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.036460 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 13:04:40.036581 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.036533 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rnvq5\"" Jun 10 13:04:40.036681 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.036666 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 13:04:40.036751 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.036739 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 13:04:40.115258 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3971888-c652-4a5c-baf8-1172ccffa13b-metrics-tls\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.115389 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115285 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/344bb8f7-93f7-4092-a37a-bd564d0c0599-image-registry-private-configuration\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115389 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsdff\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-kube-api-access-xsdff\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115389 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/344bb8f7-93f7-4092-a37a-bd564d0c0599-registry-certificates\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115389 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115368 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-bound-sa-token\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115394 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brd6t\" (UniqueName: \"kubernetes.io/projected/bc343bc5-1c73-4951-9773-9c13ea4b7ad5-kube-api-access-brd6t\") pod \"ingress-canary-bw4nm\" (UID: \"bc343bc5-1c73-4951-9773-9c13ea4b7ad5\") " pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.115569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/344bb8f7-93f7-4092-a37a-bd564d0c0599-trusted-ca\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-registry-tls\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/344bb8f7-93f7-4092-a37a-bd564d0c0599-ca-trust-extracted\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115731 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115589 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9gd\" (UniqueName: \"kubernetes.io/projected/e3971888-c652-4a5c-baf8-1172ccffa13b-kube-api-access-7c9gd\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.115731 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc343bc5-1c73-4951-9773-9c13ea4b7ad5-cert\") pod \"ingress-canary-bw4nm\" (UID: \"bc343bc5-1c73-4951-9773-9c13ea4b7ad5\") " pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.115828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3971888-c652-4a5c-baf8-1172ccffa13b-tmp-dir\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.115828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/344bb8f7-93f7-4092-a37a-bd564d0c0599-installation-pull-secrets\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.115828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3971888-c652-4a5c-baf8-1172ccffa13b-config-volume\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.115978 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.115826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/344bb8f7-93f7-4092-a37a-bd564d0c0599-ca-trust-extracted\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.116490 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.116468 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/344bb8f7-93f7-4092-a37a-bd564d0c0599-registry-certificates\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.116623 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.116501 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/344bb8f7-93f7-4092-a37a-bd564d0c0599-trusted-ca\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.119410 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.119387 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/344bb8f7-93f7-4092-a37a-bd564d0c0599-image-registry-private-configuration\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.119487 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.119420 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/344bb8f7-93f7-4092-a37a-bd564d0c0599-installation-pull-secrets\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.119535 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.119521 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-registry-tls\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.124517 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.124496 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsdff\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-kube-api-access-xsdff\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.125346 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.125326 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/344bb8f7-93f7-4092-a37a-bd564d0c0599-bound-sa-token\") pod \"image-registry-56b975f959-8fmls\" (UID: \"344bb8f7-93f7-4092-a37a-bd564d0c0599\") " pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.216504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216435 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3971888-c652-4a5c-baf8-1172ccffa13b-tmp-dir\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.216504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3971888-c652-4a5c-baf8-1172ccffa13b-config-volume\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.216504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3971888-c652-4a5c-baf8-1172ccffa13b-metrics-tls\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.216719 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brd6t\" (UniqueName: \"kubernetes.io/projected/bc343bc5-1c73-4951-9773-9c13ea4b7ad5-kube-api-access-brd6t\") pod \"ingress-canary-bw4nm\" (UID: \"bc343bc5-1c73-4951-9773-9c13ea4b7ad5\") " pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.216719 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9gd\" (UniqueName: \"kubernetes.io/projected/e3971888-c652-4a5c-baf8-1172ccffa13b-kube-api-access-7c9gd\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.216719 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216564 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc343bc5-1c73-4951-9773-9c13ea4b7ad5-cert\") pod \"ingress-canary-bw4nm\" (UID: \"bc343bc5-1c73-4951-9773-9c13ea4b7ad5\") " pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.216866 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e3971888-c652-4a5c-baf8-1172ccffa13b-tmp-dir\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.217002 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.216982 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e3971888-c652-4a5c-baf8-1172ccffa13b-config-volume\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.218682 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.218660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3971888-c652-4a5c-baf8-1172ccffa13b-metrics-tls\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.218854 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.218838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc343bc5-1c73-4951-9773-9c13ea4b7ad5-cert\") pod \"ingress-canary-bw4nm\" (UID: \"bc343bc5-1c73-4951-9773-9c13ea4b7ad5\") " pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.225944 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.225917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9gd\" (UniqueName: \"kubernetes.io/projected/e3971888-c652-4a5c-baf8-1172ccffa13b-kube-api-access-7c9gd\") pod \"dns-default-8bpds\" (UID: \"e3971888-c652-4a5c-baf8-1172ccffa13b\") " pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.226188 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.226170 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brd6t\" (UniqueName: \"kubernetes.io/projected/bc343bc5-1c73-4951-9773-9c13ea4b7ad5-kube-api-access-brd6t\") pod \"ingress-canary-bw4nm\" (UID: \"bc343bc5-1c73-4951-9773-9c13ea4b7ad5\") " pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.309095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.309067 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:40.323484 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.323463 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:40.341395 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.341379 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bw4nm" Jun 10 13:04:40.507457 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.507421 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8bpds"] Jun 10 13:04:40.511413 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:40.511387 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3971888_c652_4a5c_baf8_1172ccffa13b.slice/crio-536df913ff2da0ceea7bf867d1ba7b2b3add99cd139cabf8322ab064deca51d9 WatchSource:0}: Error finding container 536df913ff2da0ceea7bf867d1ba7b2b3add99cd139cabf8322ab064deca51d9: Status 404 returned error can't find the container with id 536df913ff2da0ceea7bf867d1ba7b2b3add99cd139cabf8322ab064deca51d9 Jun 10 13:04:40.537424 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.537400 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56b975f959-8fmls"] Jun 10 13:04:40.539974 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:40.539953 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344bb8f7_93f7_4092_a37a_bd564d0c0599.slice/crio-e59625e7ac572c2b7a23f7a22a824894e2c3e75932267606444e35c78cf8441f WatchSource:0}: Error finding container e59625e7ac572c2b7a23f7a22a824894e2c3e75932267606444e35c78cf8441f: Status 404 returned error can't find the container with id e59625e7ac572c2b7a23f7a22a824894e2c3e75932267606444e35c78cf8441f Jun 10 13:04:40.544944 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.544922 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bw4nm"] Jun 10 13:04:40.549339 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:40.549318 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc343bc5_1c73_4951_9773_9c13ea4b7ad5.slice/crio-a6c96a3486829d3d57558903c2f10cd2e054b52710c24170a6e822b19064e703 WatchSource:0}: Error finding container a6c96a3486829d3d57558903c2f10cd2e054b52710c24170a6e822b19064e703: Status 404 returned error can't find the container with id a6c96a3486829d3d57558903c2f10cd2e054b52710c24170a6e822b19064e703 Jun 10 13:04:40.979029 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.978999 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:40.979185 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.979117 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:40.979244 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.979218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:40.982003 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.981984 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:04:40.982129 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.982019 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5p9\"" Jun 10 13:04:40.982129 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.982033 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:04:40.982129 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.982023 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg2hs\"" Jun 10 13:04:40.983368 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.983353 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:04:40.983451 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:40.983379 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:04:41.166070 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:41.166038 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bw4nm" event={"ID":"bc343bc5-1c73-4951-9773-9c13ea4b7ad5","Type":"ContainerStarted","Data":"a6c96a3486829d3d57558903c2f10cd2e054b52710c24170a6e822b19064e703"} Jun 10 13:04:41.167444 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:41.167412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bpds" event={"ID":"e3971888-c652-4a5c-baf8-1172ccffa13b","Type":"ContainerStarted","Data":"536df913ff2da0ceea7bf867d1ba7b2b3add99cd139cabf8322ab064deca51d9"} Jun 10 13:04:41.169352 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:41.169305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b975f959-8fmls" event={"ID":"344bb8f7-93f7-4092-a37a-bd564d0c0599","Type":"ContainerStarted","Data":"3984290d5507f2448a18aee623e6d5b139318e6f19d405d41e4536be457ad5f8"} Jun 10 13:04:41.169501 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:41.169352 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56b975f959-8fmls" event={"ID":"344bb8f7-93f7-4092-a37a-bd564d0c0599","Type":"ContainerStarted","Data":"e59625e7ac572c2b7a23f7a22a824894e2c3e75932267606444e35c78cf8441f"} Jun 10 13:04:41.169501 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:41.169395 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:04:43.176800 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:43.176721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bpds" event={"ID":"e3971888-c652-4a5c-baf8-1172ccffa13b","Type":"ContainerStarted","Data":"bf55625fc7994ecb6ac5492541a284de9bded2e70e9243a6af79bbb2a43209bc"} Jun 10 13:04:43.177169 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:43.176800 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8bpds" event={"ID":"e3971888-c652-4a5c-baf8-1172ccffa13b","Type":"ContainerStarted","Data":"47b7e9eb35e630ccbd2bca6fe4198ad03ed95284b1a8d0962a481709d0e94930"} Jun 10 13:04:43.177169 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:43.176829 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:43.178246 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:43.178218 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bw4nm" event={"ID":"bc343bc5-1c73-4951-9773-9c13ea4b7ad5","Type":"ContainerStarted","Data":"09cf14e1f1478c7ad869897b77b798b319dde90e74732d0aea236f4222fb1f21"} Jun 10 13:04:43.197715 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:43.197676 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56b975f959-8fmls" podStartSLOduration=5.197664032 podStartE2EDuration="5.197664032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:41.190605312 +0000 UTC m=+53.601999896" watchObservedRunningTime="2026-06-10 13:04:43.197664032 +0000 UTC m=+55.609058609" Jun 10 13:04:43.197819 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:43.197770 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8bpds" podStartSLOduration=1.907640039 podStartE2EDuration="4.197766499s" totalImagesPullingTime="2.29012646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:43.196049894 +0000 UTC m=+55.607444477" watchObservedRunningTime="2026-06-10 13:04:43.197766499 +0000 UTC m=+55.609161082" Jun 10 13:04:43.213404 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:43.213368 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bw4nm" podStartSLOduration=1.963812736 podStartE2EDuration="4.213355518s" totalImagesPullingTime="2.249542782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:43.213098741 +0000 UTC m=+55.624493325" watchObservedRunningTime="2026-06-10 13:04:43.213355518 +0000 UTC m=+55.624750101" Jun 10 13:04:48.121365 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:48.121333 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lrmgf" Jun 10 13:04:50.590719 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:50.590684 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bpds_e3971888-c652-4a5c-baf8-1172ccffa13b/dns/0.log" Jun 10 13:04:50.790366 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:50.790339 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bpds_e3971888-c652-4a5c-baf8-1172ccffa13b/kube-rbac-proxy/0.log" Jun 10 13:04:51.790140 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.790114 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4n29w_75815153-68d2-46a9-92f6-0c997d983cbe/dns-node-resolver/0.log" Jun 10 13:04:51.892171 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.892144 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7s8g2"] Jun 10 13:04:51.896167 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.896149 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:51.898710 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.898683 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 13:04:51.898859 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.898795 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 13:04:51.900200 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.900185 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 13:04:51.900307 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.900219 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 13:04:51.900307 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.900289 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ncwrn\"" Jun 10 13:04:51.906011 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:51.905992 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7s8g2"] Jun 10 13:04:52.005114 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.005093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f15ea878-02a2-46c2-867d-817a7cff2ac7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.005222 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.005138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f15ea878-02a2-46c2-867d-817a7cff2ac7-crio-socket\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.005222 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.005155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f15ea878-02a2-46c2-867d-817a7cff2ac7-data-volume\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.005313 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.005231 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f15ea878-02a2-46c2-867d-817a7cff2ac7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.005313 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.005258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tc82\" (UniqueName: \"kubernetes.io/projected/f15ea878-02a2-46c2-867d-817a7cff2ac7-kube-api-access-2tc82\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.105770 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.105707 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f15ea878-02a2-46c2-867d-817a7cff2ac7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.105770 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.105757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tc82\" (UniqueName: \"kubernetes.io/projected/f15ea878-02a2-46c2-867d-817a7cff2ac7-kube-api-access-2tc82\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.105891 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.105791 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f15ea878-02a2-46c2-867d-817a7cff2ac7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.105891 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.105838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f15ea878-02a2-46c2-867d-817a7cff2ac7-crio-socket\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.105891 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.105861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f15ea878-02a2-46c2-867d-817a7cff2ac7-data-volume\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.106036 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.105944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f15ea878-02a2-46c2-867d-817a7cff2ac7-crio-socket\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.106036 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:52.105954 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 10 13:04:52.106129 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:52.106038 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15ea878-02a2-46c2-867d-817a7cff2ac7-insights-runtime-extractor-tls podName:f15ea878-02a2-46c2-867d-817a7cff2ac7 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:52.606018504 +0000 UTC m=+65.017413069 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f15ea878-02a2-46c2-867d-817a7cff2ac7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7s8g2" (UID: "f15ea878-02a2-46c2-867d-817a7cff2ac7") : secret "insights-runtime-extractor-tls" not found Jun 10 13:04:52.106190 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.106134 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f15ea878-02a2-46c2-867d-817a7cff2ac7-data-volume\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.106411 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.106393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f15ea878-02a2-46c2-867d-817a7cff2ac7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.115596 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.115579 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tc82\" (UniqueName: \"kubernetes.io/projected/f15ea878-02a2-46c2-867d-817a7cff2ac7-kube-api-access-2tc82\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.390290 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.390180 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56b975f959-8fmls_344bb8f7-93f7-4092-a37a-bd564d0c0599/registry/0.log" Jun 10 13:04:52.610047 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.610004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f15ea878-02a2-46c2-867d-817a7cff2ac7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.612311 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.612285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f15ea878-02a2-46c2-867d-817a7cff2ac7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7s8g2\" (UID: \"f15ea878-02a2-46c2-867d-817a7cff2ac7\") " pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.804970 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.804942 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7s8g2" Jun 10 13:04:52.924334 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.924303 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7s8g2"] Jun 10 13:04:52.928038 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:52.928014 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15ea878_02a2_46c2_867d_817a7cff2ac7.slice/crio-f02a888b8650f7e7a43e160eb62b5c1f7306540e27542ba9bb8e59a9876244af WatchSource:0}: Error finding container f02a888b8650f7e7a43e160eb62b5c1f7306540e27542ba9bb8e59a9876244af: Status 404 returned error can't find the container with id f02a888b8650f7e7a43e160eb62b5c1f7306540e27542ba9bb8e59a9876244af Jun 10 13:04:52.991763 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:52.991745 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nxc4h_7f59a632-66ab-4eeb-b763-dcd0d57fbf67/node-ca/0.log" Jun 10 13:04:53.182733 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.182663 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8bpds" Jun 10 13:04:53.201612 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.201571 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s8g2" event={"ID":"f15ea878-02a2-46c2-867d-817a7cff2ac7","Type":"ContainerStarted","Data":"4ef4d76a018daa27aca528830e8cfbbf79a316a87d4a8a2beb7599a5a880ef65"} Jun 10 13:04:53.201729 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.201625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s8g2" event={"ID":"f15ea878-02a2-46c2-867d-817a7cff2ac7","Type":"ContainerStarted","Data":"f02a888b8650f7e7a43e160eb62b5c1f7306540e27542ba9bb8e59a9876244af"} Jun 10 13:04:53.590912 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.590892 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bw4nm_bc343bc5-1c73-4951-9773-9c13ea4b7ad5/serve-healthcheck-canary/0.log" Jun 10 13:04:53.819003 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.818938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:53.819003 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.818988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:53.819381 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.819008 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:53.821868 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.821847 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 13:04:53.821921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.821847 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 13:04:53.821971 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.821915 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 13:04:53.831443 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.831421 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2d19bf21-6f90-411e-8268-61e8d42366be-original-pull-secret\") pod \"global-pull-secret-syncer-pj8zt\" (UID: \"2d19bf21-6f90-411e-8268-61e8d42366be\") " pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:53.831535 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.831451 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/104639b3-1c70-4ec1-897d-c8abf5be1dd3-metrics-certs\") pod \"network-metrics-daemon-v7qj9\" (UID: \"104639b3-1c70-4ec1-897d-c8abf5be1dd3\") " pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:53.831949 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.831921 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 13:04:53.841713 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.841693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk8hh\" (UniqueName: \"kubernetes.io/projected/ef2fddae-c747-4edc-a347-5e48608f2b78-kube-api-access-dk8hh\") pod \"network-check-target-xghct\" (UID: \"ef2fddae-c747-4edc-a347-5e48608f2b78\") " pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:53.891556 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.891538 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qf5p9\"" Jun 10 13:04:53.894828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.894814 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pj8zt" Jun 10 13:04:53.898761 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.898747 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:53.901470 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.901443 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cg2hs\"" Jun 10 13:04:53.909042 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:53.909024 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-v7qj9" Jun 10 13:04:54.035464 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:54.035436 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xghct"] Jun 10 13:04:54.039066 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:54.039035 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2fddae_c747_4edc_a347_5e48608f2b78.slice/crio-6ee2bafb97d468f981cb63e4752473adcba2ec3b775104c6073381d8f2524aee WatchSource:0}: Error finding container 6ee2bafb97d468f981cb63e4752473adcba2ec3b775104c6073381d8f2524aee: Status 404 returned error can't find the container with id 6ee2bafb97d468f981cb63e4752473adcba2ec3b775104c6073381d8f2524aee Jun 10 13:04:54.049086 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:54.049067 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pj8zt"] Jun 10 13:04:54.051497 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:54.051475 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d19bf21_6f90_411e_8268_61e8d42366be.slice/crio-8b7281f73d4fd1e6c527071db99cee28cbc29383c0966d2bff877e69431940cf WatchSource:0}: Error finding container 8b7281f73d4fd1e6c527071db99cee28cbc29383c0966d2bff877e69431940cf: Status 404 returned error can't find the container with id 8b7281f73d4fd1e6c527071db99cee28cbc29383c0966d2bff877e69431940cf Jun 10 13:04:54.065022 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:54.064959 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-v7qj9"] Jun 10 13:04:54.067088 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:54.067063 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod104639b3_1c70_4ec1_897d_c8abf5be1dd3.slice/crio-b47706f77587cb177b1904971e7e8cd8dfda1bbc515a2f4bd2a840dff35b0c3b WatchSource:0}: Error finding container b47706f77587cb177b1904971e7e8cd8dfda1bbc515a2f4bd2a840dff35b0c3b: Status 404 returned error can't find the container with id b47706f77587cb177b1904971e7e8cd8dfda1bbc515a2f4bd2a840dff35b0c3b Jun 10 13:04:54.207335 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:54.207305 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s8g2" event={"ID":"f15ea878-02a2-46c2-867d-817a7cff2ac7","Type":"ContainerStarted","Data":"cee46985ede601a6b01c9ffabfb4ad5251e21b22ff4efc2735ffef00d628aa06"} Jun 10 13:04:54.208372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:54.208335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xghct" event={"ID":"ef2fddae-c747-4edc-a347-5e48608f2b78","Type":"ContainerStarted","Data":"6ee2bafb97d468f981cb63e4752473adcba2ec3b775104c6073381d8f2524aee"} Jun 10 13:04:54.209499 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:54.209477 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pj8zt" event={"ID":"2d19bf21-6f90-411e-8268-61e8d42366be","Type":"ContainerStarted","Data":"8b7281f73d4fd1e6c527071db99cee28cbc29383c0966d2bff877e69431940cf"} Jun 10 13:04:54.210755 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:54.210737 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7qj9" event={"ID":"104639b3-1c70-4ec1-897d-c8abf5be1dd3","Type":"ContainerStarted","Data":"b47706f77587cb177b1904971e7e8cd8dfda1bbc515a2f4bd2a840dff35b0c3b"} Jun 10 13:04:56.222166 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:56.221725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7s8g2" event={"ID":"f15ea878-02a2-46c2-867d-817a7cff2ac7","Type":"ContainerStarted","Data":"2dc2d030eca6d1abade9dbf4721af4e9d1e67cb95877c8e365142bd96daa6f30"} Jun 10 13:04:56.223821 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:56.223743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7qj9" event={"ID":"104639b3-1c70-4ec1-897d-c8abf5be1dd3","Type":"ContainerStarted","Data":"12b5ec0c95c7f85b4fe935e7e0a06ce6ebe0d0f0d9c8a81daeb547a8a2a0040b"} Jun 10 13:04:56.223821 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:56.223798 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-v7qj9" event={"ID":"104639b3-1c70-4ec1-897d-c8abf5be1dd3","Type":"ContainerStarted","Data":"d0c3b6883c3edcb5c1fd8de67de1f7775882f83a06e6649c8e1397622697bc7c"} Jun 10 13:04:56.243736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:56.243686 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7s8g2" podStartSLOduration=2.320192129 podStartE2EDuration="5.243667094s" totalImagesPullingTime="2.923474965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:04:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:56.242284968 +0000 UTC m=+68.653679552" watchObservedRunningTime="2026-06-10 13:04:56.243667094 +0000 UTC m=+68.655061678" Jun 10 13:04:56.265165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:56.265111 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-v7qj9" podStartSLOduration=66.377232112 podStartE2EDuration="1m8.265091896s" totalImagesPullingTime="1.887859784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:56.264201481 +0000 UTC m=+68.675596066" watchObservedRunningTime="2026-06-10 13:04:56.265091896 +0000 UTC m=+68.676486480" Jun 10 13:04:57.071255 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.071214 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k"] Jun 10 13:04:57.074479 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.074460 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.077787 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.077722 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 13:04:57.079639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.079302 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k4845\"" Jun 10 13:04:57.079639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.079337 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 13:04:57.079639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.079368 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 13:04:57.079639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.079379 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 13:04:57.079639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.079477 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 13:04:57.087247 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.087225 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k"] Jun 10 13:04:57.120305 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.120258 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ppwx9"] Jun 10 13:04:57.123638 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.123615 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.126445 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.126413 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 13:04:57.126543 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.126415 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 13:04:57.126712 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.126691 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 13:04:57.126797 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.126764 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xp6nd\"" Jun 10 13:04:57.141675 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.141645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.141772 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.141681 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53c0cbc-f268-42a1-a537-b760e5470a56-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.141772 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.141707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.141896 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.141846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9jtq\" (UniqueName: \"kubernetes.io/projected/b53c0cbc-f268-42a1-a537-b760e5470a56-kube-api-access-v9jtq\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.242511 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-wtmp\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53c0cbc-f268-42a1-a537-b760e5470a56-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242543 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a18b01d-de44-431a-a89a-87a75a4cf76f-metrics-client-ca\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-root\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242585 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-sys\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9jtq\" (UniqueName: \"kubernetes.io/projected/b53c0cbc-f268-42a1-a537-b760e5470a56-kube-api-access-v9jtq\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmkqj\" (UniqueName: \"kubernetes.io/projected/6a18b01d-de44-431a-a89a-87a75a4cf76f-kube-api-access-cmkqj\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-textfile\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242697 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-tls\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242720 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.242895 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.242820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.243320 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:57.242927 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 10 13:04:57.243320 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:57.242989 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-tls podName:b53c0cbc-f268-42a1-a537-b760e5470a56 nodeName:}" failed. No retries permitted until 2026-06-10 13:04:57.742971968 +0000 UTC m=+70.154366536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-wcz6k" (UID: "b53c0cbc-f268-42a1-a537-b760e5470a56") : secret "openshift-state-metrics-tls" not found Jun 10 13:04:57.243412 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.243317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b53c0cbc-f268-42a1-a537-b760e5470a56-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.245223 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.245200 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.258599 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.258574 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9jtq\" (UniqueName: \"kubernetes.io/projected/b53c0cbc-f268-42a1-a537-b760e5470a56-kube-api-access-v9jtq\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.343688 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.343845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343731 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-wtmp\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.343845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a18b01d-de44-431a-a89a-87a75a4cf76f-metrics-client-ca\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.343845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-root\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.343845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-sys\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344070 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343889 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmkqj\" (UniqueName: \"kubernetes.io/projected/6a18b01d-de44-431a-a89a-87a75a4cf76f-kube-api-access-cmkqj\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344070 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-textfile\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344070 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-tls\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344070 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.343989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-root\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344070 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.344023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344070 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:57.344046 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 13:04:57.344070 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.344043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-sys\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344415 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:04:57.344115 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-tls podName:6a18b01d-de44-431a-a89a-87a75a4cf76f nodeName:}" failed. No retries permitted until 2026-06-10 13:04:57.844097953 +0000 UTC m=+70.255492531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-tls") pod "node-exporter-ppwx9" (UID: "6a18b01d-de44-431a-a89a-87a75a4cf76f") : secret "node-exporter-tls" not found Jun 10 13:04:57.344415 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.344176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-wtmp\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344415 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.344229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-accelerators-collector-config\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344415 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.344291 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-textfile\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.344566 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.344544 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a18b01d-de44-431a-a89a-87a75a4cf76f-metrics-client-ca\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.346459 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.346437 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.356622 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.356601 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmkqj\" (UniqueName: \"kubernetes.io/projected/6a18b01d-de44-431a-a89a-87a75a4cf76f-kube-api-access-cmkqj\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.748117 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.748085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.750615 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.750585 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b53c0cbc-f268-42a1-a537-b760e5470a56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wcz6k\" (UID: \"b53c0cbc-f268-42a1-a537-b760e5470a56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:57.848767 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.848732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-tls\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.851346 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.851318 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6a18b01d-de44-431a-a89a-87a75a4cf76f-node-exporter-tls\") pod \"node-exporter-ppwx9\" (UID: \"6a18b01d-de44-431a-a89a-87a75a4cf76f\") " pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:57.984640 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:57.984607 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" Jun 10 13:04:58.035279 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:58.035170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ppwx9" Jun 10 13:04:58.643453 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:58.643408 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a18b01d_de44_431a_a89a_87a75a4cf76f.slice/crio-644f62cab3556f98dee4a6fd924c43dcb493aff072775c47c208f6725a78f1a1 WatchSource:0}: Error finding container 644f62cab3556f98dee4a6fd924c43dcb493aff072775c47c208f6725a78f1a1: Status 404 returned error can't find the container with id 644f62cab3556f98dee4a6fd924c43dcb493aff072775c47c208f6725a78f1a1 Jun 10 13:04:58.778986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:58.778645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k"] Jun 10 13:04:58.784364 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:04:58.784337 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb53c0cbc_f268_42a1_a537_b760e5470a56.slice/crio-ce8684ddcfbbe9ea3bad78c70993f057f9fb539c0da7072d8cb8768efc7e46b3 WatchSource:0}: Error finding container ce8684ddcfbbe9ea3bad78c70993f057f9fb539c0da7072d8cb8768efc7e46b3: Status 404 returned error can't find the container with id ce8684ddcfbbe9ea3bad78c70993f057f9fb539c0da7072d8cb8768efc7e46b3 Jun 10 13:04:59.235784 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.235748 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppwx9" event={"ID":"6a18b01d-de44-431a-a89a-87a75a4cf76f","Type":"ContainerStarted","Data":"644f62cab3556f98dee4a6fd924c43dcb493aff072775c47c208f6725a78f1a1"} Jun 10 13:04:59.238735 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.238529 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xghct" event={"ID":"ef2fddae-c747-4edc-a347-5e48608f2b78","Type":"ContainerStarted","Data":"346610cf089182380eca8bda71879d8c092642113d217317058311a2ff787276"} Jun 10 13:04:59.238901 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.238879 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:04:59.241567 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.241542 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" event={"ID":"b53c0cbc-f268-42a1-a537-b760e5470a56","Type":"ContainerStarted","Data":"bdab718a835fdd26726d326293692547470856f0e2a3160be8be1e1ada1fd085"} Jun 10 13:04:59.241703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.241612 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" event={"ID":"b53c0cbc-f268-42a1-a537-b760e5470a56","Type":"ContainerStarted","Data":"331bdc79e99af359e1d140a133ca262bfb0e1427e7d4c1e7bea17e5a038cb35c"} Jun 10 13:04:59.241703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.241643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" event={"ID":"b53c0cbc-f268-42a1-a537-b760e5470a56","Type":"ContainerStarted","Data":"ce8684ddcfbbe9ea3bad78c70993f057f9fb539c0da7072d8cb8768efc7e46b3"} Jun 10 13:04:59.242993 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.242970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pj8zt" event={"ID":"2d19bf21-6f90-411e-8268-61e8d42366be","Type":"ContainerStarted","Data":"3b9fbf21dd65b7b63d9fce1bee7edb9920176dcedf4116eb3f9198e7f5e6596c"} Jun 10 13:04:59.275045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.269033 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xghct" podStartSLOduration=66.668278951 podStartE2EDuration="1m11.269014849s" totalImagesPullingTime="4.600735898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:59.267624337 +0000 UTC m=+71.679018922" watchObservedRunningTime="2026-06-10 13:04:59.269014849 +0000 UTC m=+71.680409433" Jun 10 13:04:59.289706 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:04:59.289663 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pj8zt" podStartSLOduration=66.686034274 podStartE2EDuration="1m11.289650412s" totalImagesPullingTime="4.603616138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:04:59.28883735 +0000 UTC m=+71.700231935" watchObservedRunningTime="2026-06-10 13:04:59.289650412 +0000 UTC m=+71.701044994" Jun 10 13:05:00.078329 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.078300 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b56fcb9cd-2247t"] Jun 10 13:05:00.081421 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.081406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.084512 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.084487 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 13:05:00.084512 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.084510 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 13:05:00.084689 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.084542 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 13:05:00.084689 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.084597 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ca7dmm3eao7n2\"" Jun 10 13:05:00.084689 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.084618 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 13:05:00.084689 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.084630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 13:05:00.084689 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.084669 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xkpwj\"" Jun 10 13:05:00.091204 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.091174 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b56fcb9cd-2247t"] Jun 10 13:05:00.176966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.176905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-tls\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.176966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.176938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-grpc-tls\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.177109 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.176964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.177109 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.177008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e65304c-6968-48dc-a83c-7c7f64793f17-metrics-client-ca\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.177109 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.177046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.177109 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.177071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mq2t\" (UniqueName: \"kubernetes.io/projected/3e65304c-6968-48dc-a83c-7c7f64793f17-kube-api-access-9mq2t\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.177109 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.177103 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.177298 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.177127 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.248164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.248126 2558 generic.go:356] "Generic (PLEG): container finished" podID="6a18b01d-de44-431a-a89a-87a75a4cf76f" containerID="b07e71cb705b6ea9c593e8faed4ffc44135ced5c2298fb541e036bacf96d24d0" exitCode=0 Jun 10 13:05:00.248336 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.248175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppwx9" event={"ID":"6a18b01d-de44-431a-a89a-87a75a4cf76f","Type":"ContainerDied","Data":"b07e71cb705b6ea9c593e8faed4ffc44135ced5c2298fb541e036bacf96d24d0"} Jun 10 13:05:00.250677 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.250653 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" event={"ID":"b53c0cbc-f268-42a1-a537-b760e5470a56","Type":"ContainerStarted","Data":"9a243a3816b594b4a75c4a3c9a7b3c5432755785316ff8bfc867831f516da297"} Jun 10 13:05:00.278145 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278124 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e65304c-6968-48dc-a83c-7c7f64793f17-metrics-client-ca\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.278260 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.278260 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mq2t\" (UniqueName: \"kubernetes.io/projected/3e65304c-6968-48dc-a83c-7c7f64793f17-kube-api-access-9mq2t\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.278448 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278427 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.278513 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278476 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.278569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-tls\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.278569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-grpc-tls\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.278667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278599 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.279045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.278979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e65304c-6968-48dc-a83c-7c7f64793f17-metrics-client-ca\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.281103 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.281079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-tls\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.281219 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.281197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.281379 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.281358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.281466 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.281384 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.281555 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.281538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-grpc-tls\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.281652 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.281635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e65304c-6968-48dc-a83c-7c7f64793f17-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.288787 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.288748 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wcz6k" podStartSLOduration=2.312321499 podStartE2EDuration="3.28873486s" totalImagesPullingTime="976.413361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:00.287584384 +0000 UTC m=+72.698978968" watchObservedRunningTime="2026-06-10 13:05:00.28873486 +0000 UTC m=+72.700129443" Jun 10 13:05:00.290894 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.290871 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mq2t\" (UniqueName: \"kubernetes.io/projected/3e65304c-6968-48dc-a83c-7c7f64793f17-kube-api-access-9mq2t\") pod \"thanos-querier-6b56fcb9cd-2247t\" (UID: \"3e65304c-6968-48dc-a83c-7c7f64793f17\") " pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.389479 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.389455 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:00.543571 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:00.543537 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b56fcb9cd-2247t"] Jun 10 13:05:00.546823 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:05:00.546795 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e65304c_6968_48dc_a83c_7c7f64793f17.slice/crio-030946c3687dd96ed4aa0d4949cf1a5930d3bd562c2ad4b5155096455e23b535 WatchSource:0}: Error finding container 030946c3687dd96ed4aa0d4949cf1a5930d3bd562c2ad4b5155096455e23b535: Status 404 returned error can't find the container with id 030946c3687dd96ed4aa0d4949cf1a5930d3bd562c2ad4b5155096455e23b535 Jun 10 13:05:01.260515 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.259780 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppwx9" event={"ID":"6a18b01d-de44-431a-a89a-87a75a4cf76f","Type":"ContainerStarted","Data":"86c069e33a5fb46961b3ffbdabba903d5f1270cbb7d5ec274f807f3489ea0667"} Jun 10 13:05:01.260515 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.259850 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ppwx9" event={"ID":"6a18b01d-de44-431a-a89a-87a75a4cf76f","Type":"ContainerStarted","Data":"5509193b7f9e4867a388db143d9c4450d40af01079ace38e81dfd3d1cc378197"} Jun 10 13:05:01.264742 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.263738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" event={"ID":"3e65304c-6968-48dc-a83c-7c7f64793f17","Type":"ContainerStarted","Data":"030946c3687dd96ed4aa0d4949cf1a5930d3bd562c2ad4b5155096455e23b535"} Jun 10 13:05:01.286843 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.286792 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ppwx9" podStartSLOduration=2.998260002 podStartE2EDuration="4.286777145s" totalImagesPullingTime="1.220792984s" totalInitContainerRuntime="67.724159ms" isStatefulPod=true podCreationTimestamp="2026-06-10 13:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:01.284623345 +0000 UTC m=+73.696017929" watchObservedRunningTime="2026-06-10 13:05:01.286777145 +0000 UTC m=+73.698171727" Jun 10 13:05:01.521842 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.521758 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54c68bbfff-qbqsk"] Jun 10 13:05:01.526193 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.526168 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.529667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.529451 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 13:05:01.529667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.529468 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-78z7r\"" Jun 10 13:05:01.529667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.529530 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 13:05:01.529667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.529467 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fdb0jh943fo2l\"" Jun 10 13:05:01.531341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.530645 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 13:05:01.531341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.530773 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 13:05:01.536616 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.536588 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54c68bbfff-qbqsk"] Jun 10 13:05:01.600890 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.600853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/efaad110-fef1-4588-8d90-d95b2189ed97-metrics-server-audit-profiles\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.601072 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.600904 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-secret-metrics-server-client-certs\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.601072 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.600980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/efaad110-fef1-4588-8d90-d95b2189ed97-audit-log\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.601072 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.601034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-secret-metrics-server-tls\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.601072 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.601054 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-client-ca-bundle\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.601072 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.601072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaad110-fef1-4588-8d90-d95b2189ed97-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.601358 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.601103 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwpvj\" (UniqueName: \"kubernetes.io/projected/efaad110-fef1-4588-8d90-d95b2189ed97-kube-api-access-nwpvj\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.701638 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.701606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/efaad110-fef1-4588-8d90-d95b2189ed97-metrics-server-audit-profiles\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.701810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.701642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-secret-metrics-server-client-certs\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.701810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.701690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/efaad110-fef1-4588-8d90-d95b2189ed97-audit-log\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.701810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.701728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-secret-metrics-server-tls\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.701810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.701749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-client-ca-bundle\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.701810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.701767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaad110-fef1-4588-8d90-d95b2189ed97-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.701810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.701788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwpvj\" (UniqueName: \"kubernetes.io/projected/efaad110-fef1-4588-8d90-d95b2189ed97-kube-api-access-nwpvj\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.702458 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.702383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/efaad110-fef1-4588-8d90-d95b2189ed97-audit-log\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.702703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.702678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/efaad110-fef1-4588-8d90-d95b2189ed97-metrics-server-audit-profiles\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.703071 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.703029 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efaad110-fef1-4588-8d90-d95b2189ed97-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.704725 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.704702 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-secret-metrics-server-client-certs\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.704910 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.704882 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-secret-metrics-server-tls\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.705393 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.705350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/efaad110-fef1-4588-8d90-d95b2189ed97-client-ca-bundle\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.712684 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.712659 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwpvj\" (UniqueName: \"kubernetes.io/projected/efaad110-fef1-4588-8d90-d95b2189ed97-kube-api-access-nwpvj\") pod \"metrics-server-54c68bbfff-qbqsk\" (UID: \"efaad110-fef1-4588-8d90-d95b2189ed97\") " pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.844897 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.844525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:01.865567 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.865445 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4"] Jun 10 13:05:01.870331 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.869970 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:01.873050 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.872838 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 13:05:01.873050 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.872865 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vjv5d\"" Jun 10 13:05:01.877569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.877544 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4"] Jun 10 13:05:01.996988 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:01.996964 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54c68bbfff-qbqsk"] Jun 10 13:05:02.004489 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.004465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fz6l4\" (UID: \"bf7f1646-bab0-4639-a8ff-c2c97a6317d9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.004609 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.004507 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh46s\" (UniqueName: \"kubernetes.io/projected/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-kube-api-access-nh46s\") pod \"monitoring-plugin-76b68cc874-fz6l4\" (UID: \"bf7f1646-bab0-4639-a8ff-c2c97a6317d9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.105855 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.105783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fz6l4\" (UID: \"bf7f1646-bab0-4639-a8ff-c2c97a6317d9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.105855 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.105824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh46s\" (UniqueName: \"kubernetes.io/projected/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-kube-api-access-nh46s\") pod \"monitoring-plugin-76b68cc874-fz6l4\" (UID: \"bf7f1646-bab0-4639-a8ff-c2c97a6317d9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.106033 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:05:02.105948 2558 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 13:05:02.106033 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:05:02.106012 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-monitoring-plugin-cert podName:bf7f1646-bab0-4639-a8ff-c2c97a6317d9 nodeName:}" failed. No retries permitted until 2026-06-10 13:05:02.605996739 +0000 UTC m=+75.017391304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-fz6l4" (UID: "bf7f1646-bab0-4639-a8ff-c2c97a6317d9") : secret "monitoring-plugin-cert" not found Jun 10 13:05:02.116346 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.116326 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh46s\" (UniqueName: \"kubernetes.io/projected/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-kube-api-access-nh46s\") pod \"monitoring-plugin-76b68cc874-fz6l4\" (UID: \"bf7f1646-bab0-4639-a8ff-c2c97a6317d9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.176531 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.176507 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-56b975f959-8fmls" Jun 10 13:05:02.439136 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:05:02.439065 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefaad110_fef1_4588_8d90_d95b2189ed97.slice/crio-ae4f6f2828b3e06f1ecb3f0b2bc9796570a5a1c8779a8205a1db172dc1056e5f WatchSource:0}: Error finding container ae4f6f2828b3e06f1ecb3f0b2bc9796570a5a1c8779a8205a1db172dc1056e5f: Status 404 returned error can't find the container with id ae4f6f2828b3e06f1ecb3f0b2bc9796570a5a1c8779a8205a1db172dc1056e5f Jun 10 13:05:02.611818 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.611787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fz6l4\" (UID: \"bf7f1646-bab0-4639-a8ff-c2c97a6317d9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.614487 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.614435 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bf7f1646-bab0-4639-a8ff-c2c97a6317d9-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fz6l4\" (UID: \"bf7f1646-bab0-4639-a8ff-c2c97a6317d9\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.782036 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.782006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:02.949777 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:02.949640 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4"] Jun 10 13:05:02.953572 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:05:02.953538 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7f1646_bab0_4639_a8ff_c2c97a6317d9.slice/crio-cc81f19d26bcca570b124b76595d1f986f90305217463de2b87832f91d978abb WatchSource:0}: Error finding container cc81f19d26bcca570b124b76595d1f986f90305217463de2b87832f91d978abb: Status 404 returned error can't find the container with id cc81f19d26bcca570b124b76595d1f986f90305217463de2b87832f91d978abb Jun 10 13:05:03.273342 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.273299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" event={"ID":"efaad110-fef1-4588-8d90-d95b2189ed97","Type":"ContainerStarted","Data":"ae4f6f2828b3e06f1ecb3f0b2bc9796570a5a1c8779a8205a1db172dc1056e5f"} Jun 10 13:05:03.275225 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.275154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" event={"ID":"bf7f1646-bab0-4639-a8ff-c2c97a6317d9","Type":"ContainerStarted","Data":"cc81f19d26bcca570b124b76595d1f986f90305217463de2b87832f91d978abb"} Jun 10 13:05:03.278079 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.278052 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" event={"ID":"3e65304c-6968-48dc-a83c-7c7f64793f17","Type":"ContainerStarted","Data":"13ae08751b6ae4fc923468b0fa24ceb28551e1b642e7afa2e965e9b68b3a53f1"} Jun 10 13:05:03.278199 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.278111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" event={"ID":"3e65304c-6968-48dc-a83c-7c7f64793f17","Type":"ContainerStarted","Data":"c8d6f061b6791c4b81b352187ebd0ec5c117a718053fa19e139b3745618d1b03"} Jun 10 13:05:03.278199 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.278137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" event={"ID":"3e65304c-6968-48dc-a83c-7c7f64793f17","Type":"ContainerStarted","Data":"51d9de6cb53b682d5962204c461b9dbc6fb2c10e5c5097ef8392c594a675db04"} Jun 10 13:05:03.486208 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.486170 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-rl85m"] Jun 10 13:05:03.489345 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.489322 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-rl85m" Jun 10 13:05:03.493538 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.493516 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 13:05:03.493711 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.493694 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 13:05:03.493795 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.493740 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-srvjj\"" Jun 10 13:05:03.501096 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.501075 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-rl85m"] Jun 10 13:05:03.631285 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.631190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpzkc\" (UniqueName: \"kubernetes.io/projected/6efccd99-887f-43b2-94f2-2e3b248b952d-kube-api-access-zpzkc\") pod \"downloads-6657875f97-rl85m\" (UID: \"6efccd99-887f-43b2-94f2-2e3b248b952d\") " pod="openshift-console/downloads-6657875f97-rl85m" Jun 10 13:05:03.732685 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.732645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpzkc\" (UniqueName: \"kubernetes.io/projected/6efccd99-887f-43b2-94f2-2e3b248b952d-kube-api-access-zpzkc\") pod \"downloads-6657875f97-rl85m\" (UID: \"6efccd99-887f-43b2-94f2-2e3b248b952d\") " pod="openshift-console/downloads-6657875f97-rl85m" Jun 10 13:05:03.742758 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.742732 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpzkc\" (UniqueName: \"kubernetes.io/projected/6efccd99-887f-43b2-94f2-2e3b248b952d-kube-api-access-zpzkc\") pod \"downloads-6657875f97-rl85m\" (UID: \"6efccd99-887f-43b2-94f2-2e3b248b952d\") " pod="openshift-console/downloads-6657875f97-rl85m" Jun 10 13:05:03.799243 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:03.799212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-rl85m" Jun 10 13:05:04.438877 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:04.438835 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-rl85m"] Jun 10 13:05:04.442251 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:05:04.442228 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efccd99_887f_43b2_94f2_2e3b248b952d.slice/crio-6f1af5ea8d1608bc05d90b40e799728d524f90070645ef4e971bd8e8dab293ca WatchSource:0}: Error finding container 6f1af5ea8d1608bc05d90b40e799728d524f90070645ef4e971bd8e8dab293ca: Status 404 returned error can't find the container with id 6f1af5ea8d1608bc05d90b40e799728d524f90070645ef4e971bd8e8dab293ca Jun 10 13:05:05.287104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.287067 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" event={"ID":"3e65304c-6968-48dc-a83c-7c7f64793f17","Type":"ContainerStarted","Data":"e629f6c2fe0e8e4e48ec54602b4a3a835e2004d45807df3d0c5671ec941a7ebd"} Jun 10 13:05:05.287534 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.287132 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" event={"ID":"3e65304c-6968-48dc-a83c-7c7f64793f17","Type":"ContainerStarted","Data":"85310e25cc6450e3e4faafc2f3445de20870f98b0fb3899e5030f3dd3b1cdf77"} Jun 10 13:05:05.287534 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.287162 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" event={"ID":"3e65304c-6968-48dc-a83c-7c7f64793f17","Type":"ContainerStarted","Data":"2c39809bcdff07f139440042f4571267cce6987fbf4b45871464a1c7f76dd528"} Jun 10 13:05:05.287534 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.287297 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:05.288304 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.288283 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-rl85m" event={"ID":"6efccd99-887f-43b2-94f2-2e3b248b952d","Type":"ContainerStarted","Data":"6f1af5ea8d1608bc05d90b40e799728d524f90070645ef4e971bd8e8dab293ca"} Jun 10 13:05:05.289664 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.289642 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" event={"ID":"efaad110-fef1-4588-8d90-d95b2189ed97","Type":"ContainerStarted","Data":"dd55f4d16a846a6324b122a77531e2fc312c7d209ad48361382a3a9866fe8ace"} Jun 10 13:05:05.291024 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.291002 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" event={"ID":"bf7f1646-bab0-4639-a8ff-c2c97a6317d9","Type":"ContainerStarted","Data":"f6ea298d6a6180098f87c12bd298f0fdbe47c665a0e6386fd74bc44ed78d28f9"} Jun 10 13:05:05.291198 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.291185 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:05.295656 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.295639 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" Jun 10 13:05:05.316251 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.316200 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" podStartSLOduration=1.8014614880000002 podStartE2EDuration="5.316185668s" totalImagesPullingTime="3.51472418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:05.314452622 +0000 UTC m=+77.725847216" watchObservedRunningTime="2026-06-10 13:05:05.316185668 +0000 UTC m=+77.727580250" Jun 10 13:05:05.333707 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.333661 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" podStartSLOduration=2.469652355 podStartE2EDuration="4.333648668s" totalImagesPullingTime="1.863996313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:05.333033417 +0000 UTC m=+77.744428000" watchObservedRunningTime="2026-06-10 13:05:05.333648668 +0000 UTC m=+77.745043252" Jun 10 13:05:05.364706 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:05.364662 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fz6l4" podStartSLOduration=3.011118118 podStartE2EDuration="4.364647243s" totalImagesPullingTime="1.353529125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:05.363852 +0000 UTC m=+77.775246584" watchObservedRunningTime="2026-06-10 13:05:05.364647243 +0000 UTC m=+77.776041829" Jun 10 13:05:11.302139 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:11.302110 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b56fcb9cd-2247t" Jun 10 13:05:14.979173 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.979141 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59566fd46d-x6686"] Jun 10 13:05:14.984224 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.984202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:14.986856 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.986838 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 13:05:14.988229 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.988210 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 13:05:14.988339 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.988238 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-cmn4z\"" Jun 10 13:05:14.988339 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.988244 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 13:05:14.988646 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.988538 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 13:05:14.988646 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.988558 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 13:05:14.994624 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:14.994535 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59566fd46d-x6686"] Jun 10 13:05:15.126835 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.126807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-serving-cert\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.127011 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.126856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-oauth-serving-cert\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.127011 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.126922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmczj\" (UniqueName: \"kubernetes.io/projected/e4882db2-7b72-45fe-869c-42a1b7b22231-kube-api-access-dmczj\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.127011 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.126967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-service-ca\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.127148 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.127042 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-console-config\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.127148 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.127086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-oauth-config\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.228201 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-oauth-serving-cert\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.228372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmczj\" (UniqueName: \"kubernetes.io/projected/e4882db2-7b72-45fe-869c-42a1b7b22231-kube-api-access-dmczj\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.228372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-service-ca\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.228372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-console-config\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.228372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-oauth-config\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.228572 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-serving-cert\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.229018 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228992 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-oauth-serving-cert\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.229140 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.228991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-service-ca\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.229256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.229207 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-console-config\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.231461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.231440 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-oauth-config\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.231575 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.231558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-serving-cert\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.238885 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.238859 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmczj\" (UniqueName: \"kubernetes.io/projected/e4882db2-7b72-45fe-869c-42a1b7b22231-kube-api-access-dmczj\") pod \"console-59566fd46d-x6686\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.297503 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.297475 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:15.441062 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:15.441041 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59566fd46d-x6686"] Jun 10 13:05:15.443355 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:05:15.443323 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4882db2_7b72_45fe_869c_42a1b7b22231.slice/crio-62f65da721f73ca49c720328c2db3b3abc221d8bc6ffabf36391d758475c75f3 WatchSource:0}: Error finding container 62f65da721f73ca49c720328c2db3b3abc221d8bc6ffabf36391d758475c75f3: Status 404 returned error can't find the container with id 62f65da721f73ca49c720328c2db3b3abc221d8bc6ffabf36391d758475c75f3 Jun 10 13:05:16.336972 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:16.336931 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59566fd46d-x6686" event={"ID":"e4882db2-7b72-45fe-869c-42a1b7b22231","Type":"ContainerStarted","Data":"62f65da721f73ca49c720328c2db3b3abc221d8bc6ffabf36391d758475c75f3"} Jun 10 13:05:21.845136 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:21.845097 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:21.845728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:21.845212 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:23.366010 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.365939 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-rl85m" event={"ID":"6efccd99-887f-43b2-94f2-2e3b248b952d","Type":"ContainerStarted","Data":"3aed5705c70057d360e1650b4e3182f40ab06b5076f416e20e58edceaf63f644"} Jun 10 13:05:23.366524 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.366165 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-rl85m" Jun 10 13:05:23.387398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.387371 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-rl85m" Jun 10 13:05:23.390640 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.390587 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-rl85m" podStartSLOduration=2.202618793 podStartE2EDuration="20.390568812s" totalImagesPullingTime="18.187950019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:23.389204378 +0000 UTC m=+95.800599163" watchObservedRunningTime="2026-06-10 13:05:23.390568812 +0000 UTC m=+95.801963396" Jun 10 13:05:23.813667 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.813611 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dcfb79cbf-j4lkc"] Jun 10 13:05:23.818889 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.818861 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.830320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.828828 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcfb79cbf-j4lkc"] Jun 10 13:05:23.830320 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.829864 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 13:05:23.897339 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.897282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-oauth-config\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.897545 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.897354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-trusted-ca-bundle\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.897545 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.897385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-serving-cert\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.897545 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.897408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-oauth-serving-cert\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.897859 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.897563 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-service-ca\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.897859 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.897608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-console-config\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.897859 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.897633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8wqm\" (UniqueName: \"kubernetes.io/projected/194cf082-5de7-40b1-869a-b097fe379ca5-kube-api-access-b8wqm\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.998085 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.998052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-trusted-ca-bundle\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.998085 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.998085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-serving-cert\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.998350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.998110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-oauth-serving-cert\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.998350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.998176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-service-ca\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.998350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.998211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-console-config\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.998350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.998234 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8wqm\" (UniqueName: \"kubernetes.io/projected/194cf082-5de7-40b1-869a-b097fe379ca5-kube-api-access-b8wqm\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.998350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.998308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-oauth-config\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.999051 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.999024 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-trusted-ca-bundle\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.999165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.999132 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-oauth-serving-cert\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.999621 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.999593 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-console-config\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:23.999837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:23.999810 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-service-ca\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:24.001129 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:24.001108 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-oauth-config\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:24.001314 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:24.001292 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-serving-cert\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:24.010392 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:24.010370 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8wqm\" (UniqueName: \"kubernetes.io/projected/194cf082-5de7-40b1-869a-b097fe379ca5-kube-api-access-b8wqm\") pod \"console-7dcfb79cbf-j4lkc\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:24.135058 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:24.134900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:24.342158 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:24.342074 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dcfb79cbf-j4lkc"] Jun 10 13:05:24.349064 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:05:24.349024 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194cf082_5de7_40b1_869a_b097fe379ca5.slice/crio-ec5cb9acb1b97b166300d2714efa70e098333e33aff6b9a9e85be1bf83d0f8b3 WatchSource:0}: Error finding container ec5cb9acb1b97b166300d2714efa70e098333e33aff6b9a9e85be1bf83d0f8b3: Status 404 returned error can't find the container with id ec5cb9acb1b97b166300d2714efa70e098333e33aff6b9a9e85be1bf83d0f8b3 Jun 10 13:05:24.373047 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:24.372951 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcfb79cbf-j4lkc" event={"ID":"194cf082-5de7-40b1-869a-b097fe379ca5","Type":"ContainerStarted","Data":"ec5cb9acb1b97b166300d2714efa70e098333e33aff6b9a9e85be1bf83d0f8b3"} Jun 10 13:05:28.395841 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:28.395803 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcfb79cbf-j4lkc" event={"ID":"194cf082-5de7-40b1-869a-b097fe379ca5","Type":"ContainerStarted","Data":"a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41"} Jun 10 13:05:28.397616 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:28.397590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59566fd46d-x6686" event={"ID":"e4882db2-7b72-45fe-869c-42a1b7b22231","Type":"ContainerStarted","Data":"54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c"} Jun 10 13:05:28.415006 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:28.414951 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dcfb79cbf-j4lkc" podStartSLOduration=2.441502248 podStartE2EDuration="5.414931777s" totalImagesPullingTime="2.973429529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:28.413897469 +0000 UTC m=+100.825292053" watchObservedRunningTime="2026-06-10 13:05:28.414931777 +0000 UTC m=+100.826326337" Jun 10 13:05:28.432958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:28.432913 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59566fd46d-x6686" podStartSLOduration=2.560647713 podStartE2EDuration="14.432898984s" totalImagesPullingTime="11.872251271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:05:28.43194471 +0000 UTC m=+100.843339294" watchObservedRunningTime="2026-06-10 13:05:28.432898984 +0000 UTC m=+100.844293567" Jun 10 13:05:30.253922 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:30.253890 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xghct" Jun 10 13:05:34.135837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:34.135801 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:34.136513 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:34.135864 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:34.140545 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:34.140527 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:34.424635 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:34.424563 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:05:34.485105 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:34.485077 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59566fd46d-x6686"] Jun 10 13:05:35.298361 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:35.298330 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:41.849869 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:41.849842 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:41.853488 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:41.853456 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54c68bbfff-qbqsk" Jun 10 13:05:59.506722 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.506663 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59566fd46d-x6686" podUID="e4882db2-7b72-45fe-869c-42a1b7b22231" containerName="console" containerID="cri-o://54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c" gracePeriod=15 Jun 10 13:05:59.789442 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.789386 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:05:59.873503 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873478 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-oauth-config\") pod \"e4882db2-7b72-45fe-869c-42a1b7b22231\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " Jun 10 13:05:59.873632 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873510 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-oauth-serving-cert\") pod \"e4882db2-7b72-45fe-869c-42a1b7b22231\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " Jun 10 13:05:59.873632 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873531 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-service-ca\") pod \"e4882db2-7b72-45fe-869c-42a1b7b22231\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " Jun 10 13:05:59.873632 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873554 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-console-config\") pod \"e4882db2-7b72-45fe-869c-42a1b7b22231\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " Jun 10 13:05:59.873787 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873765 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-serving-cert\") pod \"e4882db2-7b72-45fe-869c-42a1b7b22231\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " Jun 10 13:05:59.873844 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873828 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmczj\" (UniqueName: \"kubernetes.io/projected/e4882db2-7b72-45fe-869c-42a1b7b22231-kube-api-access-dmczj\") pod \"e4882db2-7b72-45fe-869c-42a1b7b22231\" (UID: \"e4882db2-7b72-45fe-869c-42a1b7b22231\") " Jun 10 13:05:59.873952 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873925 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-console-config" (OuterVolumeSpecName: "console-config") pod "e4882db2-7b72-45fe-869c-42a1b7b22231" (UID: "e4882db2-7b72-45fe-869c-42a1b7b22231"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:05:59.873952 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873931 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4882db2-7b72-45fe-869c-42a1b7b22231" (UID: "e4882db2-7b72-45fe-869c-42a1b7b22231"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:05:59.873952 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.873939 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4882db2-7b72-45fe-869c-42a1b7b22231" (UID: "e4882db2-7b72-45fe-869c-42a1b7b22231"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:05:59.874148 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.874110 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-oauth-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:05:59.874148 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.874122 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-service-ca\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:05:59.874148 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.874131 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4882db2-7b72-45fe-869c-42a1b7b22231-console-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:05:59.875791 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.875763 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4882db2-7b72-45fe-869c-42a1b7b22231-kube-api-access-dmczj" (OuterVolumeSpecName: "kube-api-access-dmczj") pod "e4882db2-7b72-45fe-869c-42a1b7b22231" (UID: "e4882db2-7b72-45fe-869c-42a1b7b22231"). InnerVolumeSpecName "kube-api-access-dmczj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:05:59.875791 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.875776 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4882db2-7b72-45fe-869c-42a1b7b22231" (UID: "e4882db2-7b72-45fe-869c-42a1b7b22231"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:05:59.875922 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.875852 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4882db2-7b72-45fe-869c-42a1b7b22231" (UID: "e4882db2-7b72-45fe-869c-42a1b7b22231"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:05:59.974789 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.974764 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmczj\" (UniqueName: \"kubernetes.io/projected/e4882db2-7b72-45fe-869c-42a1b7b22231-kube-api-access-dmczj\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:05:59.974789 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.974785 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-oauth-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:05:59.974937 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:05:59.974795 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4882db2-7b72-45fe-869c-42a1b7b22231-console-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:00.509161 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.509128 2558 generic.go:356] "Generic (PLEG): container finished" podID="e4882db2-7b72-45fe-869c-42a1b7b22231" containerID="54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c" exitCode=0 Jun 10 13:06:00.509582 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.509166 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59566fd46d-x6686" Jun 10 13:06:00.509582 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.509181 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59566fd46d-x6686" event={"ID":"e4882db2-7b72-45fe-869c-42a1b7b22231","Type":"ContainerDied","Data":"54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c"} Jun 10 13:06:00.509582 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.509229 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59566fd46d-x6686" event={"ID":"e4882db2-7b72-45fe-869c-42a1b7b22231","Type":"ContainerDied","Data":"62f65da721f73ca49c720328c2db3b3abc221d8bc6ffabf36391d758475c75f3"} Jun 10 13:06:00.509582 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.509258 2558 scope.go:117] "RemoveContainer" containerID="54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c" Jun 10 13:06:00.516927 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.516910 2558 scope.go:117] "RemoveContainer" containerID="54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c" Jun 10 13:06:00.517163 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:06:00.517144 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c\": container with ID starting with 54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c not found: ID does not exist" containerID="54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c" Jun 10 13:06:00.517216 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.517171 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c"} err="failed to get container status \"54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c\": rpc error: code = NotFound desc = could not find container \"54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c\": container with ID starting with 54d523e33f13cecc3c4d3bd7f339464e8087dfbd0d6526a1f5a0c514d25fe65c not found: ID does not exist" Jun 10 13:06:00.544690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.544672 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ccbb68ccb-bspvz"] Jun 10 13:06:00.544919 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.544908 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4882db2-7b72-45fe-869c-42a1b7b22231" containerName="console" Jun 10 13:06:00.544959 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.544920 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4882db2-7b72-45fe-869c-42a1b7b22231" containerName="console" Jun 10 13:06:00.544992 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.544970 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4882db2-7b72-45fe-869c-42a1b7b22231" containerName="console" Jun 10 13:06:00.580301 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.580262 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ccbb68ccb-bspvz"] Jun 10 13:06:00.580301 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.580306 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59566fd46d-x6686"] Jun 10 13:06:00.580301 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.580319 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59566fd46d-x6686"] Jun 10 13:06:00.580546 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.580368 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.680151 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.680125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-oauth-config\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.680254 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.680154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-oauth-serving-cert\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.680254 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.680228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-service-ca\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.680254 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.680250 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-console-config\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.680375 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.680287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-trusted-ca-bundle\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.680375 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.680320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrbg2\" (UniqueName: \"kubernetes.io/projected/44b73609-3329-420d-b2c4-ac9c182421ee-kube-api-access-zrbg2\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.680375 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.680342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-serving-cert\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.780955 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.780903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-service-ca\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.780955 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.780930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-console-config\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.780955 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.780947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-trusted-ca-bundle\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781149 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.780963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrbg2\" (UniqueName: \"kubernetes.io/projected/44b73609-3329-420d-b2c4-ac9c182421ee-kube-api-access-zrbg2\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781149 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.780984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-serving-cert\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781149 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.781010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-oauth-config\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781149 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.781025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-oauth-serving-cert\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781777 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.781751 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-service-ca\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781887 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.781787 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-console-config\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781887 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.781871 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-oauth-serving-cert\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.781887 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.781878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-trusted-ca-bundle\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.783307 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.783286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-oauth-config\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.783489 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.783473 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-serving-cert\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.790427 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.790408 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrbg2\" (UniqueName: \"kubernetes.io/projected/44b73609-3329-420d-b2c4-ac9c182421ee-kube-api-access-zrbg2\") pod \"console-7ccbb68ccb-bspvz\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:00.888778 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:00.888752 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:01.046767 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:01.046617 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ccbb68ccb-bspvz"] Jun 10 13:06:01.049548 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:06:01.049522 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b73609_3329_420d_b2c4_ac9c182421ee.slice/crio-a2de17ef18e3913c0d8ef7536089ee5e71de9080b03e89acd5e1faa5a1391c5e WatchSource:0}: Error finding container a2de17ef18e3913c0d8ef7536089ee5e71de9080b03e89acd5e1faa5a1391c5e: Status 404 returned error can't find the container with id a2de17ef18e3913c0d8ef7536089ee5e71de9080b03e89acd5e1faa5a1391c5e Jun 10 13:06:01.516007 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:01.515970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbb68ccb-bspvz" event={"ID":"44b73609-3329-420d-b2c4-ac9c182421ee","Type":"ContainerStarted","Data":"3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d"} Jun 10 13:06:01.516379 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:01.516029 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbb68ccb-bspvz" event={"ID":"44b73609-3329-420d-b2c4-ac9c182421ee","Type":"ContainerStarted","Data":"a2de17ef18e3913c0d8ef7536089ee5e71de9080b03e89acd5e1faa5a1391c5e"} Jun 10 13:06:01.540920 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:01.540870 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ccbb68ccb-bspvz" podStartSLOduration=1.540856008 podStartE2EDuration="1.540856008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:06:01.540326643 +0000 UTC m=+133.951721219" watchObservedRunningTime="2026-06-10 13:06:01.540856008 +0000 UTC m=+133.952250591" Jun 10 13:06:01.982945 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:01.982919 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4882db2-7b72-45fe-869c-42a1b7b22231" path="/var/lib/kubelet/pods/e4882db2-7b72-45fe-869c-42a1b7b22231/volumes" Jun 10 13:06:10.888952 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:10.888916 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:10.889424 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:10.888976 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:10.893442 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:10.893421 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:11.557495 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:11.557466 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:06:11.631358 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:11.631331 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcfb79cbf-j4lkc"] Jun 10 13:06:36.650166 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:36.650047 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7dcfb79cbf-j4lkc" podUID="194cf082-5de7-40b1-869a-b097fe379ca5" containerName="console" containerID="cri-o://a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41" gracePeriod=15 Jun 10 13:06:36.896335 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:36.896313 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:06:37.035560 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035537 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-console-config\") pod \"194cf082-5de7-40b1-869a-b097fe379ca5\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " Jun 10 13:06:37.035728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035580 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-oauth-serving-cert\") pod \"194cf082-5de7-40b1-869a-b097fe379ca5\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " Jun 10 13:06:37.035728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035600 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-oauth-config\") pod \"194cf082-5de7-40b1-869a-b097fe379ca5\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " Jun 10 13:06:37.035728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035616 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8wqm\" (UniqueName: \"kubernetes.io/projected/194cf082-5de7-40b1-869a-b097fe379ca5-kube-api-access-b8wqm\") pod \"194cf082-5de7-40b1-869a-b097fe379ca5\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " Jun 10 13:06:37.035728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035649 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-trusted-ca-bundle\") pod \"194cf082-5de7-40b1-869a-b097fe379ca5\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " Jun 10 13:06:37.035728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035674 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-service-ca\") pod \"194cf082-5de7-40b1-869a-b097fe379ca5\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " Jun 10 13:06:37.035728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035698 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-serving-cert\") pod \"194cf082-5de7-40b1-869a-b097fe379ca5\" (UID: \"194cf082-5de7-40b1-869a-b097fe379ca5\") " Jun 10 13:06:37.036029 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.035940 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-console-config" (OuterVolumeSpecName: "console-config") pod "194cf082-5de7-40b1-869a-b097fe379ca5" (UID: "194cf082-5de7-40b1-869a-b097fe379ca5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:06:37.036100 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.036080 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "194cf082-5de7-40b1-869a-b097fe379ca5" (UID: "194cf082-5de7-40b1-869a-b097fe379ca5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:06:37.036183 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.036158 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "194cf082-5de7-40b1-869a-b097fe379ca5" (UID: "194cf082-5de7-40b1-869a-b097fe379ca5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:06:37.036183 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.036154 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-service-ca" (OuterVolumeSpecName: "service-ca") pod "194cf082-5de7-40b1-869a-b097fe379ca5" (UID: "194cf082-5de7-40b1-869a-b097fe379ca5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:06:37.037766 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.037736 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "194cf082-5de7-40b1-869a-b097fe379ca5" (UID: "194cf082-5de7-40b1-869a-b097fe379ca5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:06:37.037862 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.037772 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "194cf082-5de7-40b1-869a-b097fe379ca5" (UID: "194cf082-5de7-40b1-869a-b097fe379ca5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:06:37.037919 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.037865 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194cf082-5de7-40b1-869a-b097fe379ca5-kube-api-access-b8wqm" (OuterVolumeSpecName: "kube-api-access-b8wqm") pod "194cf082-5de7-40b1-869a-b097fe379ca5" (UID: "194cf082-5de7-40b1-869a-b097fe379ca5"). InnerVolumeSpecName "kube-api-access-b8wqm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:06:37.137104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.137085 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-trusted-ca-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:37.137104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.137105 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-service-ca\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:37.137227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.137114 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:37.137227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.137123 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-console-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:37.137227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.137131 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/194cf082-5de7-40b1-869a-b097fe379ca5-oauth-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:37.137227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.137139 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/194cf082-5de7-40b1-869a-b097fe379ca5-console-oauth-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:37.137227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.137146 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8wqm\" (UniqueName: \"kubernetes.io/projected/194cf082-5de7-40b1-869a-b097fe379ca5-kube-api-access-b8wqm\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:06:37.648123 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.648093 2558 generic.go:356] "Generic (PLEG): container finished" podID="194cf082-5de7-40b1-869a-b097fe379ca5" containerID="a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41" exitCode=0 Jun 10 13:06:37.648256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.648141 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dcfb79cbf-j4lkc" Jun 10 13:06:37.648256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.648179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcfb79cbf-j4lkc" event={"ID":"194cf082-5de7-40b1-869a-b097fe379ca5","Type":"ContainerDied","Data":"a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41"} Jun 10 13:06:37.648256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.648228 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dcfb79cbf-j4lkc" event={"ID":"194cf082-5de7-40b1-869a-b097fe379ca5","Type":"ContainerDied","Data":"ec5cb9acb1b97b166300d2714efa70e098333e33aff6b9a9e85be1bf83d0f8b3"} Jun 10 13:06:37.648256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.648251 2558 scope.go:117] "RemoveContainer" containerID="a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41" Jun 10 13:06:37.656853 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.656729 2558 scope.go:117] "RemoveContainer" containerID="a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41" Jun 10 13:06:37.657040 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:06:37.656963 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41\": container with ID starting with a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41 not found: ID does not exist" containerID="a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41" Jun 10 13:06:37.657040 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.656987 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41"} err="failed to get container status \"a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41\": rpc error: code = NotFound desc = could not find container \"a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41\": container with ID starting with a5934d4e22439addd821fda56875e0ddcd83c35cf30be9a9dde88c8ae819be41 not found: ID does not exist" Jun 10 13:06:37.683186 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.683162 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dcfb79cbf-j4lkc"] Jun 10 13:06:37.685624 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.685607 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dcfb79cbf-j4lkc"] Jun 10 13:06:37.983555 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:06:37.983530 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194cf082-5de7-40b1-869a-b097fe379ca5" path="/var/lib/kubelet/pods/194cf082-5de7-40b1-869a-b097fe379ca5/volumes" Jun 10 13:07:05.226599 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.226564 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4"] Jun 10 13:07:05.226986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.226839 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194cf082-5de7-40b1-869a-b097fe379ca5" containerName="console" Jun 10 13:07:05.226986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.226854 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="194cf082-5de7-40b1-869a-b097fe379ca5" containerName="console" Jun 10 13:07:05.226986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.226900 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="194cf082-5de7-40b1-869a-b097fe379ca5" containerName="console" Jun 10 13:07:05.229931 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.229915 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.234203 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.234180 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jvvb\"" Jun 10 13:07:05.234341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.234250 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:07:05.235472 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.235454 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:07:05.246845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.246823 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4"] Jun 10 13:07:05.328735 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.328712 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6gv2\" (UniqueName: \"kubernetes.io/projected/b68c2fce-454c-4011-81e1-5d8901203b94-kube-api-access-d6gv2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.328861 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.328742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.328861 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.328838 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.429863 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.429841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6gv2\" (UniqueName: \"kubernetes.io/projected/b68c2fce-454c-4011-81e1-5d8901203b94-kube-api-access-d6gv2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.429954 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.429871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.430015 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.429996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.430286 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.430249 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.430327 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.430308 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.441589 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.441562 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6gv2\" (UniqueName: \"kubernetes.io/projected/b68c2fce-454c-4011-81e1-5d8901203b94-kube-api-access-d6gv2\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.538668 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.538648 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:05.668206 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.668170 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4"] Jun 10 13:07:05.670941 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:07:05.670908 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68c2fce_454c_4011_81e1_5d8901203b94.slice/crio-268133055e50bed3dcd9eee633fb4e19dfb5b8d2ffdb23451ef2dc7205c13756 WatchSource:0}: Error finding container 268133055e50bed3dcd9eee633fb4e19dfb5b8d2ffdb23451ef2dc7205c13756: Status 404 returned error can't find the container with id 268133055e50bed3dcd9eee633fb4e19dfb5b8d2ffdb23451ef2dc7205c13756 Jun 10 13:07:05.747481 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:05.747458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" event={"ID":"b68c2fce-454c-4011-81e1-5d8901203b94","Type":"ContainerStarted","Data":"268133055e50bed3dcd9eee633fb4e19dfb5b8d2ffdb23451ef2dc7205c13756"} Jun 10 13:07:15.784071 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:15.784037 2558 generic.go:356] "Generic (PLEG): container finished" podID="b68c2fce-454c-4011-81e1-5d8901203b94" containerID="11096d2c7909e729f5012a75a912c097fa0cdcab05b4b514c695ec0435396a92" exitCode=0 Jun 10 13:07:15.784428 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:15.784138 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" event={"ID":"b68c2fce-454c-4011-81e1-5d8901203b94","Type":"ContainerDied","Data":"11096d2c7909e729f5012a75a912c097fa0cdcab05b4b514c695ec0435396a92"} Jun 10 13:07:17.794391 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:17.794311 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" event={"ID":"b68c2fce-454c-4011-81e1-5d8901203b94","Type":"ContainerStarted","Data":"a81ce3fe991d08a1f8f36c52db2440c7245220ba18e37f954c0b0101047e21e6"} Jun 10 13:07:18.799520 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:18.799487 2558 generic.go:356] "Generic (PLEG): container finished" podID="b68c2fce-454c-4011-81e1-5d8901203b94" containerID="a81ce3fe991d08a1f8f36c52db2440c7245220ba18e37f954c0b0101047e21e6" exitCode=0 Jun 10 13:07:18.799964 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:18.799578 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" event={"ID":"b68c2fce-454c-4011-81e1-5d8901203b94","Type":"ContainerDied","Data":"a81ce3fe991d08a1f8f36c52db2440c7245220ba18e37f954c0b0101047e21e6"} Jun 10 13:07:25.829629 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:25.829591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" event={"ID":"b68c2fce-454c-4011-81e1-5d8901203b94","Type":"ContainerStarted","Data":"f0b5b07b27024259b335535c796b00f36c6b9bda0ad3a4da3a03980b50d51dc8"} Jun 10 13:07:25.872755 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:25.872702 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" podStartSLOduration=2.142966176 podStartE2EDuration="20.872687614s" totalImagesPullingTime="18.729721438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:25.870644769 +0000 UTC m=+218.282039352" watchObservedRunningTime="2026-06-10 13:07:25.872687614 +0000 UTC m=+218.284082197" Jun 10 13:07:26.834752 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:26.834719 2558 generic.go:356] "Generic (PLEG): container finished" podID="b68c2fce-454c-4011-81e1-5d8901203b94" containerID="f0b5b07b27024259b335535c796b00f36c6b9bda0ad3a4da3a03980b50d51dc8" exitCode=0 Jun 10 13:07:26.835079 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:26.834797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" event={"ID":"b68c2fce-454c-4011-81e1-5d8901203b94","Type":"ContainerDied","Data":"f0b5b07b27024259b335535c796b00f36c6b9bda0ad3a4da3a03980b50d51dc8"} Jun 10 13:07:27.963039 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:27.963014 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:28.002188 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.002160 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6gv2\" (UniqueName: \"kubernetes.io/projected/b68c2fce-454c-4011-81e1-5d8901203b94-kube-api-access-d6gv2\") pod \"b68c2fce-454c-4011-81e1-5d8901203b94\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " Jun 10 13:07:28.002340 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.002238 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-util\") pod \"b68c2fce-454c-4011-81e1-5d8901203b94\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " Jun 10 13:07:28.002340 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.002283 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-bundle\") pod \"b68c2fce-454c-4011-81e1-5d8901203b94\" (UID: \"b68c2fce-454c-4011-81e1-5d8901203b94\") " Jun 10 13:07:28.003046 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.003022 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-bundle" (OuterVolumeSpecName: "bundle") pod "b68c2fce-454c-4011-81e1-5d8901203b94" (UID: "b68c2fce-454c-4011-81e1-5d8901203b94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:28.004875 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.004853 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b68c2fce-454c-4011-81e1-5d8901203b94-kube-api-access-d6gv2" (OuterVolumeSpecName: "kube-api-access-d6gv2") pod "b68c2fce-454c-4011-81e1-5d8901203b94" (UID: "b68c2fce-454c-4011-81e1-5d8901203b94"). InnerVolumeSpecName "kube-api-access-d6gv2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:28.006636 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.006609 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-util" (OuterVolumeSpecName: "util") pod "b68c2fce-454c-4011-81e1-5d8901203b94" (UID: "b68c2fce-454c-4011-81e1-5d8901203b94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:28.103380 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.103331 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:07:28.103380 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.103351 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6gv2\" (UniqueName: \"kubernetes.io/projected/b68c2fce-454c-4011-81e1-5d8901203b94-kube-api-access-d6gv2\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:07:28.103380 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.103361 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b68c2fce-454c-4011-81e1-5d8901203b94-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:07:28.843442 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.843421 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" Jun 10 13:07:28.843588 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.843405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnbtp4" event={"ID":"b68c2fce-454c-4011-81e1-5d8901203b94","Type":"ContainerDied","Data":"268133055e50bed3dcd9eee633fb4e19dfb5b8d2ffdb23451ef2dc7205c13756"} Jun 10 13:07:28.843588 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:28.843566 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="268133055e50bed3dcd9eee633fb4e19dfb5b8d2ffdb23451ef2dc7205c13756" Jun 10 13:07:33.991537 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991503 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz"] Jun 10 13:07:33.991958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991739 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68c2fce-454c-4011-81e1-5d8901203b94" containerName="util" Jun 10 13:07:33.991958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991749 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68c2fce-454c-4011-81e1-5d8901203b94" containerName="util" Jun 10 13:07:33.991958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991761 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68c2fce-454c-4011-81e1-5d8901203b94" containerName="pull" Jun 10 13:07:33.991958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991766 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68c2fce-454c-4011-81e1-5d8901203b94" containerName="pull" Jun 10 13:07:33.991958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991773 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b68c2fce-454c-4011-81e1-5d8901203b94" containerName="extract" Jun 10 13:07:33.991958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991779 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b68c2fce-454c-4011-81e1-5d8901203b94" containerName="extract" Jun 10 13:07:33.991958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:33.991835 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b68c2fce-454c-4011-81e1-5d8901203b94" containerName="extract" Jun 10 13:07:34.039549 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.039526 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz"] Jun 10 13:07:34.039709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.039604 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.042758 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.042737 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-n6ppq\"" Jun 10 13:07:34.042879 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.042762 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 13:07:34.044252 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.044236 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:07:34.140763 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.140738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86c1626c-8521-4af1-a32d-f038bda7c999-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wdhlz\" (UID: \"86c1626c-8521-4af1-a32d-f038bda7c999\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.140852 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.140774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s5vf\" (UniqueName: \"kubernetes.io/projected/86c1626c-8521-4af1-a32d-f038bda7c999-kube-api-access-2s5vf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wdhlz\" (UID: \"86c1626c-8521-4af1-a32d-f038bda7c999\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.241156 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.241131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86c1626c-8521-4af1-a32d-f038bda7c999-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wdhlz\" (UID: \"86c1626c-8521-4af1-a32d-f038bda7c999\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.241244 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.241163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s5vf\" (UniqueName: \"kubernetes.io/projected/86c1626c-8521-4af1-a32d-f038bda7c999-kube-api-access-2s5vf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wdhlz\" (UID: \"86c1626c-8521-4af1-a32d-f038bda7c999\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.241478 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.241461 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86c1626c-8521-4af1-a32d-f038bda7c999-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wdhlz\" (UID: \"86c1626c-8521-4af1-a32d-f038bda7c999\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.254488 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.254442 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s5vf\" (UniqueName: \"kubernetes.io/projected/86c1626c-8521-4af1-a32d-f038bda7c999-kube-api-access-2s5vf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-wdhlz\" (UID: \"86c1626c-8521-4af1-a32d-f038bda7c999\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.348441 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.348417 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" Jun 10 13:07:34.507707 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.507681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz"] Jun 10 13:07:34.509574 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:07:34.509551 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c1626c_8521_4af1_a32d_f038bda7c999.slice/crio-5e480a233028469b2afa56868c6456a942d9ead635416eecd2674749331b0e58 WatchSource:0}: Error finding container 5e480a233028469b2afa56868c6456a942d9ead635416eecd2674749331b0e58: Status 404 returned error can't find the container with id 5e480a233028469b2afa56868c6456a942d9ead635416eecd2674749331b0e58 Jun 10 13:07:34.864677 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:34.864604 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" event={"ID":"86c1626c-8521-4af1-a32d-f038bda7c999","Type":"ContainerStarted","Data":"5e480a233028469b2afa56868c6456a942d9ead635416eecd2674749331b0e58"} Jun 10 13:07:37.879409 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:37.879375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" event={"ID":"86c1626c-8521-4af1-a32d-f038bda7c999","Type":"ContainerStarted","Data":"01cfac0698ddb7aa29d159ca39cce43e200c01e57e94564107f96af754aa2096"} Jun 10 13:07:37.906994 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:37.906942 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-wdhlz" podStartSLOduration=2.409759002 podStartE2EDuration="4.906927509s" totalImagesPullingTime="2.497168507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:37.904098289 +0000 UTC m=+230.315492875" watchObservedRunningTime="2026-06-10 13:07:37.906927509 +0000 UTC m=+230.318322091" Jun 10 13:07:38.627506 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.627476 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg"] Jun 10 13:07:38.650543 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.650516 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg"] Jun 10 13:07:38.650672 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.650633 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.654214 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.654189 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:07:38.654352 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.654237 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jvvb\"" Jun 10 13:07:38.655555 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.655537 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:07:38.774146 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.774118 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzv9k\" (UniqueName: \"kubernetes.io/projected/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-kube-api-access-bzv9k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.774305 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.774154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.774305 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.774198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.874527 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.874502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.874648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.874542 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzv9k\" (UniqueName: \"kubernetes.io/projected/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-kube-api-access-bzv9k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.874648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.874568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.874904 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.874886 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.874975 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.874915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.898175 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.898122 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzv9k\" (UniqueName: \"kubernetes.io/projected/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-kube-api-access-bzv9k\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:38.960507 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:38.960484 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:39.113552 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:39.113515 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg"] Jun 10 13:07:39.117296 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:07:39.117252 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2569daf8_a6ca_4bad_86ea_1459e44fa3e8.slice/crio-13265d2a9dcf8de73386ff9295f71c63653694cbd03457ab7c2bb4e6e4f4d370 WatchSource:0}: Error finding container 13265d2a9dcf8de73386ff9295f71c63653694cbd03457ab7c2bb4e6e4f4d370: Status 404 returned error can't find the container with id 13265d2a9dcf8de73386ff9295f71c63653694cbd03457ab7c2bb4e6e4f4d370 Jun 10 13:07:39.888991 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:39.888951 2558 generic.go:356] "Generic (PLEG): container finished" podID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerID="5403b1f3fdaa7ba3a32267f52d984c569aeee6593d3fd89ccbcd9554b470f22b" exitCode=0 Jun 10 13:07:39.889295 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:39.889018 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" event={"ID":"2569daf8-a6ca-4bad-86ea-1459e44fa3e8","Type":"ContainerDied","Data":"5403b1f3fdaa7ba3a32267f52d984c569aeee6593d3fd89ccbcd9554b470f22b"} Jun 10 13:07:39.889295 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:39.889073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" event={"ID":"2569daf8-a6ca-4bad-86ea-1459e44fa3e8","Type":"ContainerStarted","Data":"13265d2a9dcf8de73386ff9295f71c63653694cbd03457ab7c2bb4e6e4f4d370"} Jun 10 13:07:40.753622 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.753583 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv"] Jun 10 13:07:40.756806 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.756786 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:40.760753 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.760732 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 13:07:40.762308 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.762259 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-644qt\"" Jun 10 13:07:40.762308 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.762299 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 13:07:40.767493 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.767473 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv"] Jun 10 13:07:40.890289 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.890229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf2f4\" (UniqueName: \"kubernetes.io/projected/704932b7-eead-4ef4-a6bc-7b038f7485bf-kube-api-access-rf2f4\") pod \"cert-manager-webhook-7dc76cbb94-xqgdv\" (UID: \"704932b7-eead-4ef4-a6bc-7b038f7485bf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:40.890509 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.890297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/704932b7-eead-4ef4-a6bc-7b038f7485bf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xqgdv\" (UID: \"704932b7-eead-4ef4-a6bc-7b038f7485bf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:40.990971 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.990935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf2f4\" (UniqueName: \"kubernetes.io/projected/704932b7-eead-4ef4-a6bc-7b038f7485bf-kube-api-access-rf2f4\") pod \"cert-manager-webhook-7dc76cbb94-xqgdv\" (UID: \"704932b7-eead-4ef4-a6bc-7b038f7485bf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:40.991131 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:40.990988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/704932b7-eead-4ef4-a6bc-7b038f7485bf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xqgdv\" (UID: \"704932b7-eead-4ef4-a6bc-7b038f7485bf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:41.001818 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:41.001794 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf2f4\" (UniqueName: \"kubernetes.io/projected/704932b7-eead-4ef4-a6bc-7b038f7485bf-kube-api-access-rf2f4\") pod \"cert-manager-webhook-7dc76cbb94-xqgdv\" (UID: \"704932b7-eead-4ef4-a6bc-7b038f7485bf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:41.001948 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:41.001826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/704932b7-eead-4ef4-a6bc-7b038f7485bf-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-xqgdv\" (UID: \"704932b7-eead-4ef4-a6bc-7b038f7485bf\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:41.080473 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:41.080404 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:41.251629 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:41.251601 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv"] Jun 10 13:07:41.253649 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:07:41.253618 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod704932b7_eead_4ef4_a6bc_7b038f7485bf.slice/crio-b744069783d7e60e3f39731ed28c57dde699b17bc3e3753a41f3a7ddfb6e9703 WatchSource:0}: Error finding container b744069783d7e60e3f39731ed28c57dde699b17bc3e3753a41f3a7ddfb6e9703: Status 404 returned error can't find the container with id b744069783d7e60e3f39731ed28c57dde699b17bc3e3753a41f3a7ddfb6e9703 Jun 10 13:07:41.899707 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:41.899672 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" event={"ID":"704932b7-eead-4ef4-a6bc-7b038f7485bf","Type":"ContainerStarted","Data":"b744069783d7e60e3f39731ed28c57dde699b17bc3e3753a41f3a7ddfb6e9703"} Jun 10 13:07:42.907535 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:42.907496 2558 generic.go:356] "Generic (PLEG): container finished" podID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerID="2ab88e9d200eeb256bc0f24c61982e58c18833b1b218f66a50caadf6c62d1476" exitCode=0 Jun 10 13:07:42.907906 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:42.907552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" event={"ID":"2569daf8-a6ca-4bad-86ea-1459e44fa3e8","Type":"ContainerDied","Data":"2ab88e9d200eeb256bc0f24c61982e58c18833b1b218f66a50caadf6c62d1476"} Jun 10 13:07:43.566921 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.566891 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p"] Jun 10 13:07:43.570000 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.569985 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.572726 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.572706 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4l6fb\"" Jun 10 13:07:43.578148 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.578125 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p"] Jun 10 13:07:43.610577 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.610554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b565d57b-a006-4d83-bcc8-dcb974382067-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-g9j8p\" (UID: \"b565d57b-a006-4d83-bcc8-dcb974382067\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.610692 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.610673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcfmz\" (UniqueName: \"kubernetes.io/projected/b565d57b-a006-4d83-bcc8-dcb974382067-kube-api-access-wcfmz\") pod \"cert-manager-cainjector-5d99449ffd-g9j8p\" (UID: \"b565d57b-a006-4d83-bcc8-dcb974382067\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.711875 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.711847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcfmz\" (UniqueName: \"kubernetes.io/projected/b565d57b-a006-4d83-bcc8-dcb974382067-kube-api-access-wcfmz\") pod \"cert-manager-cainjector-5d99449ffd-g9j8p\" (UID: \"b565d57b-a006-4d83-bcc8-dcb974382067\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.711978 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.711889 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b565d57b-a006-4d83-bcc8-dcb974382067-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-g9j8p\" (UID: \"b565d57b-a006-4d83-bcc8-dcb974382067\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.723163 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.723137 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcfmz\" (UniqueName: \"kubernetes.io/projected/b565d57b-a006-4d83-bcc8-dcb974382067-kube-api-access-wcfmz\") pod \"cert-manager-cainjector-5d99449ffd-g9j8p\" (UID: \"b565d57b-a006-4d83-bcc8-dcb974382067\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.723163 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.723159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b565d57b-a006-4d83-bcc8-dcb974382067-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-g9j8p\" (UID: \"b565d57b-a006-4d83-bcc8-dcb974382067\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.878987 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.878927 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" Jun 10 13:07:43.919752 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.919716 2558 generic.go:356] "Generic (PLEG): container finished" podID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerID="f7fefc72a5b02102cde7906bcc16d908ad5c0755c63738f6a3a30ce723bad29e" exitCode=0 Jun 10 13:07:43.920094 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:43.919797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" event={"ID":"2569daf8-a6ca-4bad-86ea-1459e44fa3e8","Type":"ContainerDied","Data":"f7fefc72a5b02102cde7906bcc16d908ad5c0755c63738f6a3a30ce723bad29e"} Jun 10 13:07:44.005488 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:44.005465 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p"] Jun 10 13:07:44.007837 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:07:44.007813 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb565d57b_a006_4d83_bcc8_dcb974382067.slice/crio-1e2a250a78a12d70086c5839b23c65babd43eae4730e15ac315a53f0e0924801 WatchSource:0}: Error finding container 1e2a250a78a12d70086c5839b23c65babd43eae4730e15ac315a53f0e0924801: Status 404 returned error can't find the container with id 1e2a250a78a12d70086c5839b23c65babd43eae4730e15ac315a53f0e0924801 Jun 10 13:07:44.926447 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:44.926413 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" event={"ID":"b565d57b-a006-4d83-bcc8-dcb974382067","Type":"ContainerStarted","Data":"1e2a250a78a12d70086c5839b23c65babd43eae4730e15ac315a53f0e0924801"} Jun 10 13:07:45.067495 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.067471 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:45.124766 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.124735 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzv9k\" (UniqueName: \"kubernetes.io/projected/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-kube-api-access-bzv9k\") pod \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " Jun 10 13:07:45.124901 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.124837 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-bundle\") pod \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " Jun 10 13:07:45.124901 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.124889 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-util\") pod \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\" (UID: \"2569daf8-a6ca-4bad-86ea-1459e44fa3e8\") " Jun 10 13:07:45.125367 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.125309 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-bundle" (OuterVolumeSpecName: "bundle") pod "2569daf8-a6ca-4bad-86ea-1459e44fa3e8" (UID: "2569daf8-a6ca-4bad-86ea-1459e44fa3e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:45.127328 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.127296 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-kube-api-access-bzv9k" (OuterVolumeSpecName: "kube-api-access-bzv9k") pod "2569daf8-a6ca-4bad-86ea-1459e44fa3e8" (UID: "2569daf8-a6ca-4bad-86ea-1459e44fa3e8"). InnerVolumeSpecName "kube-api-access-bzv9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:07:45.130998 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.130971 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-util" (OuterVolumeSpecName: "util") pod "2569daf8-a6ca-4bad-86ea-1459e44fa3e8" (UID: "2569daf8-a6ca-4bad-86ea-1459e44fa3e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:07:45.225861 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.225795 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:07:45.225861 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.225825 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:07:45.225861 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.225838 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzv9k\" (UniqueName: \"kubernetes.io/projected/2569daf8-a6ca-4bad-86ea-1459e44fa3e8-kube-api-access-bzv9k\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:07:45.933284 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.933236 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" event={"ID":"2569daf8-a6ca-4bad-86ea-1459e44fa3e8","Type":"ContainerDied","Data":"13265d2a9dcf8de73386ff9295f71c63653694cbd03457ab7c2bb4e6e4f4d370"} Jun 10 13:07:45.933687 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.933315 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13265d2a9dcf8de73386ff9295f71c63653694cbd03457ab7c2bb4e6e4f4d370" Jun 10 13:07:45.933687 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:45.933247 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnm6qg" Jun 10 13:07:46.938737 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:46.938690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" event={"ID":"b565d57b-a006-4d83-bcc8-dcb974382067","Type":"ContainerStarted","Data":"2b6d0a7b5e0f0403ae2696dbd5d7337be82ad0aeab9f63bd0a64e1dc9e82b5ad"} Jun 10 13:07:46.940096 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:46.940073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" event={"ID":"704932b7-eead-4ef4-a6bc-7b038f7485bf","Type":"ContainerStarted","Data":"3d93e6f825b8c279909496aa2393a42d5a6cb6c464461b351ee56be9011f23f5"} Jun 10 13:07:46.940202 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:46.940183 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:46.959468 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:46.959422 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-g9j8p" podStartSLOduration=1.607741759 podStartE2EDuration="3.959410817s" totalImagesPullingTime="2.351669058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:46.957940751 +0000 UTC m=+239.369335335" watchObservedRunningTime="2026-06-10 13:07:46.959410817 +0000 UTC m=+239.370805379" Jun 10 13:07:46.978001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:46.977950 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" podStartSLOduration=1.8719064410000001 podStartE2EDuration="6.977933958s" totalImagesPullingTime="5.106027517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:07:46.976442978 +0000 UTC m=+239.387837558" watchObservedRunningTime="2026-06-10 13:07:46.977933958 +0000 UTC m=+239.389328542" Jun 10 13:07:52.945703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:52.945669 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-xqgdv" Jun 10 13:07:58.693234 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693157 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl"] Jun 10 13:07:58.693584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693429 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerName="util" Jun 10 13:07:58.693584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693440 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerName="util" Jun 10 13:07:58.693584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693448 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerName="extract" Jun 10 13:07:58.693584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693455 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerName="extract" Jun 10 13:07:58.693584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693472 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerName="pull" Jun 10 13:07:58.693584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693479 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerName="pull" Jun 10 13:07:58.693584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.693525 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2569daf8-a6ca-4bad-86ea-1459e44fa3e8" containerName="extract" Jun 10 13:07:58.696560 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.696540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.699774 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.699753 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:07:58.701237 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.701221 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jvvb\"" Jun 10 13:07:58.701332 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.701223 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:07:58.707563 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.707537 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl"] Jun 10 13:07:58.831864 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.831837 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.831995 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.831869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.831995 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.831902 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzcw4\" (UniqueName: \"kubernetes.io/projected/e23cfffd-e1b2-4460-8e94-01d7d55b265a-kube-api-access-gzcw4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.932680 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.932646 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzcw4\" (UniqueName: \"kubernetes.io/projected/e23cfffd-e1b2-4460-8e94-01d7d55b265a-kube-api-access-gzcw4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.932826 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.932747 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.932826 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.932775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.933150 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.933131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.933216 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.933132 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:58.946669 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:58.946617 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzcw4\" (UniqueName: \"kubernetes.io/projected/e23cfffd-e1b2-4460-8e94-01d7d55b265a-kube-api-access-gzcw4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:59.005677 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:59.005641 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:07:59.137466 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:59.137444 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl"] Jun 10 13:07:59.139218 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:07:59.139193 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23cfffd_e1b2_4460_8e94_01d7d55b265a.slice/crio-f51bf8ee63bbc69f44adccc9b7f61ef1d2963dbff441332698c088a23e46ddde WatchSource:0}: Error finding container f51bf8ee63bbc69f44adccc9b7f61ef1d2963dbff441332698c088a23e46ddde: Status 404 returned error can't find the container with id f51bf8ee63bbc69f44adccc9b7f61ef1d2963dbff441332698c088a23e46ddde Jun 10 13:07:59.990014 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:59.989981 2558 generic.go:356] "Generic (PLEG): container finished" podID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerID="406616ee9f4ae450fb16fdbe74fd402649176d15875c586650d155c9a362f43f" exitCode=0 Jun 10 13:07:59.990475 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:59.990022 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" event={"ID":"e23cfffd-e1b2-4460-8e94-01d7d55b265a","Type":"ContainerDied","Data":"406616ee9f4ae450fb16fdbe74fd402649176d15875c586650d155c9a362f43f"} Jun 10 13:07:59.990475 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:07:59.990058 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" event={"ID":"e23cfffd-e1b2-4460-8e94-01d7d55b265a","Type":"ContainerStarted","Data":"f51bf8ee63bbc69f44adccc9b7f61ef1d2963dbff441332698c088a23e46ddde"} Jun 10 13:08:00.995844 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:00.995809 2558 generic.go:356] "Generic (PLEG): container finished" podID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerID="b3db282e96754d8479e0cfb468017ba3807da6ec3ca28da91b6bc1f56c523021" exitCode=0 Jun 10 13:08:00.996189 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:00.995851 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" event={"ID":"e23cfffd-e1b2-4460-8e94-01d7d55b265a","Type":"ContainerDied","Data":"b3db282e96754d8479e0cfb468017ba3807da6ec3ca28da91b6bc1f56c523021"} Jun 10 13:08:02.001141 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:02.001104 2558 generic.go:356] "Generic (PLEG): container finished" podID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerID="893abca9103a494906baea87286c7de1b90a3aeae8b47776289e398949245df1" exitCode=0 Jun 10 13:08:02.001510 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:02.001144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" event={"ID":"e23cfffd-e1b2-4460-8e94-01d7d55b265a","Type":"ContainerDied","Data":"893abca9103a494906baea87286c7de1b90a3aeae8b47776289e398949245df1"} Jun 10 13:08:03.127247 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.127221 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:08:03.264941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.264878 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-bundle\") pod \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " Jun 10 13:08:03.264941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.264918 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzcw4\" (UniqueName: \"kubernetes.io/projected/e23cfffd-e1b2-4460-8e94-01d7d55b265a-kube-api-access-gzcw4\") pod \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " Jun 10 13:08:03.265086 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.264956 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-util\") pod \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\" (UID: \"e23cfffd-e1b2-4460-8e94-01d7d55b265a\") " Jun 10 13:08:03.265572 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.265537 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-bundle" (OuterVolumeSpecName: "bundle") pod "e23cfffd-e1b2-4460-8e94-01d7d55b265a" (UID: "e23cfffd-e1b2-4460-8e94-01d7d55b265a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:03.266882 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.266857 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23cfffd-e1b2-4460-8e94-01d7d55b265a-kube-api-access-gzcw4" (OuterVolumeSpecName: "kube-api-access-gzcw4") pod "e23cfffd-e1b2-4460-8e94-01d7d55b265a" (UID: "e23cfffd-e1b2-4460-8e94-01d7d55b265a"). InnerVolumeSpecName "kube-api-access-gzcw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:08:03.273010 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.272989 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-util" (OuterVolumeSpecName: "util") pod "e23cfffd-e1b2-4460-8e94-01d7d55b265a" (UID: "e23cfffd-e1b2-4460-8e94-01d7d55b265a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:03.365834 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.365813 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:03.365834 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.365831 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzcw4\" (UniqueName: \"kubernetes.io/projected/e23cfffd-e1b2-4460-8e94-01d7d55b265a-kube-api-access-gzcw4\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:03.365956 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:03.365840 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e23cfffd-e1b2-4460-8e94-01d7d55b265a-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:04.010089 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:04.010070 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" Jun 10 13:08:04.010215 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:04.010069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdhdtjl" event={"ID":"e23cfffd-e1b2-4460-8e94-01d7d55b265a","Type":"ContainerDied","Data":"f51bf8ee63bbc69f44adccc9b7f61ef1d2963dbff441332698c088a23e46ddde"} Jun 10 13:08:04.010215 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:04.010170 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f51bf8ee63bbc69f44adccc9b7f61ef1d2963dbff441332698c088a23e46ddde" Jun 10 13:08:15.846584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846548 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2"] Jun 10 13:08:15.847021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846858 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerName="extract" Jun 10 13:08:15.847021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846872 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerName="extract" Jun 10 13:08:15.847021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846884 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerName="util" Jun 10 13:08:15.847021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846889 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerName="util" Jun 10 13:08:15.847021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846900 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerName="pull" Jun 10 13:08:15.847021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846906 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerName="pull" Jun 10 13:08:15.847021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.846965 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23cfffd-e1b2-4460-8e94-01d7d55b265a" containerName="extract" Jun 10 13:08:15.853197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.853182 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:15.860591 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.860569 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 13:08:15.860705 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.860673 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 13:08:15.862136 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.862116 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 13:08:15.862225 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.862155 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 13:08:15.862225 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.862157 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6g9hm\"" Jun 10 13:08:15.881586 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.881554 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2"] Jun 10 13:08:15.965336 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.965306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:15.965336 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.965339 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:15.965527 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.965361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-tmp\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:15.965527 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.965461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-manifests\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:15.965527 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:15.965499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6mc9\" (UniqueName: \"kubernetes.io/projected/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-kube-api-access-s6mc9\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.065842 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.065810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.065977 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.065858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.065977 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.065889 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-tmp\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.065977 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.065951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-manifests\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.066083 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.065979 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6mc9\" (UniqueName: \"kubernetes.io/projected/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-kube-api-access-s6mc9\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.066401 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.066378 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-manifests\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.068244 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.068214 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-tmp\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.068360 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.068327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-webhook-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.068401 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.068366 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.075748 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.075724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6mc9\" (UniqueName: \"kubernetes.io/projected/9f672853-25a9-4e0e-8b0d-0b95a3c68d49-kube-api-access-s6mc9\") pod \"opendatahub-operator-controller-manager-798cb5c965-tqvz2\" (UID: \"9f672853-25a9-4e0e-8b0d-0b95a3c68d49\") " pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.162558 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.162489 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:16.305046 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:16.304915 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2"] Jun 10 13:08:16.307802 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:08:16.307776 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f672853_25a9_4e0e_8b0d_0b95a3c68d49.slice/crio-1cd7bcbfada3919dd7fd502c9e1f3b7de00d5641c126aa67ad87ddfa31b11e8c WatchSource:0}: Error finding container 1cd7bcbfada3919dd7fd502c9e1f3b7de00d5641c126aa67ad87ddfa31b11e8c: Status 404 returned error can't find the container with id 1cd7bcbfada3919dd7fd502c9e1f3b7de00d5641c126aa67ad87ddfa31b11e8c Jun 10 13:08:17.064338 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:17.064299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" event={"ID":"9f672853-25a9-4e0e-8b0d-0b95a3c68d49","Type":"ContainerStarted","Data":"1cd7bcbfada3919dd7fd502c9e1f3b7de00d5641c126aa67ad87ddfa31b11e8c"} Jun 10 13:08:20.077776 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:20.077736 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" event={"ID":"9f672853-25a9-4e0e-8b0d-0b95a3c68d49","Type":"ContainerStarted","Data":"12c61764401759782af7ce5f0cb4cc03861078d7d870a4910a3c1d1ba2e457e5"} Jun 10 13:08:21.083765 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:21.083734 2558 generic.go:356] "Generic (PLEG): container finished" podID="9f672853-25a9-4e0e-8b0d-0b95a3c68d49" containerID="12c61764401759782af7ce5f0cb4cc03861078d7d870a4910a3c1d1ba2e457e5" exitCode=0 Jun 10 13:08:21.084147 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:21.083825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" event={"ID":"9f672853-25a9-4e0e-8b0d-0b95a3c68d49","Type":"ContainerDied","Data":"12c61764401759782af7ce5f0cb4cc03861078d7d870a4910a3c1d1ba2e457e5"} Jun 10 13:08:22.089127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:22.089093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" event={"ID":"9f672853-25a9-4e0e-8b0d-0b95a3c68d49","Type":"ContainerStarted","Data":"3a5203f2d49e19e5e8a987cdccd294f448550b49caac4272ce0b28a82afa7505"} Jun 10 13:08:22.089563 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:22.089317 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:22.118856 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:22.118811 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" podStartSLOduration=3.055776855 podStartE2EDuration="7.118796996s" totalImagesPullingTime="3.135529713s" totalInitContainerRuntime="927.490428ms" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:22.116904792 +0000 UTC m=+274.528299405" watchObservedRunningTime="2026-06-10 13:08:22.118796996 +0000 UTC m=+274.530191579" Jun 10 13:08:33.095253 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:33.095225 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-798cb5c965-tqvz2" Jun 10 13:08:34.370183 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.370150 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4"] Jun 10 13:08:34.374557 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.374534 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.378450 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.378429 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 13:08:34.378556 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.378514 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 13:08:34.379924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.379902 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 13:08:34.380046 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.380022 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cz8sk\"" Jun 10 13:08:34.380116 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.380071 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 13:08:34.380171 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.380124 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 13:08:34.388461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.388439 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4"] Jun 10 13:08:34.394279 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.394247 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b8b9262-d545-4867-b786-e4dfbe60bc07-manager-config\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.394374 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.394308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crk5p\" (UniqueName: \"kubernetes.io/projected/3b8b9262-d545-4867-b786-e4dfbe60bc07-kube-api-access-crk5p\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.394374 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.394365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b8b9262-d545-4867-b786-e4dfbe60bc07-cert\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.394479 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.394413 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b8b9262-d545-4867-b786-e4dfbe60bc07-metrics-cert\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.495614 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.495574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crk5p\" (UniqueName: \"kubernetes.io/projected/3b8b9262-d545-4867-b786-e4dfbe60bc07-kube-api-access-crk5p\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.495728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.495627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b8b9262-d545-4867-b786-e4dfbe60bc07-cert\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.495728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.495650 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b8b9262-d545-4867-b786-e4dfbe60bc07-metrics-cert\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.495728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.495697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b8b9262-d545-4867-b786-e4dfbe60bc07-manager-config\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.496351 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.496332 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b8b9262-d545-4867-b786-e4dfbe60bc07-manager-config\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.497933 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.497912 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b8b9262-d545-4867-b786-e4dfbe60bc07-metrics-cert\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.498107 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.498087 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b8b9262-d545-4867-b786-e4dfbe60bc07-cert\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.510636 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.510613 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crk5p\" (UniqueName: \"kubernetes.io/projected/3b8b9262-d545-4867-b786-e4dfbe60bc07-kube-api-access-crk5p\") pod \"lws-controller-manager-6d9fc7975b-lshj4\" (UID: \"3b8b9262-d545-4867-b786-e4dfbe60bc07\") " pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.684121 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.684050 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:34.820479 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:34.820455 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4"] Jun 10 13:08:34.822332 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:08:34.822306 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8b9262_d545_4867_b786_e4dfbe60bc07.slice/crio-e7156d6383fe91a5a921e0f8b685797887ea5170759898487ee4f606cfbd4eae WatchSource:0}: Error finding container e7156d6383fe91a5a921e0f8b685797887ea5170759898487ee4f606cfbd4eae: Status 404 returned error can't find the container with id e7156d6383fe91a5a921e0f8b685797887ea5170759898487ee4f606cfbd4eae Jun 10 13:08:35.141759 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:35.141726 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" event={"ID":"3b8b9262-d545-4867-b786-e4dfbe60bc07","Type":"ContainerStarted","Data":"e7156d6383fe91a5a921e0f8b685797887ea5170759898487ee4f606cfbd4eae"} Jun 10 13:08:35.937524 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:35.937490 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48"] Jun 10 13:08:35.941389 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:35.941367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:35.944489 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:35.944449 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:08:35.944588 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:35.944541 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:08:35.946055 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:35.946037 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jvvb\"" Jun 10 13:08:35.954784 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:35.954742 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48"] Jun 10 13:08:36.010723 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.010695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.010904 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.010811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.010904 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.010866 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k99zb\" (UniqueName: \"kubernetes.io/projected/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-kube-api-access-k99zb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.111601 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.111570 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.111762 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.111669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.111762 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.111724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k99zb\" (UniqueName: \"kubernetes.io/projected/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-kube-api-access-k99zb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.112083 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.112055 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.112197 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.112140 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.130055 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.130028 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k99zb\" (UniqueName: \"kubernetes.io/projected/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-kube-api-access-k99zb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.253795 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.253764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:36.554826 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:36.554779 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48"] Jun 10 13:08:36.556896 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:08:36.556872 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9c4fe2_05af_42c3_9b07_87d24d4ce247.slice/crio-a1b2003f29c95efa740985ad94f14208529c6df1b059da1d3f0885f22aab1235 WatchSource:0}: Error finding container a1b2003f29c95efa740985ad94f14208529c6df1b059da1d3f0885f22aab1235: Status 404 returned error can't find the container with id a1b2003f29c95efa740985ad94f14208529c6df1b059da1d3f0885f22aab1235 Jun 10 13:08:37.154486 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:37.154450 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerID="36295a7c4eb4388dae2c50d5bae2b2ea55a95637dc54211acebb6fb0513e5fdc" exitCode=0 Jun 10 13:08:37.154932 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:37.154540 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" event={"ID":"6e9c4fe2-05af-42c3-9b07-87d24d4ce247","Type":"ContainerDied","Data":"36295a7c4eb4388dae2c50d5bae2b2ea55a95637dc54211acebb6fb0513e5fdc"} Jun 10 13:08:37.154932 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:37.154632 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" event={"ID":"6e9c4fe2-05af-42c3-9b07-87d24d4ce247","Type":"ContainerStarted","Data":"a1b2003f29c95efa740985ad94f14208529c6df1b059da1d3f0885f22aab1235"} Jun 10 13:08:37.156241 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:37.156217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" event={"ID":"3b8b9262-d545-4867-b786-e4dfbe60bc07","Type":"ContainerStarted","Data":"d324e22579a509bfd1d9101e075fb15e4c84a300ea832ce8a68b31e068adc749"} Jun 10 13:08:37.156347 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:37.156306 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:37.199604 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:37.199565 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" podStartSLOduration=1.5472058039999999 podStartE2EDuration="3.199550307s" totalImagesPullingTime="1.652344503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:37.19925432 +0000 UTC m=+289.610648902" watchObservedRunningTime="2026-06-10 13:08:37.199550307 +0000 UTC m=+289.610944890" Jun 10 13:08:38.161957 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:38.161880 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerID="8f032daff71434edb32a19613d7473c56ba236a592720e5403183237e8fb4b2c" exitCode=0 Jun 10 13:08:38.162310 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:38.161957 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" event={"ID":"6e9c4fe2-05af-42c3-9b07-87d24d4ce247","Type":"ContainerDied","Data":"8f032daff71434edb32a19613d7473c56ba236a592720e5403183237e8fb4b2c"} Jun 10 13:08:39.169550 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:39.169513 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerID="817b2a9c2bac75d27b6f34eb0118fc57e2f9dc5989de5a749af021e229565f5d" exitCode=0 Jun 10 13:08:39.169913 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:39.169603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" event={"ID":"6e9c4fe2-05af-42c3-9b07-87d24d4ce247","Type":"ContainerDied","Data":"817b2a9c2bac75d27b6f34eb0118fc57e2f9dc5989de5a749af021e229565f5d"} Jun 10 13:08:40.307976 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.307949 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:40.344179 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.344150 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-util\") pod \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " Jun 10 13:08:40.344179 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.344185 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k99zb\" (UniqueName: \"kubernetes.io/projected/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-kube-api-access-k99zb\") pod \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " Jun 10 13:08:40.344422 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.344248 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-bundle\") pod \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\" (UID: \"6e9c4fe2-05af-42c3-9b07-87d24d4ce247\") " Jun 10 13:08:40.345346 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.345317 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-bundle" (OuterVolumeSpecName: "bundle") pod "6e9c4fe2-05af-42c3-9b07-87d24d4ce247" (UID: "6e9c4fe2-05af-42c3-9b07-87d24d4ce247"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:40.346350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.346323 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-kube-api-access-k99zb" (OuterVolumeSpecName: "kube-api-access-k99zb") pod "6e9c4fe2-05af-42c3-9b07-87d24d4ce247" (UID: "6e9c4fe2-05af-42c3-9b07-87d24d4ce247"). InnerVolumeSpecName "kube-api-access-k99zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:08:40.349831 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.349808 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-util" (OuterVolumeSpecName: "util") pod "6e9c4fe2-05af-42c3-9b07-87d24d4ce247" (UID: "6e9c4fe2-05af-42c3-9b07-87d24d4ce247"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:40.444975 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.444897 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:40.444975 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.444922 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:40.444975 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:40.444930 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k99zb\" (UniqueName: \"kubernetes.io/projected/6e9c4fe2-05af-42c3-9b07-87d24d4ce247-kube-api-access-k99zb\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:41.182756 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:41.182719 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" event={"ID":"6e9c4fe2-05af-42c3-9b07-87d24d4ce247","Type":"ContainerDied","Data":"a1b2003f29c95efa740985ad94f14208529c6df1b059da1d3f0885f22aab1235"} Jun 10 13:08:41.182924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:41.182773 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1b2003f29c95efa740985ad94f14208529c6df1b059da1d3f0885f22aab1235" Jun 10 13:08:41.182924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:41.182732 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab064jg48" Jun 10 13:08:46.608599 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608565 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv"] Jun 10 13:08:46.608966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608848 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerName="util" Jun 10 13:08:46.608966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608859 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerName="util" Jun 10 13:08:46.608966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608866 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerName="pull" Jun 10 13:08:46.608966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608872 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerName="pull" Jun 10 13:08:46.608966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608888 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerName="extract" Jun 10 13:08:46.608966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608894 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerName="extract" Jun 10 13:08:46.608966 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.608942 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e9c4fe2-05af-42c3-9b07-87d24d4ce247" containerName="extract" Jun 10 13:08:46.612021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.612006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:46.614747 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.614727 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 10 13:08:46.614853 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.614732 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wpvtd\"" Jun 10 13:08:46.629022 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.629001 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv"] Jun 10 13:08:46.690891 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.690852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrbvw\" (UniqueName: \"kubernetes.io/projected/ed2a5742-c878-4052-98da-e8d44861caac-kube-api-access-vrbvw\") pod \"llmisvc-controller-manager-864bfd7bc9-cgclv\" (UID: \"ed2a5742-c878-4052-98da-e8d44861caac\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:46.691092 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.690907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed2a5742-c878-4052-98da-e8d44861caac-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cgclv\" (UID: \"ed2a5742-c878-4052-98da-e8d44861caac\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:46.792206 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.792174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrbvw\" (UniqueName: \"kubernetes.io/projected/ed2a5742-c878-4052-98da-e8d44861caac-kube-api-access-vrbvw\") pod \"llmisvc-controller-manager-864bfd7bc9-cgclv\" (UID: \"ed2a5742-c878-4052-98da-e8d44861caac\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:46.792556 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.792226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed2a5742-c878-4052-98da-e8d44861caac-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cgclv\" (UID: \"ed2a5742-c878-4052-98da-e8d44861caac\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:46.794615 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.794587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed2a5742-c878-4052-98da-e8d44861caac-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-cgclv\" (UID: \"ed2a5742-c878-4052-98da-e8d44861caac\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:46.806777 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.806746 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrbvw\" (UniqueName: \"kubernetes.io/projected/ed2a5742-c878-4052-98da-e8d44861caac-kube-api-access-vrbvw\") pod \"llmisvc-controller-manager-864bfd7bc9-cgclv\" (UID: \"ed2a5742-c878-4052-98da-e8d44861caac\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:46.921709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:46.921618 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:47.059946 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:47.059874 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv"] Jun 10 13:08:47.062059 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:08:47.062033 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poded2a5742_c878_4052_98da_e8d44861caac.slice/crio-deb57e6ac13c86bac01186b6db1390ceeba6189a4ff6e799eff47cb614f48357 WatchSource:0}: Error finding container deb57e6ac13c86bac01186b6db1390ceeba6189a4ff6e799eff47cb614f48357: Status 404 returned error can't find the container with id deb57e6ac13c86bac01186b6db1390ceeba6189a4ff6e799eff47cb614f48357 Jun 10 13:08:47.209779 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:47.209693 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" event={"ID":"ed2a5742-c878-4052-98da-e8d44861caac","Type":"ContainerStarted","Data":"deb57e6ac13c86bac01186b6db1390ceeba6189a4ff6e799eff47cb614f48357"} Jun 10 13:08:48.075911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:48.075885 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 13:08:48.164491 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:48.164463 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d9fc7975b-lshj4" Jun 10 13:08:50.474163 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.474127 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48"] Jun 10 13:08:50.477549 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.477534 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.481223 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.481203 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:08:50.481351 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.481298 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jvvb\"" Jun 10 13:08:50.481657 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.481640 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:08:50.497105 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.497074 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48"] Jun 10 13:08:50.525484 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.525409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.525484 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.525449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.525655 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.525538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l6bv\" (UniqueName: \"kubernetes.io/projected/ebea19dd-9c33-4db2-bbf4-141670d9366f-kube-api-access-2l6bv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.626652 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.626620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l6bv\" (UniqueName: \"kubernetes.io/projected/ebea19dd-9c33-4db2-bbf4-141670d9366f-kube-api-access-2l6bv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.626837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.626681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.626837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.626725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.627025 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.627005 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.627093 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.627078 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.644049 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.644026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l6bv\" (UniqueName: \"kubernetes.io/projected/ebea19dd-9c33-4db2-bbf4-141670d9366f-kube-api-access-2l6bv\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:50.786068 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:50.785986 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:51.018250 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.018213 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48"] Jun 10 13:08:51.034066 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:08:51.034041 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebea19dd_9c33_4db2_bbf4_141670d9366f.slice/crio-c126c348a1803f5fe3e6116ca6f8d65e57bc329c9f98b302e8931c712b66ab2a WatchSource:0}: Error finding container c126c348a1803f5fe3e6116ca6f8d65e57bc329c9f98b302e8931c712b66ab2a: Status 404 returned error can't find the container with id c126c348a1803f5fe3e6116ca6f8d65e57bc329c9f98b302e8931c712b66ab2a Jun 10 13:08:51.234034 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.233990 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" event={"ID":"ed2a5742-c878-4052-98da-e8d44861caac","Type":"ContainerStarted","Data":"0a3042097cd7bcfaf06155c3004080472c33fda8f60ff6b6555b1b30351b0f8e"} Jun 10 13:08:51.234222 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.234143 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:08:51.235368 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.235346 2558 generic.go:356] "Generic (PLEG): container finished" podID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerID="7a13ef16027515a3c04cf3ed9909ce381505456abd8b86ce4454c89613ea3b36" exitCode=0 Jun 10 13:08:51.235488 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.235400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" event={"ID":"ebea19dd-9c33-4db2-bbf4-141670d9366f","Type":"ContainerDied","Data":"7a13ef16027515a3c04cf3ed9909ce381505456abd8b86ce4454c89613ea3b36"} Jun 10 13:08:51.235488 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.235434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" event={"ID":"ebea19dd-9c33-4db2-bbf4-141670d9366f","Type":"ContainerStarted","Data":"c126c348a1803f5fe3e6116ca6f8d65e57bc329c9f98b302e8931c712b66ab2a"} Jun 10 13:08:51.236261 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.236247 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:08:51.267570 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:51.267521 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" podStartSLOduration=2.056223032 podStartE2EDuration="5.2675087s" totalImagesPullingTime="3.211285668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:08:51.266968355 +0000 UTC m=+303.678362935" watchObservedRunningTime="2026-06-10 13:08:51.2675087 +0000 UTC m=+303.678903304" Jun 10 13:08:53.246151 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:53.246119 2558 generic.go:356] "Generic (PLEG): container finished" podID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerID="5b1e111de12612aefa3876568c5a640443f4a5f18e11f05da6706581113cf46b" exitCode=0 Jun 10 13:08:53.246523 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:53.246212 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" event={"ID":"ebea19dd-9c33-4db2-bbf4-141670d9366f","Type":"ContainerDied","Data":"5b1e111de12612aefa3876568c5a640443f4a5f18e11f05da6706581113cf46b"} Jun 10 13:08:54.252548 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:54.252515 2558 generic.go:356] "Generic (PLEG): container finished" podID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerID="4970c568b027ba5c177cebc0b1320c2c0839f4b4288b71aaf72b2c669536415a" exitCode=0 Jun 10 13:08:54.252904 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:54.252552 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" event={"ID":"ebea19dd-9c33-4db2-bbf4-141670d9366f","Type":"ContainerDied","Data":"4970c568b027ba5c177cebc0b1320c2c0839f4b4288b71aaf72b2c669536415a"} Jun 10 13:08:55.387901 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.387879 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:55.461712 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.461687 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-bundle\") pod \"ebea19dd-9c33-4db2-bbf4-141670d9366f\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " Jun 10 13:08:55.461829 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.461739 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-util\") pod \"ebea19dd-9c33-4db2-bbf4-141670d9366f\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " Jun 10 13:08:55.461829 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.461760 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2l6bv\" (UniqueName: \"kubernetes.io/projected/ebea19dd-9c33-4db2-bbf4-141670d9366f-kube-api-access-2l6bv\") pod \"ebea19dd-9c33-4db2-bbf4-141670d9366f\" (UID: \"ebea19dd-9c33-4db2-bbf4-141670d9366f\") " Jun 10 13:08:55.462514 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.462488 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-bundle" (OuterVolumeSpecName: "bundle") pod "ebea19dd-9c33-4db2-bbf4-141670d9366f" (UID: "ebea19dd-9c33-4db2-bbf4-141670d9366f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:55.463736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.463709 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebea19dd-9c33-4db2-bbf4-141670d9366f-kube-api-access-2l6bv" (OuterVolumeSpecName: "kube-api-access-2l6bv") pod "ebea19dd-9c33-4db2-bbf4-141670d9366f" (UID: "ebea19dd-9c33-4db2-bbf4-141670d9366f"). InnerVolumeSpecName "kube-api-access-2l6bv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:08:55.467511 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.467493 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-util" (OuterVolumeSpecName: "util") pod "ebea19dd-9c33-4db2-bbf4-141670d9366f" (UID: "ebea19dd-9c33-4db2-bbf4-141670d9366f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:08:55.562819 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.562760 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:55.562819 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.562788 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ebea19dd-9c33-4db2-bbf4-141670d9366f-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:55.562819 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:55.562798 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2l6bv\" (UniqueName: \"kubernetes.io/projected/ebea19dd-9c33-4db2-bbf4-141670d9366f-kube-api-access-2l6bv\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:08:56.262654 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:56.262570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" event={"ID":"ebea19dd-9c33-4db2-bbf4-141670d9366f","Type":"ContainerDied","Data":"c126c348a1803f5fe3e6116ca6f8d65e57bc329c9f98b302e8931c712b66ab2a"} Jun 10 13:08:56.262654 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:56.262617 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aphc48" Jun 10 13:08:56.262821 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:08:56.262623 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c126c348a1803f5fe3e6116ca6f8d65e57bc329c9f98b302e8931c712b66ab2a" Jun 10 13:09:06.317630 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317598 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l"] Jun 10 13:09:06.318077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317884 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerName="extract" Jun 10 13:09:06.318077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317894 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerName="extract" Jun 10 13:09:06.318077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317909 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerName="util" Jun 10 13:09:06.318077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317914 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerName="util" Jun 10 13:09:06.318077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317925 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerName="pull" Jun 10 13:09:06.318077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317931 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerName="pull" Jun 10 13:09:06.318077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.317988 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebea19dd-9c33-4db2-bbf4-141670d9366f" containerName="extract" Jun 10 13:09:06.320917 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.320901 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.326698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.326675 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 13:09:06.326698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.326690 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jxlc7\"" Jun 10 13:09:06.327512 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.327133 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 13:09:06.328048 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.328031 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 13:09:06.343033 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.343013 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l"] Jun 10 13:09:06.432736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.432852 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.432852 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432790 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.432852 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432838 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.433001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.433001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.433001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqqjx\" (UniqueName: \"kubernetes.io/projected/33392bfe-e8be-4409-a2ab-d3178ddf10ca-kube-api-access-gqqjx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.433001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.432993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.433167 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.433041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534036 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqqjx\" (UniqueName: \"kubernetes.io/projected/33392bfe-e8be-4409-a2ab-d3178ddf10ca-kube-api-access-gqqjx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534204 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534545 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534449 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534602 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534582 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534679 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534825 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534805 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.534944 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.534927 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.536327 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.536308 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.536612 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.536592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.543709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.543682 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33392bfe-e8be-4409-a2ab-d3178ddf10ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.544089 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.544072 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqqjx\" (UniqueName: \"kubernetes.io/projected/33392bfe-e8be-4409-a2ab-d3178ddf10ca-kube-api-access-gqqjx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcjgp5l\" (UID: \"33392bfe-e8be-4409-a2ab-d3178ddf10ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.631584 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.631536 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:06.765232 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:06.760965 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l"] Jun 10 13:09:07.311112 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:07.311070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" event={"ID":"33392bfe-e8be-4409-a2ab-d3178ddf10ca","Type":"ContainerStarted","Data":"9ff6347e7623209d23b146653fabb753e9641c4f9108e279ad1b3cda2344c886"} Jun 10 13:09:12.442088 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:12.442051 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:09:12.442362 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:12.442124 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:09:12.442362 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:12.442158 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:09:13.342045 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.342005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" event={"ID":"33392bfe-e8be-4409-a2ab-d3178ddf10ca","Type":"ContainerStarted","Data":"92456b647bb32b8a1ad4480a3a08c1b37d93505295c062107d9cd06eabea6d2e"} Jun 10 13:09:13.370088 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.370044 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" podStartSLOduration=1.695384053 podStartE2EDuration="7.370031565s" totalImagesPullingTime="5.674647512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:13.367805054 +0000 UTC m=+325.779199636" watchObservedRunningTime="2026-06-10 13:09:13.370031565 +0000 UTC m=+325.781426179" Jun 10 13:09:13.632020 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.631948 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:13.636217 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.636192 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:13.768019 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.767986 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-85c8dc5456-cklk6"] Jun 10 13:09:13.771381 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.771360 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:13.774562 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.774538 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 13:09:13.774686 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.774623 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rkklt\"" Jun 10 13:09:13.781731 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.781710 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-85c8dc5456-cklk6"] Jun 10 13:09:13.892217 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.892138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2m4c\" (UniqueName: \"kubernetes.io/projected/d50e1d95-5024-47c3-9dc2-1906f8a241e3-kube-api-access-f2m4c\") pod \"dashboard-redirect-85c8dc5456-cklk6\" (UID: \"d50e1d95-5024-47c3-9dc2-1906f8a241e3\") " pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:13.892217 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.892175 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d50e1d95-5024-47c3-9dc2-1906f8a241e3-redirect-config\") pod \"dashboard-redirect-85c8dc5456-cklk6\" (UID: \"d50e1d95-5024-47c3-9dc2-1906f8a241e3\") " pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:13.992679 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.992647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2m4c\" (UniqueName: \"kubernetes.io/projected/d50e1d95-5024-47c3-9dc2-1906f8a241e3-kube-api-access-f2m4c\") pod \"dashboard-redirect-85c8dc5456-cklk6\" (UID: \"d50e1d95-5024-47c3-9dc2-1906f8a241e3\") " pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:13.992679 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.992681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d50e1d95-5024-47c3-9dc2-1906f8a241e3-redirect-config\") pod \"dashboard-redirect-85c8dc5456-cklk6\" (UID: \"d50e1d95-5024-47c3-9dc2-1906f8a241e3\") " pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:13.993364 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:13.993348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d50e1d95-5024-47c3-9dc2-1906f8a241e3-redirect-config\") pod \"dashboard-redirect-85c8dc5456-cklk6\" (UID: \"d50e1d95-5024-47c3-9dc2-1906f8a241e3\") " pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:14.003696 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:14.003674 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2m4c\" (UniqueName: \"kubernetes.io/projected/d50e1d95-5024-47c3-9dc2-1906f8a241e3-kube-api-access-f2m4c\") pod \"dashboard-redirect-85c8dc5456-cklk6\" (UID: \"d50e1d95-5024-47c3-9dc2-1906f8a241e3\") " pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:14.084475 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:14.084450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" Jun 10 13:09:14.208751 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:14.208729 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-85c8dc5456-cklk6"] Jun 10 13:09:14.210720 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:09:14.210691 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50e1d95_5024_47c3_9dc2_1906f8a241e3.slice/crio-f54bddbfee26601052a965d49cf142a020c6e707c2ea984ee4c15b708658d51c WatchSource:0}: Error finding container f54bddbfee26601052a965d49cf142a020c6e707c2ea984ee4c15b708658d51c: Status 404 returned error can't find the container with id f54bddbfee26601052a965d49cf142a020c6e707c2ea984ee4c15b708658d51c Jun 10 13:09:14.347681 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:14.347654 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" event={"ID":"d50e1d95-5024-47c3-9dc2-1906f8a241e3","Type":"ContainerStarted","Data":"f54bddbfee26601052a965d49cf142a020c6e707c2ea984ee4c15b708658d51c"} Jun 10 13:09:14.347910 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:14.347886 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:14.348885 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:14.348866 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcjgp5l" Jun 10 13:09:21.381255 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:21.381167 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" event={"ID":"d50e1d95-5024-47c3-9dc2-1906f8a241e3","Type":"ContainerStarted","Data":"dbf121d4756f6ac1acdff6e262712171d2c563b182756d4b0fc488defe9d43a4"} Jun 10 13:09:21.403440 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:21.403393 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-85c8dc5456-cklk6" podStartSLOduration=1.483147316 podStartE2EDuration="8.403379067s" totalImagesPullingTime="6.920231751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:21.400551975 +0000 UTC m=+333.811946560" watchObservedRunningTime="2026-06-10 13:09:21.403379067 +0000 UTC m=+333.814773651" Jun 10 13:09:22.242073 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:22.242044 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-cgclv" Jun 10 13:09:36.408326 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.408238 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqzzs"] Jun 10 13:09:36.411470 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.411448 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" Jun 10 13:09:36.415570 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.415548 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 13:09:36.415705 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.415619 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zmmfd\"" Jun 10 13:09:36.417450 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.417427 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 13:09:36.428986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.428964 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqzzs"] Jun 10 13:09:36.567852 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.567822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4779\" (UniqueName: \"kubernetes.io/projected/6c83b3c8-f8ca-4eff-a40d-659501945a95-kube-api-access-g4779\") pod \"kuadrant-operator-catalog-wqzzs\" (UID: \"6c83b3c8-f8ca-4eff-a40d-659501945a95\") " pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" Jun 10 13:09:36.668416 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.668357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4779\" (UniqueName: \"kubernetes.io/projected/6c83b3c8-f8ca-4eff-a40d-659501945a95-kube-api-access-g4779\") pod \"kuadrant-operator-catalog-wqzzs\" (UID: \"6c83b3c8-f8ca-4eff-a40d-659501945a95\") " pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" Jun 10 13:09:36.681753 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.681733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4779\" (UniqueName: \"kubernetes.io/projected/6c83b3c8-f8ca-4eff-a40d-659501945a95-kube-api-access-g4779\") pod \"kuadrant-operator-catalog-wqzzs\" (UID: \"6c83b3c8-f8ca-4eff-a40d-659501945a95\") " pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" Jun 10 13:09:36.721772 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.721742 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" Jun 10 13:09:36.762982 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.762946 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqzzs"] Jun 10 13:09:36.848659 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.848634 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqzzs"] Jun 10 13:09:36.973391 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.973315 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2n9bp"] Jun 10 13:09:36.977698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.977677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:36.986940 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:36.986917 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2n9bp"] Jun 10 13:09:37.071989 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:37.071957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnq9h\" (UniqueName: \"kubernetes.io/projected/b275a4a6-d547-4026-8aeb-c93c3e2c0db4-kube-api-access-nnq9h\") pod \"kuadrant-operator-catalog-2n9bp\" (UID: \"b275a4a6-d547-4026-8aeb-c93c3e2c0db4\") " pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:37.172795 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:37.172767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnq9h\" (UniqueName: \"kubernetes.io/projected/b275a4a6-d547-4026-8aeb-c93c3e2c0db4-kube-api-access-nnq9h\") pod \"kuadrant-operator-catalog-2n9bp\" (UID: \"b275a4a6-d547-4026-8aeb-c93c3e2c0db4\") " pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:37.184925 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:37.184898 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnq9h\" (UniqueName: \"kubernetes.io/projected/b275a4a6-d547-4026-8aeb-c93c3e2c0db4-kube-api-access-nnq9h\") pod \"kuadrant-operator-catalog-2n9bp\" (UID: \"b275a4a6-d547-4026-8aeb-c93c3e2c0db4\") " pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:37.288083 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:37.288055 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:37.428402 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:37.428380 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2n9bp"] Jun 10 13:09:37.430352 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:09:37.430322 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb275a4a6_d547_4026_8aeb_c93c3e2c0db4.slice/crio-ac68558641de90f40143ebffa179e5d0205ee1ee45a24f952c25859a1e1feb50 WatchSource:0}: Error finding container ac68558641de90f40143ebffa179e5d0205ee1ee45a24f952c25859a1e1feb50: Status 404 returned error can't find the container with id ac68558641de90f40143ebffa179e5d0205ee1ee45a24f952c25859a1e1feb50 Jun 10 13:09:37.456801 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:37.456771 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" event={"ID":"b275a4a6-d547-4026-8aeb-c93c3e2c0db4","Type":"ContainerStarted","Data":"ac68558641de90f40143ebffa179e5d0205ee1ee45a24f952c25859a1e1feb50"} Jun 10 13:09:37.457823 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:37.457805 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" event={"ID":"6c83b3c8-f8ca-4eff-a40d-659501945a95","Type":"ContainerStarted","Data":"769ba018167d064f9329d53fe6b4ee29ca12bd1ce445ef4a26e04e1182d52ef4"} Jun 10 13:09:39.469713 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.469674 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" event={"ID":"6c83b3c8-f8ca-4eff-a40d-659501945a95","Type":"ContainerStarted","Data":"7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57"} Jun 10 13:09:39.470124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.469689 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" podUID="6c83b3c8-f8ca-4eff-a40d-659501945a95" containerName="registry-server" containerID="cri-o://7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57" gracePeriod=2 Jun 10 13:09:39.471315 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.471291 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" event={"ID":"b275a4a6-d547-4026-8aeb-c93c3e2c0db4","Type":"ContainerStarted","Data":"4c20482211a2f2229a40e3d14443c77e846846006a11d0611e1ff471f1663ca1"} Jun 10 13:09:39.489497 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.489458 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" podStartSLOduration=1.51661716 podStartE2EDuration="3.489444173s" totalImagesPullingTime="1.972827013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:39.487940287 +0000 UTC m=+351.899334867" watchObservedRunningTime="2026-06-10 13:09:39.489444173 +0000 UTC m=+351.900838755" Jun 10 13:09:39.506476 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.506438 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" podStartSLOduration=2.10803717 podStartE2EDuration="3.506423944s" totalImagesPullingTime="1.398386774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:09:39.505337509 +0000 UTC m=+351.916732093" watchObservedRunningTime="2026-06-10 13:09:39.506423944 +0000 UTC m=+351.917818576" Jun 10 13:09:39.710786 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.710764 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" Jun 10 13:09:39.794904 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.794876 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4779\" (UniqueName: \"kubernetes.io/projected/6c83b3c8-f8ca-4eff-a40d-659501945a95-kube-api-access-g4779\") pod \"6c83b3c8-f8ca-4eff-a40d-659501945a95\" (UID: \"6c83b3c8-f8ca-4eff-a40d-659501945a95\") " Jun 10 13:09:39.796915 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.796892 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c83b3c8-f8ca-4eff-a40d-659501945a95-kube-api-access-g4779" (OuterVolumeSpecName: "kube-api-access-g4779") pod "6c83b3c8-f8ca-4eff-a40d-659501945a95" (UID: "6c83b3c8-f8ca-4eff-a40d-659501945a95"). InnerVolumeSpecName "kube-api-access-g4779". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:09:39.895845 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:39.895821 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4779\" (UniqueName: \"kubernetes.io/projected/6c83b3c8-f8ca-4eff-a40d-659501945a95-kube-api-access-g4779\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:40.476490 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.476454 2558 generic.go:356] "Generic (PLEG): container finished" podID="6c83b3c8-f8ca-4eff-a40d-659501945a95" containerID="7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57" exitCode=0 Jun 10 13:09:40.476490 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.476491 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" Jun 10 13:09:40.477001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.476539 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" event={"ID":"6c83b3c8-f8ca-4eff-a40d-659501945a95","Type":"ContainerDied","Data":"7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57"} Jun 10 13:09:40.477001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.476586 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wqzzs" event={"ID":"6c83b3c8-f8ca-4eff-a40d-659501945a95","Type":"ContainerDied","Data":"769ba018167d064f9329d53fe6b4ee29ca12bd1ce445ef4a26e04e1182d52ef4"} Jun 10 13:09:40.477001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.476609 2558 scope.go:117] "RemoveContainer" containerID="7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57" Jun 10 13:09:40.485263 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.485243 2558 scope.go:117] "RemoveContainer" containerID="7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57" Jun 10 13:09:40.485537 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:09:40.485519 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57\": container with ID starting with 7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57 not found: ID does not exist" containerID="7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57" Jun 10 13:09:40.485599 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.485553 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57"} err="failed to get container status \"7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57\": rpc error: code = NotFound desc = could not find container \"7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57\": container with ID starting with 7e2bef2ff68407e35b243ece6dc85bf410121c381ca3f9a1d091bea11290ae57 not found: ID does not exist" Jun 10 13:09:40.497662 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.497641 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqzzs"] Jun 10 13:09:40.500361 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:40.500340 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wqzzs"] Jun 10 13:09:41.989215 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:41.989180 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c83b3c8-f8ca-4eff-a40d-659501945a95" path="/var/lib/kubelet/pods/6c83b3c8-f8ca-4eff-a40d-659501945a95/volumes" Jun 10 13:09:47.289004 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:47.288969 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:47.289440 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:47.289046 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:47.310691 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:47.310665 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:47.532513 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:47.532487 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-2n9bp" Jun 10 13:09:51.817709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.817653 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv"] Jun 10 13:09:51.818080 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.818027 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c83b3c8-f8ca-4eff-a40d-659501945a95" containerName="registry-server" Jun 10 13:09:51.818080 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.818040 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c83b3c8-f8ca-4eff-a40d-659501945a95" containerName="registry-server" Jun 10 13:09:51.818149 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.818099 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c83b3c8-f8ca-4eff-a40d-659501945a95" containerName="registry-server" Jun 10 13:09:51.827443 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.827417 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.830048 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.830020 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv"] Jun 10 13:09:51.830394 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.830369 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6np7p\"" Jun 10 13:09:51.884900 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.884874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj2pt\" (UniqueName: \"kubernetes.io/projected/ac1d6c58-c532-424e-82eb-5d420d8d626e-kube-api-access-tj2pt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.885017 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.884916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.885017 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.884942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.985894 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.985867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.986023 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.985905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.986023 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.985955 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj2pt\" (UniqueName: \"kubernetes.io/projected/ac1d6c58-c532-424e-82eb-5d420d8d626e-kube-api-access-tj2pt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.986346 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.986327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.986396 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.986360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:51.996894 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:51.996872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj2pt\" (UniqueName: \"kubernetes.io/projected/ac1d6c58-c532-424e-82eb-5d420d8d626e-kube-api-access-tj2pt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:52.137165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.137107 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:52.269983 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.269961 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv"] Jun 10 13:09:52.271668 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:09:52.271638 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac1d6c58_c532_424e_82eb_5d420d8d626e.slice/crio-d35e0878c8f331c07cc6b5d6b755f9ad9ae1db3187674c6870a4c9bfa8d82e5e WatchSource:0}: Error finding container d35e0878c8f331c07cc6b5d6b755f9ad9ae1db3187674c6870a4c9bfa8d82e5e: Status 404 returned error can't find the container with id d35e0878c8f331c07cc6b5d6b755f9ad9ae1db3187674c6870a4c9bfa8d82e5e Jun 10 13:09:52.459304 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.459218 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2"] Jun 10 13:09:52.462594 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.462575 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.482448 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.482420 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2"] Jun 10 13:09:52.488549 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.488528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.488630 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.488562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.488630 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.488590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7r56\" (UniqueName: \"kubernetes.io/projected/5f8f1993-a627-456e-b0be-5343ae0fa776-kube-api-access-b7r56\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.535537 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.535512 2558 generic.go:356] "Generic (PLEG): container finished" podID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerID="b9986354f7e43a40660c3edabfacc29da037e142847b0f7137cd91ae20087754" exitCode=0 Jun 10 13:09:52.535659 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.535585 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" event={"ID":"ac1d6c58-c532-424e-82eb-5d420d8d626e","Type":"ContainerDied","Data":"b9986354f7e43a40660c3edabfacc29da037e142847b0f7137cd91ae20087754"} Jun 10 13:09:52.535659 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.535635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" event={"ID":"ac1d6c58-c532-424e-82eb-5d420d8d626e","Type":"ContainerStarted","Data":"d35e0878c8f331c07cc6b5d6b755f9ad9ae1db3187674c6870a4c9bfa8d82e5e"} Jun 10 13:09:52.589389 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.589366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.589504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.589411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.589504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.589456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7r56\" (UniqueName: \"kubernetes.io/projected/5f8f1993-a627-456e-b0be-5343ae0fa776-kube-api-access-b7r56\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.589783 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.589765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.589848 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.589795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.600835 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.600817 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7r56\" (UniqueName: \"kubernetes.io/projected/5f8f1993-a627-456e-b0be-5343ae0fa776-kube-api-access-b7r56\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.771516 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.771497 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:52.912484 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:52.912462 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2"] Jun 10 13:09:52.913906 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:09:52.913878 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f8f1993_a627_456e_b0be_5343ae0fa776.slice/crio-c92a8699b7726af8864cdc514eaa52b6be1380d8af8d40b8d703af923accf70b WatchSource:0}: Error finding container c92a8699b7726af8864cdc514eaa52b6be1380d8af8d40b8d703af923accf70b: Status 404 returned error can't find the container with id c92a8699b7726af8864cdc514eaa52b6be1380d8af8d40b8d703af923accf70b Jun 10 13:09:53.036031 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.035996 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv"] Jun 10 13:09:53.040049 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.040028 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.050451 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.050431 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv"] Jun 10 13:09:53.093606 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.093581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq87w\" (UniqueName: \"kubernetes.io/projected/6866e96b-59ff-49c3-ae6e-56529829541d-kube-api-access-xq87w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.093717 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.093625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.093789 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.093732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.194527 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.194503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq87w\" (UniqueName: \"kubernetes.io/projected/6866e96b-59ff-49c3-ae6e-56529829541d-kube-api-access-xq87w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.194645 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.194543 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.194645 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.194581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.194944 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.194921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.195044 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.194923 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.209713 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.209676 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq87w\" (UniqueName: \"kubernetes.io/projected/6866e96b-59ff-49c3-ae6e-56529829541d-kube-api-access-xq87w\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.383122 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.383063 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:53.438752 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.438728 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk"] Jun 10 13:09:53.473428 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.473402 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk"] Jun 10 13:09:53.473607 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.473502 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.496821 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.496793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.496941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.496832 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.496941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.496853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8jr6\" (UniqueName: \"kubernetes.io/projected/39b389c0-4c5d-4c69-9c64-9a419067bf06-kube-api-access-c8jr6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.543714 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.543686 2558 generic.go:356] "Generic (PLEG): container finished" podID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerID="61370e0f1df7fc369c6b02328f4da32ffc1458bd104e4ef1f3a8223415e2c4ad" exitCode=0 Jun 10 13:09:53.543842 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.543752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" event={"ID":"ac1d6c58-c532-424e-82eb-5d420d8d626e","Type":"ContainerDied","Data":"61370e0f1df7fc369c6b02328f4da32ffc1458bd104e4ef1f3a8223415e2c4ad"} Jun 10 13:09:53.545331 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.545304 2558 generic.go:356] "Generic (PLEG): container finished" podID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerID="ac3db44d9a5f38727d139f89930115ee265050981dc9d60d7aa036415288b548" exitCode=0 Jun 10 13:09:53.545439 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.545350 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" event={"ID":"5f8f1993-a627-456e-b0be-5343ae0fa776","Type":"ContainerDied","Data":"ac3db44d9a5f38727d139f89930115ee265050981dc9d60d7aa036415288b548"} Jun 10 13:09:53.545439 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.545381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" event={"ID":"5f8f1993-a627-456e-b0be-5343ae0fa776","Type":"ContainerStarted","Data":"c92a8699b7726af8864cdc514eaa52b6be1380d8af8d40b8d703af923accf70b"} Jun 10 13:09:53.574549 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.574524 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv"] Jun 10 13:09:53.579357 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:09:53.579325 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6866e96b_59ff_49c3_ae6e_56529829541d.slice/crio-5f6786dceaca8f8f8c75e03abef4b33723068fd8bec095b56201859de64d28c4 WatchSource:0}: Error finding container 5f6786dceaca8f8f8c75e03abef4b33723068fd8bec095b56201859de64d28c4: Status 404 returned error can't find the container with id 5f6786dceaca8f8f8c75e03abef4b33723068fd8bec095b56201859de64d28c4 Jun 10 13:09:53.598186 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.598163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.598383 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.598363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.598538 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.598514 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.598639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.598546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8jr6\" (UniqueName: \"kubernetes.io/projected/39b389c0-4c5d-4c69-9c64-9a419067bf06-kube-api-access-c8jr6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.598750 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.598724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.615124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.615103 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8jr6\" (UniqueName: \"kubernetes.io/projected/39b389c0-4c5d-4c69-9c64-9a419067bf06-kube-api-access-c8jr6\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.784987 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.784960 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:53.950023 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:53.949990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk"] Jun 10 13:09:53.950513 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:09:53.950488 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b389c0_4c5d_4c69_9c64_9a419067bf06.slice/crio-af3cc7c648109c7da17d38d2f31500a59b92baeac5d5cd5804c375304f1e3447 WatchSource:0}: Error finding container af3cc7c648109c7da17d38d2f31500a59b92baeac5d5cd5804c375304f1e3447: Status 404 returned error can't find the container with id af3cc7c648109c7da17d38d2f31500a59b92baeac5d5cd5804c375304f1e3447 Jun 10 13:09:54.552853 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.552828 2558 generic.go:356] "Generic (PLEG): container finished" podID="6866e96b-59ff-49c3-ae6e-56529829541d" containerID="834d98e17cfb8bbfa62b297a79542cae82fa4119d49335feb54dcf513cb21543" exitCode=0 Jun 10 13:09:54.552954 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.552915 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" event={"ID":"6866e96b-59ff-49c3-ae6e-56529829541d","Type":"ContainerDied","Data":"834d98e17cfb8bbfa62b297a79542cae82fa4119d49335feb54dcf513cb21543"} Jun 10 13:09:54.553023 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.552964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" event={"ID":"6866e96b-59ff-49c3-ae6e-56529829541d","Type":"ContainerStarted","Data":"5f6786dceaca8f8f8c75e03abef4b33723068fd8bec095b56201859de64d28c4"} Jun 10 13:09:54.554775 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.554752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" event={"ID":"5f8f1993-a627-456e-b0be-5343ae0fa776","Type":"ContainerStarted","Data":"6d4ae19b5f29e5a0652d8d8066b732446ac670a67f28434d8eccaea0247ba038"} Jun 10 13:09:54.563106 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.563076 2558 generic.go:356] "Generic (PLEG): container finished" podID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerID="b047ad8fcd635041275a9a4560244d40705e8dfd972b5d387f94e34a104d0722" exitCode=0 Jun 10 13:09:54.563235 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.563131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" event={"ID":"39b389c0-4c5d-4c69-9c64-9a419067bf06","Type":"ContainerDied","Data":"b047ad8fcd635041275a9a4560244d40705e8dfd972b5d387f94e34a104d0722"} Jun 10 13:09:54.563235 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.563218 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" event={"ID":"39b389c0-4c5d-4c69-9c64-9a419067bf06","Type":"ContainerStarted","Data":"af3cc7c648109c7da17d38d2f31500a59b92baeac5d5cd5804c375304f1e3447"} Jun 10 13:09:54.565655 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.565633 2558 generic.go:356] "Generic (PLEG): container finished" podID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerID="c4c33913bb3a514b516d31da53bf20ae2d4f67e9b2b83413171b0338bf3b079c" exitCode=0 Jun 10 13:09:54.565739 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:54.565715 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" event={"ID":"ac1d6c58-c532-424e-82eb-5d420d8d626e","Type":"ContainerDied","Data":"c4c33913bb3a514b516d31da53bf20ae2d4f67e9b2b83413171b0338bf3b079c"} Jun 10 13:09:55.572591 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.572566 2558 generic.go:356] "Generic (PLEG): container finished" podID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerID="6d4ae19b5f29e5a0652d8d8066b732446ac670a67f28434d8eccaea0247ba038" exitCode=0 Jun 10 13:09:55.572989 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.572648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" event={"ID":"5f8f1993-a627-456e-b0be-5343ae0fa776","Type":"ContainerDied","Data":"6d4ae19b5f29e5a0652d8d8066b732446ac670a67f28434d8eccaea0247ba038"} Jun 10 13:09:55.574517 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.574496 2558 generic.go:356] "Generic (PLEG): container finished" podID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerID="fd53fcc205fc52d5bfd47a91a0bc6d81cc2c63c09dbfca6fd7f5f51cc7b06c0b" exitCode=0 Jun 10 13:09:55.574608 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.574584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" event={"ID":"39b389c0-4c5d-4c69-9c64-9a419067bf06","Type":"ContainerDied","Data":"fd53fcc205fc52d5bfd47a91a0bc6d81cc2c63c09dbfca6fd7f5f51cc7b06c0b"} Jun 10 13:09:55.576377 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.576360 2558 generic.go:356] "Generic (PLEG): container finished" podID="6866e96b-59ff-49c3-ae6e-56529829541d" containerID="22639734654f291e57579eb32fcad7e997777bf99385bc245733b432750588da" exitCode=0 Jun 10 13:09:55.576462 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.576379 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" event={"ID":"6866e96b-59ff-49c3-ae6e-56529829541d","Type":"ContainerDied","Data":"22639734654f291e57579eb32fcad7e997777bf99385bc245733b432750588da"} Jun 10 13:09:55.712618 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.712590 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:55.719171 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.718670 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-bundle\") pod \"ac1d6c58-c532-424e-82eb-5d420d8d626e\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " Jun 10 13:09:55.719171 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.718754 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tj2pt\" (UniqueName: \"kubernetes.io/projected/ac1d6c58-c532-424e-82eb-5d420d8d626e-kube-api-access-tj2pt\") pod \"ac1d6c58-c532-424e-82eb-5d420d8d626e\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " Jun 10 13:09:55.719171 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.718780 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-util\") pod \"ac1d6c58-c532-424e-82eb-5d420d8d626e\" (UID: \"ac1d6c58-c532-424e-82eb-5d420d8d626e\") " Jun 10 13:09:55.719686 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.719661 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-bundle" (OuterVolumeSpecName: "bundle") pod "ac1d6c58-c532-424e-82eb-5d420d8d626e" (UID: "ac1d6c58-c532-424e-82eb-5d420d8d626e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:55.721292 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.721248 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac1d6c58-c532-424e-82eb-5d420d8d626e-kube-api-access-tj2pt" (OuterVolumeSpecName: "kube-api-access-tj2pt") pod "ac1d6c58-c532-424e-82eb-5d420d8d626e" (UID: "ac1d6c58-c532-424e-82eb-5d420d8d626e"). InnerVolumeSpecName "kube-api-access-tj2pt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:09:55.725053 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.725031 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-util" (OuterVolumeSpecName: "util") pod "ac1d6c58-c532-424e-82eb-5d420d8d626e" (UID: "ac1d6c58-c532-424e-82eb-5d420d8d626e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:55.819516 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.819489 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tj2pt\" (UniqueName: \"kubernetes.io/projected/ac1d6c58-c532-424e-82eb-5d420d8d626e-kube-api-access-tj2pt\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:55.819516 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.819514 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:55.819655 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:55.819523 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ac1d6c58-c532-424e-82eb-5d420d8d626e-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:56.583505 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.583430 2558 generic.go:356] "Generic (PLEG): container finished" podID="6866e96b-59ff-49c3-ae6e-56529829541d" containerID="dc75035b594cf8623fd10bd4e9be08b591f6e1dc37005a1371321d341b77622d" exitCode=0 Jun 10 13:09:56.583852 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.583521 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" event={"ID":"6866e96b-59ff-49c3-ae6e-56529829541d","Type":"ContainerDied","Data":"dc75035b594cf8623fd10bd4e9be08b591f6e1dc37005a1371321d341b77622d"} Jun 10 13:09:56.585699 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.585674 2558 generic.go:356] "Generic (PLEG): container finished" podID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerID="b67be7c47eaac22888413260054b924f9c3f11d41eb16970033001cbe3bb3928" exitCode=0 Jun 10 13:09:56.585819 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.585735 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" event={"ID":"5f8f1993-a627-456e-b0be-5343ae0fa776","Type":"ContainerDied","Data":"b67be7c47eaac22888413260054b924f9c3f11d41eb16970033001cbe3bb3928"} Jun 10 13:09:56.587836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.587815 2558 generic.go:356] "Generic (PLEG): container finished" podID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerID="5fb2056e9e1845ddab1b8fc46c9efb7bccff416380cd030c7070de48f46b7821" exitCode=0 Jun 10 13:09:56.587939 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.587897 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" event={"ID":"39b389c0-4c5d-4c69-9c64-9a419067bf06","Type":"ContainerDied","Data":"5fb2056e9e1845ddab1b8fc46c9efb7bccff416380cd030c7070de48f46b7821"} Jun 10 13:09:56.589820 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.589804 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" Jun 10 13:09:56.589906 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.589826 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv" event={"ID":"ac1d6c58-c532-424e-82eb-5d420d8d626e","Type":"ContainerDied","Data":"d35e0878c8f331c07cc6b5d6b755f9ad9ae1db3187674c6870a4c9bfa8d82e5e"} Jun 10 13:09:56.589906 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:56.589856 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d35e0878c8f331c07cc6b5d6b755f9ad9ae1db3187674c6870a4c9bfa8d82e5e" Jun 10 13:09:57.751124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.751104 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:09:57.787057 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.787035 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:57.790130 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.790108 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:57.835394 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835369 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7r56\" (UniqueName: \"kubernetes.io/projected/5f8f1993-a627-456e-b0be-5343ae0fa776-kube-api-access-b7r56\") pod \"5f8f1993-a627-456e-b0be-5343ae0fa776\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " Jun 10 13:09:57.835522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835409 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-bundle\") pod \"6866e96b-59ff-49c3-ae6e-56529829541d\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " Jun 10 13:09:57.835522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835449 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-bundle\") pod \"5f8f1993-a627-456e-b0be-5343ae0fa776\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " Jun 10 13:09:57.835522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835476 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-util\") pod \"5f8f1993-a627-456e-b0be-5343ae0fa776\" (UID: \"5f8f1993-a627-456e-b0be-5343ae0fa776\") " Jun 10 13:09:57.835522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835499 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-util\") pod \"6866e96b-59ff-49c3-ae6e-56529829541d\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " Jun 10 13:09:57.835522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835521 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8jr6\" (UniqueName: \"kubernetes.io/projected/39b389c0-4c5d-4c69-9c64-9a419067bf06-kube-api-access-c8jr6\") pod \"39b389c0-4c5d-4c69-9c64-9a419067bf06\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " Jun 10 13:09:57.835779 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835553 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xq87w\" (UniqueName: \"kubernetes.io/projected/6866e96b-59ff-49c3-ae6e-56529829541d-kube-api-access-xq87w\") pod \"6866e96b-59ff-49c3-ae6e-56529829541d\" (UID: \"6866e96b-59ff-49c3-ae6e-56529829541d\") " Jun 10 13:09:57.835779 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835572 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-bundle\") pod \"39b389c0-4c5d-4c69-9c64-9a419067bf06\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " Jun 10 13:09:57.835779 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835627 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-util\") pod \"39b389c0-4c5d-4c69-9c64-9a419067bf06\" (UID: \"39b389c0-4c5d-4c69-9c64-9a419067bf06\") " Jun 10 13:09:57.836164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.835986 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-bundle" (OuterVolumeSpecName: "bundle") pod "6866e96b-59ff-49c3-ae6e-56529829541d" (UID: "6866e96b-59ff-49c3-ae6e-56529829541d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:57.836322 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.836046 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-bundle" (OuterVolumeSpecName: "bundle") pod "5f8f1993-a627-456e-b0be-5343ae0fa776" (UID: "5f8f1993-a627-456e-b0be-5343ae0fa776"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:57.836447 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.836403 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-bundle" (OuterVolumeSpecName: "bundle") pod "39b389c0-4c5d-4c69-9c64-9a419067bf06" (UID: "39b389c0-4c5d-4c69-9c64-9a419067bf06"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:57.838487 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.838450 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6866e96b-59ff-49c3-ae6e-56529829541d-kube-api-access-xq87w" (OuterVolumeSpecName: "kube-api-access-xq87w") pod "6866e96b-59ff-49c3-ae6e-56529829541d" (UID: "6866e96b-59ff-49c3-ae6e-56529829541d"). InnerVolumeSpecName "kube-api-access-xq87w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:09:57.838565 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.838490 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f8f1993-a627-456e-b0be-5343ae0fa776-kube-api-access-b7r56" (OuterVolumeSpecName: "kube-api-access-b7r56") pod "5f8f1993-a627-456e-b0be-5343ae0fa776" (UID: "5f8f1993-a627-456e-b0be-5343ae0fa776"). InnerVolumeSpecName "kube-api-access-b7r56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:09:57.838688 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.838660 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39b389c0-4c5d-4c69-9c64-9a419067bf06-kube-api-access-c8jr6" (OuterVolumeSpecName: "kube-api-access-c8jr6") pod "39b389c0-4c5d-4c69-9c64-9a419067bf06" (UID: "39b389c0-4c5d-4c69-9c64-9a419067bf06"). InnerVolumeSpecName "kube-api-access-c8jr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:09:57.842926 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.842907 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-util" (OuterVolumeSpecName: "util") pod "39b389c0-4c5d-4c69-9c64-9a419067bf06" (UID: "39b389c0-4c5d-4c69-9c64-9a419067bf06"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:57.844699 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.844672 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-util" (OuterVolumeSpecName: "util") pod "5f8f1993-a627-456e-b0be-5343ae0fa776" (UID: "5f8f1993-a627-456e-b0be-5343ae0fa776"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:57.845072 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.845049 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-util" (OuterVolumeSpecName: "util") pod "6866e96b-59ff-49c3-ae6e-56529829541d" (UID: "6866e96b-59ff-49c3-ae6e-56529829541d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:09:57.936504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936457 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936477 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f8f1993-a627-456e-b0be-5343ae0fa776-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936485 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936494 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8jr6\" (UniqueName: \"kubernetes.io/projected/39b389c0-4c5d-4c69-9c64-9a419067bf06-kube-api-access-c8jr6\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936504 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936503 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xq87w\" (UniqueName: \"kubernetes.io/projected/6866e96b-59ff-49c3-ae6e-56529829541d-kube-api-access-xq87w\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936512 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936519 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/39b389c0-4c5d-4c69-9c64-9a419067bf06-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936527 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7r56\" (UniqueName: \"kubernetes.io/projected/5f8f1993-a627-456e-b0be-5343ae0fa776-kube-api-access-b7r56\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:57.936703 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:57.936534 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6866e96b-59ff-49c3-ae6e-56529829541d-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:09:58.602403 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.602375 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" Jun 10 13:09:58.602591 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.602381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv" event={"ID":"6866e96b-59ff-49c3-ae6e-56529829541d","Type":"ContainerDied","Data":"5f6786dceaca8f8f8c75e03abef4b33723068fd8bec095b56201859de64d28c4"} Jun 10 13:09:58.602591 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.602496 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f6786dceaca8f8f8c75e03abef4b33723068fd8bec095b56201859de64d28c4" Jun 10 13:09:58.604347 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.604317 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" event={"ID":"5f8f1993-a627-456e-b0be-5343ae0fa776","Type":"ContainerDied","Data":"c92a8699b7726af8864cdc514eaa52b6be1380d8af8d40b8d703af923accf70b"} Jun 10 13:09:58.604347 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.604344 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2" Jun 10 13:09:58.604524 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.604366 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c92a8699b7726af8864cdc514eaa52b6be1380d8af8d40b8d703af923accf70b" Jun 10 13:09:58.606469 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.606447 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" event={"ID":"39b389c0-4c5d-4c69-9c64-9a419067bf06","Type":"ContainerDied","Data":"af3cc7c648109c7da17d38d2f31500a59b92baeac5d5cd5804c375304f1e3447"} Jun 10 13:09:58.606572 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.606485 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af3cc7c648109c7da17d38d2f31500a59b92baeac5d5cd5804c375304f1e3447" Jun 10 13:09:58.606572 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:09:58.606569 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk" Jun 10 13:10:05.021699 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.021659 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp"] Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.021995 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerName="util" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022006 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerName="util" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022018 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerName="pull" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022023 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerName="pull" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022033 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerName="pull" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022038 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerName="pull" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022045 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6866e96b-59ff-49c3-ae6e-56529829541d" containerName="extract" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022051 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6866e96b-59ff-49c3-ae6e-56529829541d" containerName="extract" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022066 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerName="util" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022072 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerName="util" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022077 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6866e96b-59ff-49c3-ae6e-56529829541d" containerName="pull" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022082 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6866e96b-59ff-49c3-ae6e-56529829541d" containerName="pull" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022087 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerName="extract" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022091 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerName="extract" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022099 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerName="util" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022103 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerName="util" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022109 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerName="extract" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022114 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerName="extract" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022121 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6866e96b-59ff-49c3-ae6e-56529829541d" containerName="util" Jun 10 13:10:05.022127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022126 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6866e96b-59ff-49c3-ae6e-56529829541d" containerName="util" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022137 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerName="pull" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022146 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerName="pull" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022151 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerName="extract" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022156 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerName="extract" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022209 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6866e96b-59ff-49c3-ae6e-56529829541d" containerName="extract" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022220 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="39b389c0-4c5d-4c69-9c64-9a419067bf06" containerName="extract" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022229 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac1d6c58-c532-424e-82eb-5d420d8d626e" containerName="extract" Jun 10 13:10:05.022736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.022235 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f8f1993-a627-456e-b0be-5343ae0fa776" containerName="extract" Jun 10 13:10:05.026566 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.026550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.029683 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.029665 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5b5d2\"" Jun 10 13:10:05.045082 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.045059 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp"] Jun 10 13:10:05.091322 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.091288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f2eb035-14b9-4d7c-95ee-4207327b0afa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.091497 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.091401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lldhs\" (UniqueName: \"kubernetes.io/projected/3f2eb035-14b9-4d7c-95ee-4207327b0afa-kube-api-access-lldhs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.192316 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.192259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lldhs\" (UniqueName: \"kubernetes.io/projected/3f2eb035-14b9-4d7c-95ee-4207327b0afa-kube-api-access-lldhs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.192486 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.192355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f2eb035-14b9-4d7c-95ee-4207327b0afa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.192700 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.192682 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f2eb035-14b9-4d7c-95ee-4207327b0afa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.203751 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.203724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lldhs\" (UniqueName: \"kubernetes.io/projected/3f2eb035-14b9-4d7c-95ee-4207327b0afa-kube-api-access-lldhs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.336838 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.336765 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:05.479578 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.479546 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp"] Jun 10 13:10:05.480842 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:05.480815 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2eb035_14b9_4d7c_95ee_4207327b0afa.slice/crio-a9894772c12557dd87748886a5522e595945c2825e997db34d207d4fc5178182 WatchSource:0}: Error finding container a9894772c12557dd87748886a5522e595945c2825e997db34d207d4fc5178182: Status 404 returned error can't find the container with id a9894772c12557dd87748886a5522e595945c2825e997db34d207d4fc5178182 Jun 10 13:10:05.641686 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:05.641607 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" event={"ID":"3f2eb035-14b9-4d7c-95ee-4207327b0afa","Type":"ContainerStarted","Data":"a9894772c12557dd87748886a5522e595945c2825e997db34d207d4fc5178182"} Jun 10 13:10:09.700282 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:09.700228 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n"] Jun 10 13:10:09.703934 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:09.703908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:09.707073 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:09.707051 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vzd7l\"" Jun 10 13:10:09.716729 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:09.716705 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n"] Jun 10 13:10:09.737200 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:09.732676 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxxwc\" (UniqueName: \"kubernetes.io/projected/3a6bf8a3-22af-477f-8db3-79371d180e6e-kube-api-access-mxxwc\") pod \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" (UID: \"3a6bf8a3-22af-477f-8db3-79371d180e6e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:09.833608 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:09.833574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxxwc\" (UniqueName: \"kubernetes.io/projected/3a6bf8a3-22af-477f-8db3-79371d180e6e-kube-api-access-mxxwc\") pod \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" (UID: \"3a6bf8a3-22af-477f-8db3-79371d180e6e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:09.844857 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:09.844833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxxwc\" (UniqueName: \"kubernetes.io/projected/3a6bf8a3-22af-477f-8db3-79371d180e6e-kube-api-access-mxxwc\") pod \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" (UID: \"3a6bf8a3-22af-477f-8db3-79371d180e6e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:10.016607 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:10.016580 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:10.157849 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:10.157822 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n"] Jun 10 13:10:10.158977 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:10.158950 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6bf8a3_22af_477f_8db3_79371d180e6e.slice/crio-27a533417296a86a4a579cde50a799c5ca72c6ad88ffd9141a741b5ac24ceab7 WatchSource:0}: Error finding container 27a533417296a86a4a579cde50a799c5ca72c6ad88ffd9141a741b5ac24ceab7: Status 404 returned error can't find the container with id 27a533417296a86a4a579cde50a799c5ca72c6ad88ffd9141a741b5ac24ceab7 Jun 10 13:10:10.670336 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:10.670299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" event={"ID":"3a6bf8a3-22af-477f-8db3-79371d180e6e","Type":"ContainerStarted","Data":"27a533417296a86a4a579cde50a799c5ca72c6ad88ffd9141a741b5ac24ceab7"} Jun 10 13:10:12.682623 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:12.682594 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" event={"ID":"3a6bf8a3-22af-477f-8db3-79371d180e6e","Type":"ContainerStarted","Data":"c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6"} Jun 10 13:10:12.682978 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:12.682663 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:12.684144 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:12.684124 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" event={"ID":"3f2eb035-14b9-4d7c-95ee-4207327b0afa","Type":"ContainerStarted","Data":"e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470"} Jun 10 13:10:12.684302 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:12.684283 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:12.710141 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:12.710088 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" podStartSLOduration=1.3565436100000001 podStartE2EDuration="3.710074345s" totalImagesPullingTime="2.353530735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:12.706713576 +0000 UTC m=+385.118108159" watchObservedRunningTime="2026-06-10 13:10:12.710074345 +0000 UTC m=+385.121468928" Jun 10 13:10:12.743680 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:12.743637 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" podStartSLOduration=1.7589613549999998 podStartE2EDuration="8.743621783s" totalImagesPullingTime="6.984660428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:12.742547276 +0000 UTC m=+385.153941858" watchObservedRunningTime="2026-06-10 13:10:12.743621783 +0000 UTC m=+385.155016365" Jun 10 13:10:23.692001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:23.691969 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:23.692392 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:23.692038 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:25.665855 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.665817 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp"] Jun 10 13:10:25.666352 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.666008 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" containerName="manager" containerID="cri-o://e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470" gracePeriod=2 Jun 10 13:10:25.681226 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.681199 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp"] Jun 10 13:10:25.691743 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.691707 2558 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3f2eb035-14b9-4d7c-95ee-4207327b0afa\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:25.716499 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.716466 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n"] Jun 10 13:10:25.716754 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.716701 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" containerName="manager" containerID="cri-o://c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6" gracePeriod=2 Jun 10 13:10:25.722188 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.722160 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp"] Jun 10 13:10:25.722891 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.722869 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" containerName="manager" Jun 10 13:10:25.723066 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.723052 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" containerName="manager" Jun 10 13:10:25.723335 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.723294 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" containerName="manager" Jun 10 13:10:25.726911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.726892 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n"] Jun 10 13:10:25.727033 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.726977 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:25.728182 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.728152 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:25.737852 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.737825 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:25.741708 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.741680 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:25.751141 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.751120 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp"] Jun 10 13:10:25.781767 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.781741 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db"] Jun 10 13:10:25.782134 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.782118 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" containerName="manager" Jun 10 13:10:25.782224 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.782135 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" containerName="manager" Jun 10 13:10:25.782292 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.782226 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" containerName="manager" Jun 10 13:10:25.782821 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.782790 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:25.785101 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.785083 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" Jun 10 13:10:25.802436 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.802417 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db"] Jun 10 13:10:25.832068 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.832033 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:25.834634 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.834607 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:25.860840 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.860810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b462x\" (UniqueName: \"kubernetes.io/projected/4479bd51-0971-4c17-90e1-a16a4952de27-kube-api-access-b462x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rqtrp\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:25.860986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.860867 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-982r5\" (UniqueName: \"kubernetes.io/projected/7a10699d-eed8-40dd-9723-6f1be9979c6c-kube-api-access-982r5\") pod \"limitador-operator-controller-manager-859d7b78bd-d54db\" (UID: \"7a10699d-eed8-40dd-9723-6f1be9979c6c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" Jun 10 13:10:25.860986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.860888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4479bd51-0971-4c17-90e1-a16a4952de27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rqtrp\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:25.960210 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.960189 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:25.962212 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.962187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4479bd51-0971-4c17-90e1-a16a4952de27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rqtrp\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:25.962316 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.962295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b462x\" (UniqueName: \"kubernetes.io/projected/4479bd51-0971-4c17-90e1-a16a4952de27-kube-api-access-b462x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rqtrp\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:25.962381 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.962339 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-982r5\" (UniqueName: \"kubernetes.io/projected/7a10699d-eed8-40dd-9723-6f1be9979c6c-kube-api-access-982r5\") pod \"limitador-operator-controller-manager-859d7b78bd-d54db\" (UID: \"7a10699d-eed8-40dd-9723-6f1be9979c6c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" Jun 10 13:10:25.962536 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.962516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4479bd51-0971-4c17-90e1-a16a4952de27-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rqtrp\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:25.962858 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.962843 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:25.964930 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.964907 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:25.967459 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.967438 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:25.969856 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.969833 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rp8fp\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:25.973063 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:25.973043 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fgp4n\" is forbidden: User \"system:node:ip-10-0-138-87.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-87.ec2.internal' and this object" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:25.979813 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.979793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b462x\" (UniqueName: \"kubernetes.io/projected/4479bd51-0971-4c17-90e1-a16a4952de27-kube-api-access-b462x\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rqtrp\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:25.983042 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:25.983023 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-982r5\" (UniqueName: \"kubernetes.io/projected/7a10699d-eed8-40dd-9723-6f1be9979c6c-kube-api-access-982r5\") pod \"limitador-operator-controller-manager-859d7b78bd-d54db\" (UID: \"7a10699d-eed8-40dd-9723-6f1be9979c6c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" Jun 10 13:10:26.063409 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.063384 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lldhs\" (UniqueName: \"kubernetes.io/projected/3f2eb035-14b9-4d7c-95ee-4207327b0afa-kube-api-access-lldhs\") pod \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " Jun 10 13:10:26.063521 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.063413 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxxwc\" (UniqueName: \"kubernetes.io/projected/3a6bf8a3-22af-477f-8db3-79371d180e6e-kube-api-access-mxxwc\") pod \"3a6bf8a3-22af-477f-8db3-79371d180e6e\" (UID: \"3a6bf8a3-22af-477f-8db3-79371d180e6e\") " Jun 10 13:10:26.063521 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.063454 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f2eb035-14b9-4d7c-95ee-4207327b0afa-extensions-socket-volume\") pod \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\" (UID: \"3f2eb035-14b9-4d7c-95ee-4207327b0afa\") " Jun 10 13:10:26.063975 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.063947 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f2eb035-14b9-4d7c-95ee-4207327b0afa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3f2eb035-14b9-4d7c-95ee-4207327b0afa" (UID: "3f2eb035-14b9-4d7c-95ee-4207327b0afa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:10:26.065202 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.065185 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f2eb035-14b9-4d7c-95ee-4207327b0afa-kube-api-access-lldhs" (OuterVolumeSpecName: "kube-api-access-lldhs") pod "3f2eb035-14b9-4d7c-95ee-4207327b0afa" (UID: "3f2eb035-14b9-4d7c-95ee-4207327b0afa"). InnerVolumeSpecName "kube-api-access-lldhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:10:26.065286 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.065251 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a6bf8a3-22af-477f-8db3-79371d180e6e-kube-api-access-mxxwc" (OuterVolumeSpecName: "kube-api-access-mxxwc") pod "3a6bf8a3-22af-477f-8db3-79371d180e6e" (UID: "3a6bf8a3-22af-477f-8db3-79371d180e6e"). InnerVolumeSpecName "kube-api-access-mxxwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:10:26.099412 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.099392 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:26.106861 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.106840 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" Jun 10 13:10:26.165464 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.165392 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lldhs\" (UniqueName: \"kubernetes.io/projected/3f2eb035-14b9-4d7c-95ee-4207327b0afa-kube-api-access-lldhs\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:10:26.165464 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.165424 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxxwc\" (UniqueName: \"kubernetes.io/projected/3a6bf8a3-22af-477f-8db3-79371d180e6e-kube-api-access-mxxwc\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:10:26.165464 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.165439 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3f2eb035-14b9-4d7c-95ee-4207327b0afa-extensions-socket-volume\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:10:26.255464 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.255440 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp"] Jun 10 13:10:26.256773 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:26.256742 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4479bd51_0971_4c17_90e1_a16a4952de27.slice/crio-d8ee0b30f77f944bde5ac2d4db8a1141c15be199741f35ecc20bb3850e932a82 WatchSource:0}: Error finding container d8ee0b30f77f944bde5ac2d4db8a1141c15be199741f35ecc20bb3850e932a82: Status 404 returned error can't find the container with id d8ee0b30f77f944bde5ac2d4db8a1141c15be199741f35ecc20bb3850e932a82 Jun 10 13:10:26.300820 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.300797 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db"] Jun 10 13:10:26.303534 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:26.303509 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a10699d_eed8_40dd_9723_6f1be9979c6c.slice/crio-137c7be4182d4eef43a3e5e4c81b3932ceb8c091ee5c2ebccca2d6c10e97c7fb WatchSource:0}: Error finding container 137c7be4182d4eef43a3e5e4c81b3932ceb8c091ee5c2ebccca2d6c10e97c7fb: Status 404 returned error can't find the container with id 137c7be4182d4eef43a3e5e4c81b3932ceb8c091ee5c2ebccca2d6c10e97c7fb Jun 10 13:10:26.762422 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.762389 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" event={"ID":"7a10699d-eed8-40dd-9723-6f1be9979c6c","Type":"ContainerStarted","Data":"1b62c41a6aef9cfa971d1362d40f9a82aafe39509541015aa9a013ad627c5344"} Jun 10 13:10:26.762810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.762446 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" event={"ID":"7a10699d-eed8-40dd-9723-6f1be9979c6c","Type":"ContainerStarted","Data":"137c7be4182d4eef43a3e5e4c81b3932ceb8c091ee5c2ebccca2d6c10e97c7fb"} Jun 10 13:10:26.762810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.762487 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" Jun 10 13:10:26.763768 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.763747 2558 generic.go:356] "Generic (PLEG): container finished" podID="3a6bf8a3-22af-477f-8db3-79371d180e6e" containerID="c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6" exitCode=0 Jun 10 13:10:26.763853 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.763779 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fgp4n" Jun 10 13:10:26.763853 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.763840 2558 scope.go:117] "RemoveContainer" containerID="c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6" Jun 10 13:10:26.765288 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.765250 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" containerID="e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470" exitCode=0 Jun 10 13:10:26.765398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.765380 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rp8fp" Jun 10 13:10:26.767113 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.767092 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" event={"ID":"4479bd51-0971-4c17-90e1-a16a4952de27","Type":"ContainerStarted","Data":"72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11"} Jun 10 13:10:26.767218 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.767131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" event={"ID":"4479bd51-0971-4c17-90e1-a16a4952de27","Type":"ContainerStarted","Data":"d8ee0b30f77f944bde5ac2d4db8a1141c15be199741f35ecc20bb3850e932a82"} Jun 10 13:10:26.767218 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.767181 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:26.772941 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.772923 2558 scope.go:117] "RemoveContainer" containerID="c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6" Jun 10 13:10:26.773217 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:26.773193 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6\": container with ID starting with c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6 not found: ID does not exist" containerID="c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6" Jun 10 13:10:26.773322 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.773229 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6"} err="failed to get container status \"c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6\": rpc error: code = NotFound desc = could not find container \"c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6\": container with ID starting with c874f27e0f31cfdc9c19f390b0b4fd46147d84c6fbb783cde97feec7fd732ac6 not found: ID does not exist" Jun 10 13:10:26.773322 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.773254 2558 scope.go:117] "RemoveContainer" containerID="e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470" Jun 10 13:10:26.781525 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.781512 2558 scope.go:117] "RemoveContainer" containerID="e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470" Jun 10 13:10:26.781745 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:26.781728 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470\": container with ID starting with e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470 not found: ID does not exist" containerID="e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470" Jun 10 13:10:26.781800 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.781750 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470"} err="failed to get container status \"e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470\": rpc error: code = NotFound desc = could not find container \"e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470\": container with ID starting with e26784be2282c8cdf508f4594466f8937705435f149972bc9719591e01d4d470 not found: ID does not exist" Jun 10 13:10:26.882833 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.882748 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" podStartSLOduration=1.882735808 podStartE2EDuration="1.882735808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:26.814925081 +0000 UTC m=+399.226319665" watchObservedRunningTime="2026-06-10 13:10:26.882735808 +0000 UTC m=+399.294130391" Jun 10 13:10:26.883241 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:26.883211 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" podStartSLOduration=1.883203736 podStartE2EDuration="1.883203736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:26.881646984 +0000 UTC m=+399.293041566" watchObservedRunningTime="2026-06-10 13:10:26.883203736 +0000 UTC m=+399.294598319" Jun 10 13:10:27.984691 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:27.984661 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a6bf8a3-22af-477f-8db3-79371d180e6e" path="/var/lib/kubelet/pods/3a6bf8a3-22af-477f-8db3-79371d180e6e/volumes" Jun 10 13:10:27.985025 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:27.984986 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f2eb035-14b9-4d7c-95ee-4207327b0afa" path="/var/lib/kubelet/pods/3f2eb035-14b9-4d7c-95ee-4207327b0afa/volumes" Jun 10 13:10:28.131329 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.131293 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94"] Jun 10 13:10:28.134750 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.134728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.175561 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.175536 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94"] Jun 10 13:10:28.181185 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.181161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8g8\" (UniqueName: \"kubernetes.io/projected/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-kube-api-access-pr8g8\") pod \"kuadrant-operator-controller-manager-86878c769f-jtg94\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.181329 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.181229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jtg94\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.281884 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.281801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jtg94\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.281884 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.281850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8g8\" (UniqueName: \"kubernetes.io/projected/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-kube-api-access-pr8g8\") pod \"kuadrant-operator-controller-manager-86878c769f-jtg94\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.282187 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.282169 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jtg94\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.293639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.293607 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8g8\" (UniqueName: \"kubernetes.io/projected/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-kube-api-access-pr8g8\") pod \"kuadrant-operator-controller-manager-86878c769f-jtg94\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.444126 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.444091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.586260 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.586238 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94"] Jun 10 13:10:28.586969 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:28.586944 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3218de4_9b3c_42c3_ae82_9e64ce6950a2.slice/crio-ce65b006790ac10d78000ce9fcf6f8b1420ef20bcea6caa7beb4b62fc0d48140 WatchSource:0}: Error finding container ce65b006790ac10d78000ce9fcf6f8b1420ef20bcea6caa7beb4b62fc0d48140: Status 404 returned error can't find the container with id ce65b006790ac10d78000ce9fcf6f8b1420ef20bcea6caa7beb4b62fc0d48140 Jun 10 13:10:28.781665 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.781634 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" event={"ID":"c3218de4-9b3c-42c3-ae82-9e64ce6950a2","Type":"ContainerStarted","Data":"48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad"} Jun 10 13:10:28.781800 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.781690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" event={"ID":"c3218de4-9b3c-42c3-ae82-9e64ce6950a2","Type":"ContainerStarted","Data":"ce65b006790ac10d78000ce9fcf6f8b1420ef20bcea6caa7beb4b62fc0d48140"} Jun 10 13:10:28.781800 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.781714 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:28.815120 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:28.815078 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" podStartSLOduration=0.815063865 podStartE2EDuration="815.063865ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:28.814606451 +0000 UTC m=+401.226001033" watchObservedRunningTime="2026-06-10 13:10:28.815063865 +0000 UTC m=+401.226458447" Jun 10 13:10:37.776644 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:37.776613 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:37.777068 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:37.776686 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d54db" Jun 10 13:10:39.789363 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:39.789331 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:10:39.846041 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:39.846005 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp"] Jun 10 13:10:39.846219 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:39.846176 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" podUID="4479bd51-0971-4c17-90e1-a16a4952de27" containerName="manager" containerID="cri-o://72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11" gracePeriod=10 Jun 10 13:10:40.097717 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.097696 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:40.181256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.181230 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b462x\" (UniqueName: \"kubernetes.io/projected/4479bd51-0971-4c17-90e1-a16a4952de27-kube-api-access-b462x\") pod \"4479bd51-0971-4c17-90e1-a16a4952de27\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " Jun 10 13:10:40.181420 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.181376 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4479bd51-0971-4c17-90e1-a16a4952de27-extensions-socket-volume\") pod \"4479bd51-0971-4c17-90e1-a16a4952de27\" (UID: \"4479bd51-0971-4c17-90e1-a16a4952de27\") " Jun 10 13:10:40.181738 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.181718 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4479bd51-0971-4c17-90e1-a16a4952de27-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4479bd51-0971-4c17-90e1-a16a4952de27" (UID: "4479bd51-0971-4c17-90e1-a16a4952de27"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:10:40.183298 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.183276 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4479bd51-0971-4c17-90e1-a16a4952de27-kube-api-access-b462x" (OuterVolumeSpecName: "kube-api-access-b462x") pod "4479bd51-0971-4c17-90e1-a16a4952de27" (UID: "4479bd51-0971-4c17-90e1-a16a4952de27"). InnerVolumeSpecName "kube-api-access-b462x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:10:40.282759 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.282736 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b462x\" (UniqueName: \"kubernetes.io/projected/4479bd51-0971-4c17-90e1-a16a4952de27-kube-api-access-b462x\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:10:40.282759 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.282759 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4479bd51-0971-4c17-90e1-a16a4952de27-extensions-socket-volume\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:10:40.848062 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.848028 2558 generic.go:356] "Generic (PLEG): container finished" podID="4479bd51-0971-4c17-90e1-a16a4952de27" containerID="72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11" exitCode=0 Jun 10 13:10:40.848556 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.848070 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" event={"ID":"4479bd51-0971-4c17-90e1-a16a4952de27","Type":"ContainerDied","Data":"72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11"} Jun 10 13:10:40.848556 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.848084 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" Jun 10 13:10:40.848556 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.848140 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp" event={"ID":"4479bd51-0971-4c17-90e1-a16a4952de27","Type":"ContainerDied","Data":"d8ee0b30f77f944bde5ac2d4db8a1141c15be199741f35ecc20bb3850e932a82"} Jun 10 13:10:40.848556 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.848163 2558 scope.go:117] "RemoveContainer" containerID="72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11" Jun 10 13:10:40.857261 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.857245 2558 scope.go:117] "RemoveContainer" containerID="72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11" Jun 10 13:10:40.857509 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:10:40.857489 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11\": container with ID starting with 72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11 not found: ID does not exist" containerID="72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11" Jun 10 13:10:40.857550 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.857516 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11"} err="failed to get container status \"72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11\": rpc error: code = NotFound desc = could not find container \"72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11\": container with ID starting with 72a0dee02572ff53c65efe6ba70a29f2d3fb188b414ae923fadb453efa297a11 not found: ID does not exist" Jun 10 13:10:40.882417 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.882388 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp"] Jun 10 13:10:40.902615 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:40.902591 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rqtrp"] Jun 10 13:10:41.983819 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:41.983791 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4479bd51-0971-4c17-90e1-a16a4952de27" path="/var/lib/kubelet/pods/4479bd51-0971-4c17-90e1-a16a4952de27/volumes" Jun 10 13:10:56.186125 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.186087 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7"] Jun 10 13:10:56.186518 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.186448 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4479bd51-0971-4c17-90e1-a16a4952de27" containerName="manager" Jun 10 13:10:56.186518 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.186459 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4479bd51-0971-4c17-90e1-a16a4952de27" containerName="manager" Jun 10 13:10:56.186626 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.186521 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4479bd51-0971-4c17-90e1-a16a4952de27" containerName="manager" Jun 10 13:10:56.190601 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.190585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.193585 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.193562 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wfhqn\"" Jun 10 13:10:56.204639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.204615 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7"] Jun 10 13:10:56.303435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303435 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303645 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303467 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303645 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303645 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.303810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.303782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brlbr\" (UniqueName: \"kubernetes.io/projected/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-kube-api-access-brlbr\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.404911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.404880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brlbr\" (UniqueName: \"kubernetes.io/projected/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-kube-api-access-brlbr\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405052 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.404986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405052 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405052 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405214 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405293 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405251 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405364 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405473 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405570 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405485 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405570 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405497 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405753 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405616 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405753 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405860 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.405899 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.405855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.407211 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.407189 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.407560 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.407542 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.415202 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.415179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brlbr\" (UniqueName: \"kubernetes.io/projected/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-kube-api-access-brlbr\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.415448 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.415430 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36bc21f6-fd42-41ab-8a64-95ad8037ccb6-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-qj6c7\" (UID: \"36bc21f6-fd42-41ab-8a64-95ad8037ccb6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.500763 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.500738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:56.641062 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.641035 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7"] Jun 10 13:10:56.641950 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:56.641928 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bc21f6_fd42_41ab_8a64_95ad8037ccb6.slice/crio-8fd21b95452f4044fcfb82e2be32ce0b28c0f3ff0feee0f2a5873e1fe5243480 WatchSource:0}: Error finding container 8fd21b95452f4044fcfb82e2be32ce0b28c0f3ff0feee0f2a5873e1fe5243480: Status 404 returned error can't find the container with id 8fd21b95452f4044fcfb82e2be32ce0b28c0f3ff0feee0f2a5873e1fe5243480 Jun 10 13:10:56.644059 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.644026 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:10:56.644137 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.644086 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:10:56.644137 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.644115 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:10:56.930179 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.930094 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" event={"ID":"36bc21f6-fd42-41ab-8a64-95ad8037ccb6","Type":"ContainerStarted","Data":"86684a725b5466d88822856363e81cac35e0ec2fa4eecc8586f822b089458e64"} Jun 10 13:10:56.930179 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.930151 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" event={"ID":"36bc21f6-fd42-41ab-8a64-95ad8037ccb6","Type":"ContainerStarted","Data":"8fd21b95452f4044fcfb82e2be32ce0b28c0f3ff0feee0f2a5873e1fe5243480"} Jun 10 13:10:56.956949 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:56.956909 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" podStartSLOduration=0.956894427 podStartE2EDuration="956.894427ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:10:56.956219598 +0000 UTC m=+429.367614190" watchObservedRunningTime="2026-06-10 13:10:56.956894427 +0000 UTC m=+429.368289009" Jun 10 13:10:57.501033 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:57.501005 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:57.505623 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:57.505601 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:57.934809 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:57.934710 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:57.935586 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:57.935565 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:10:58.970852 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:58.970820 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9s7br"] Jun 10 13:10:58.974099 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:58.974081 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9s7br" Jun 10 13:10:58.977889 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:58.977870 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j9c28\"" Jun 10 13:10:58.989603 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:58.989581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9s7br"] Jun 10 13:10:59.127055 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.127031 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6ldp\" (UniqueName: \"kubernetes.io/projected/e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f-kube-api-access-h6ldp\") pod \"authorino-58cd955675-9s7br\" (UID: \"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f\") " pod="kuadrant-system/authorino-58cd955675-9s7br" Jun 10 13:10:59.183287 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.182177 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xnnfz"] Jun 10 13:10:59.191223 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.191196 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xnnfz" Jun 10 13:10:59.195311 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.195262 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xnnfz"] Jun 10 13:10:59.227761 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.227705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6ldp\" (UniqueName: \"kubernetes.io/projected/e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f-kube-api-access-h6ldp\") pod \"authorino-58cd955675-9s7br\" (UID: \"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f\") " pod="kuadrant-system/authorino-58cd955675-9s7br" Jun 10 13:10:59.243893 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.243871 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6ldp\" (UniqueName: \"kubernetes.io/projected/e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f-kube-api-access-h6ldp\") pod \"authorino-58cd955675-9s7br\" (UID: \"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f\") " pod="kuadrant-system/authorino-58cd955675-9s7br" Jun 10 13:10:59.283326 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.283303 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9s7br" Jun 10 13:10:59.329125 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.329092 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m5p9\" (UniqueName: \"kubernetes.io/projected/8627c1f4-4560-47de-868e-916bc179aec4-kube-api-access-2m5p9\") pod \"authorino-75d556bd77-xnnfz\" (UID: \"8627c1f4-4560-47de-868e-916bc179aec4\") " pod="kuadrant-system/authorino-75d556bd77-xnnfz" Jun 10 13:10:59.423947 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.423923 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9s7br"] Jun 10 13:10:59.425232 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:59.425210 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1ca41f1_7c02_4f38_adc8_d256c4a2dd7f.slice/crio-5a70987adf05ead251d655dd7a671ba21dae9aa0e45bdc24692ed93302d9a049 WatchSource:0}: Error finding container 5a70987adf05ead251d655dd7a671ba21dae9aa0e45bdc24692ed93302d9a049: Status 404 returned error can't find the container with id 5a70987adf05ead251d655dd7a671ba21dae9aa0e45bdc24692ed93302d9a049 Jun 10 13:10:59.430366 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.430345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m5p9\" (UniqueName: \"kubernetes.io/projected/8627c1f4-4560-47de-868e-916bc179aec4-kube-api-access-2m5p9\") pod \"authorino-75d556bd77-xnnfz\" (UID: \"8627c1f4-4560-47de-868e-916bc179aec4\") " pod="kuadrant-system/authorino-75d556bd77-xnnfz" Jun 10 13:10:59.444752 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.444732 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m5p9\" (UniqueName: \"kubernetes.io/projected/8627c1f4-4560-47de-868e-916bc179aec4-kube-api-access-2m5p9\") pod \"authorino-75d556bd77-xnnfz\" (UID: \"8627c1f4-4560-47de-868e-916bc179aec4\") " pod="kuadrant-system/authorino-75d556bd77-xnnfz" Jun 10 13:10:59.501534 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.501512 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xnnfz" Jun 10 13:10:59.645102 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.645077 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xnnfz"] Jun 10 13:10:59.646798 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:10:59.646770 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8627c1f4_4560_47de_868e_916bc179aec4.slice/crio-16569402e6e65cbf661de4b5e089157e4ac8271963eb75fcd1f228b2b3ec63af WatchSource:0}: Error finding container 16569402e6e65cbf661de4b5e089157e4ac8271963eb75fcd1f228b2b3ec63af: Status 404 returned error can't find the container with id 16569402e6e65cbf661de4b5e089157e4ac8271963eb75fcd1f228b2b3ec63af Jun 10 13:10:59.949239 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.949131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xnnfz" event={"ID":"8627c1f4-4560-47de-868e-916bc179aec4","Type":"ContainerStarted","Data":"16569402e6e65cbf661de4b5e089157e4ac8271963eb75fcd1f228b2b3ec63af"} Jun 10 13:10:59.950624 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:10:59.950591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9s7br" event={"ID":"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f","Type":"ContainerStarted","Data":"5a70987adf05ead251d655dd7a671ba21dae9aa0e45bdc24692ed93302d9a049"} Jun 10 13:11:02.973766 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:02.973725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9s7br" event={"ID":"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f","Type":"ContainerStarted","Data":"1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79"} Jun 10 13:11:02.975375 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:02.975348 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xnnfz" event={"ID":"8627c1f4-4560-47de-868e-916bc179aec4","Type":"ContainerStarted","Data":"615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4"} Jun 10 13:11:03.017165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:03.017109 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9s7br" podStartSLOduration=1.626964639 podStartE2EDuration="5.017093117s" totalImagesPullingTime="3.390128478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:03.015045946 +0000 UTC m=+435.426440529" watchObservedRunningTime="2026-06-10 13:11:03.017093117 +0000 UTC m=+435.428487739" Jun 10 13:11:03.050088 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:03.050039 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xnnfz" podStartSLOduration=0.866027232 podStartE2EDuration="4.05002489s" totalImagesPullingTime="3.183997658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:11:03.048552537 +0000 UTC m=+435.459947121" watchObservedRunningTime="2026-06-10 13:11:03.05002489 +0000 UTC m=+435.461419473" Jun 10 13:11:03.098818 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:03.098747 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9s7br"] Jun 10 13:11:04.985701 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:04.985664 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9s7br" podUID="e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f" containerName="authorino" containerID="cri-o://1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79" gracePeriod=30 Jun 10 13:11:05.237854 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.237798 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9s7br" Jun 10 13:11:05.281873 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.281842 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6ldp\" (UniqueName: \"kubernetes.io/projected/e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f-kube-api-access-h6ldp\") pod \"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f\" (UID: \"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f\") " Jun 10 13:11:05.284051 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.283993 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f-kube-api-access-h6ldp" (OuterVolumeSpecName: "kube-api-access-h6ldp") pod "e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f" (UID: "e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f"). InnerVolumeSpecName "kube-api-access-h6ldp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:11:05.382964 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.382937 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6ldp\" (UniqueName: \"kubernetes.io/projected/e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f-kube-api-access-h6ldp\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:11:05.996750 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.996721 2558 generic.go:356] "Generic (PLEG): container finished" podID="e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f" containerID="1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79" exitCode=0 Jun 10 13:11:05.997114 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.996764 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9s7br" Jun 10 13:11:05.997114 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.996782 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9s7br" event={"ID":"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f","Type":"ContainerDied","Data":"1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79"} Jun 10 13:11:05.997114 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.996823 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9s7br" event={"ID":"e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f","Type":"ContainerDied","Data":"5a70987adf05ead251d655dd7a671ba21dae9aa0e45bdc24692ed93302d9a049"} Jun 10 13:11:05.997114 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:05.996850 2558 scope.go:117] "RemoveContainer" containerID="1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79" Jun 10 13:11:06.005340 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:06.005322 2558 scope.go:117] "RemoveContainer" containerID="1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79" Jun 10 13:11:06.005602 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:11:06.005581 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79\": container with ID starting with 1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79 not found: ID does not exist" containerID="1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79" Jun 10 13:11:06.005650 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:06.005608 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79"} err="failed to get container status \"1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79\": rpc error: code = NotFound desc = could not find container \"1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79\": container with ID starting with 1f203632d248e6f4483cc2e1a9f0235bab21f43c08aba3b40e97696a55ea6d79 not found: ID does not exist" Jun 10 13:11:06.024920 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:06.024899 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9s7br"] Jun 10 13:11:06.033810 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:06.033792 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9s7br"] Jun 10 13:11:07.984255 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:07.984222 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f" path="/var/lib/kubelet/pods/e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f/volumes" Jun 10 13:11:30.964256 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.964224 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6"] Jun 10 13:11:30.964671 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.964563 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f" containerName="authorino" Jun 10 13:11:30.964671 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.964574 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f" containerName="authorino" Jun 10 13:11:30.964671 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.964634 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1ca41f1-7c02-4f38-adc8-d256c4a2dd7f" containerName="authorino" Jun 10 13:11:30.967854 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.967838 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:30.973450 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.973428 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-8jvvb\"" Jun 10 13:11:30.973450 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.973438 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 13:11:30.973618 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.973427 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 13:11:30.985037 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:30.985016 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6"] Jun 10 13:11:31.084462 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.084434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6w66\" (UniqueName: \"kubernetes.io/projected/08942140-992f-4b4b-88d5-f0cdf87c394e-kube-api-access-x6w66\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.084624 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.084607 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.084832 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.084789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.185922 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.185892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.186086 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.185939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6w66\" (UniqueName: \"kubernetes.io/projected/08942140-992f-4b4b-88d5-f0cdf87c394e-kube-api-access-x6w66\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.186086 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.185986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.186341 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.186320 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.186416 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.186369 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.197645 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.197625 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6w66\" (UniqueName: \"kubernetes.io/projected/08942140-992f-4b4b-88d5-f0cdf87c394e-kube-api-access-x6w66\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.276788 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.276765 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:31.409019 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:31.408987 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6"] Jun 10 13:11:31.409353 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:11:31.409332 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08942140_992f_4b4b_88d5_f0cdf87c394e.slice/crio-a6d4bfd9aa01033c304078d1b26da3063c863892443fc20e7acec852b1950dd7 WatchSource:0}: Error finding container a6d4bfd9aa01033c304078d1b26da3063c863892443fc20e7acec852b1950dd7: Status 404 returned error can't find the container with id a6d4bfd9aa01033c304078d1b26da3063c863892443fc20e7acec852b1950dd7 Jun 10 13:11:32.130998 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:32.130965 2558 generic.go:356] "Generic (PLEG): container finished" podID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerID="25b1539a2dfa7b047e071116e89342f37f4a6900e33ac8c3c6cfa2b05b3652b8" exitCode=0 Jun 10 13:11:32.131474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:32.131021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" event={"ID":"08942140-992f-4b4b-88d5-f0cdf87c394e","Type":"ContainerDied","Data":"25b1539a2dfa7b047e071116e89342f37f4a6900e33ac8c3c6cfa2b05b3652b8"} Jun 10 13:11:32.131474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:32.131073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" event={"ID":"08942140-992f-4b4b-88d5-f0cdf87c394e","Type":"ContainerStarted","Data":"a6d4bfd9aa01033c304078d1b26da3063c863892443fc20e7acec852b1950dd7"} Jun 10 13:11:33.137931 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:33.137898 2558 generic.go:356] "Generic (PLEG): container finished" podID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerID="65eec189e751cf25b94ec4e88d13e9a5db0442a66319f45310dda419038106cd" exitCode=0 Jun 10 13:11:33.138292 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:33.137934 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" event={"ID":"08942140-992f-4b4b-88d5-f0cdf87c394e","Type":"ContainerDied","Data":"65eec189e751cf25b94ec4e88d13e9a5db0442a66319f45310dda419038106cd"} Jun 10 13:11:34.144933 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:34.144901 2558 generic.go:356] "Generic (PLEG): container finished" podID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerID="eff3399474bb81405b637a085ec3a2642bf8bd653488d613ddf124e59665e9ce" exitCode=0 Jun 10 13:11:34.144933 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:34.144934 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" event={"ID":"08942140-992f-4b4b-88d5-f0cdf87c394e","Type":"ContainerDied","Data":"eff3399474bb81405b637a085ec3a2642bf8bd653488d613ddf124e59665e9ce"} Jun 10 13:11:35.338164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.338135 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:35.424398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.424338 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-bundle\") pod \"08942140-992f-4b4b-88d5-f0cdf87c394e\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " Jun 10 13:11:35.424398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.424380 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-util\") pod \"08942140-992f-4b4b-88d5-f0cdf87c394e\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " Jun 10 13:11:35.424552 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.424405 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6w66\" (UniqueName: \"kubernetes.io/projected/08942140-992f-4b4b-88d5-f0cdf87c394e-kube-api-access-x6w66\") pod \"08942140-992f-4b4b-88d5-f0cdf87c394e\" (UID: \"08942140-992f-4b4b-88d5-f0cdf87c394e\") " Jun 10 13:11:35.424868 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.424836 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-bundle" (OuterVolumeSpecName: "bundle") pod "08942140-992f-4b4b-88d5-f0cdf87c394e" (UID: "08942140-992f-4b4b-88d5-f0cdf87c394e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:11:35.426503 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.426483 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08942140-992f-4b4b-88d5-f0cdf87c394e-kube-api-access-x6w66" (OuterVolumeSpecName: "kube-api-access-x6w66") pod "08942140-992f-4b4b-88d5-f0cdf87c394e" (UID: "08942140-992f-4b4b-88d5-f0cdf87c394e"). InnerVolumeSpecName "kube-api-access-x6w66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:11:35.430466 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.430444 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-util" (OuterVolumeSpecName: "util") pod "08942140-992f-4b4b-88d5-f0cdf87c394e" (UID: "08942140-992f-4b4b-88d5-f0cdf87c394e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:11:35.525151 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.525127 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:11:35.525151 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.525146 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08942140-992f-4b4b-88d5-f0cdf87c394e-util\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:11:35.525294 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:35.525156 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6w66\" (UniqueName: \"kubernetes.io/projected/08942140-992f-4b4b-88d5-f0cdf87c394e-kube-api-access-x6w66\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:11:36.156844 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:36.156811 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" event={"ID":"08942140-992f-4b4b-88d5-f0cdf87c394e","Type":"ContainerDied","Data":"a6d4bfd9aa01033c304078d1b26da3063c863892443fc20e7acec852b1950dd7"} Jun 10 13:11:36.157012 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:36.156859 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6d4bfd9aa01033c304078d1b26da3063c863892443fc20e7acec852b1950dd7" Jun 10 13:11:36.157012 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:36.156859 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748k6hg6" Jun 10 13:11:56.136926 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.136889 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:56.137325 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.137201 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerName="util" Jun 10 13:11:56.137325 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.137214 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerName="util" Jun 10 13:11:56.137325 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.137221 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerName="extract" Jun 10 13:11:56.137325 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.137227 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerName="extract" Jun 10 13:11:56.137325 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.137242 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerName="pull" Jun 10 13:11:56.137325 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.137249 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerName="pull" Jun 10 13:11:56.137540 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.137336 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="08942140-992f-4b4b-88d5-f0cdf87c394e" containerName="extract" Jun 10 13:11:56.141714 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.141698 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:56.145379 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.145355 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:11:56.145529 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.145393 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:11:56.145529 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.145436 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:11:56.146720 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.146692 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rqpw6\"" Jun 10 13:11:56.151698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.151679 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:56.289239 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.289211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ch7j\" (UniqueName: \"kubernetes.io/projected/816f1634-ebf7-4a98-adeb-7a83b945bef1-kube-api-access-2ch7j\") pod \"maas-keycloak-0\" (UID: \"816f1634-ebf7-4a98-adeb-7a83b945bef1\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:56.390606 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.390535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ch7j\" (UniqueName: \"kubernetes.io/projected/816f1634-ebf7-4a98-adeb-7a83b945bef1-kube-api-access-2ch7j\") pod \"maas-keycloak-0\" (UID: \"816f1634-ebf7-4a98-adeb-7a83b945bef1\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:56.403521 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.403490 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ch7j\" (UniqueName: \"kubernetes.io/projected/816f1634-ebf7-4a98-adeb-7a83b945bef1-kube-api-access-2ch7j\") pod \"maas-keycloak-0\" (UID: \"816f1634-ebf7-4a98-adeb-7a83b945bef1\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:56.451861 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.451836 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:11:56.596252 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:56.596229 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:11:56.597569 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:11:56.597533 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816f1634_ebf7_4a98_adeb_7a83b945bef1.slice/crio-3daabd39c56c6e0ed1af64058c1ae669c41fee2a1ff718fcb2e0c834eac88d2b WatchSource:0}: Error finding container 3daabd39c56c6e0ed1af64058c1ae669c41fee2a1ff718fcb2e0c834eac88d2b: Status 404 returned error can't find the container with id 3daabd39c56c6e0ed1af64058c1ae669c41fee2a1ff718fcb2e0c834eac88d2b Jun 10 13:11:57.273542 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:11:57.273504 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"816f1634-ebf7-4a98-adeb-7a83b945bef1","Type":"ContainerStarted","Data":"3daabd39c56c6e0ed1af64058c1ae669c41fee2a1ff718fcb2e0c834eac88d2b"} Jun 10 13:12:02.308570 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:02.308526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"816f1634-ebf7-4a98-adeb-7a83b945bef1","Type":"ContainerStarted","Data":"64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c"} Jun 10 13:12:02.340438 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:02.340382 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.04422359 podStartE2EDuration="6.340367449s" totalImagesPullingTime="5.296143859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:11:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:12:02.339085858 +0000 UTC m=+494.750480440" watchObservedRunningTime="2026-06-10 13:12:02.340367449 +0000 UTC m=+494.751762031" Jun 10 13:12:02.452900 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:02.452863 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:12:02.454905 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:02.454852 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:03.452350 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:03.452307 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:04.452408 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:04.452365 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:05.452709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:05.452657 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:06.452046 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:06.452001 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:12:06.452604 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:06.452560 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:07.452698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:07.452648 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:08.452677 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:08.452628 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:09.453339 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:09.453292 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:10.452917 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:10.452879 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:11.452749 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:11.452689 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:12.452743 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:12.452687 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:13.452362 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:13.452318 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:14.453251 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:14.453202 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.46:9000/health/started\": dial tcp 10.133.0.46:9000: connect: connection refused" Jun 10 13:12:15.579282 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:15.579202 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:12:15.594569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:15.594528 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:12:25.586345 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:25.586308 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:12:26.478018 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.477979 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m2x8g"] Jun 10 13:12:26.489313 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.489257 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m2x8g"] Jun 10 13:12:26.489450 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.489374 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" Jun 10 13:12:26.561214 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.561183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mr4fk\" (UniqueName: \"kubernetes.io/projected/e88fe386-aef2-4cf6-952c-b7ce65a51e32-kube-api-access-mr4fk\") pod \"authorino-5d4b67c446-m2x8g\" (UID: \"e88fe386-aef2-4cf6-952c-b7ce65a51e32\") " pod="kuadrant-system/authorino-5d4b67c446-m2x8g" Jun 10 13:12:26.662396 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.661997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mr4fk\" (UniqueName: \"kubernetes.io/projected/e88fe386-aef2-4cf6-952c-b7ce65a51e32-kube-api-access-mr4fk\") pod \"authorino-5d4b67c446-m2x8g\" (UID: \"e88fe386-aef2-4cf6-952c-b7ce65a51e32\") " pod="kuadrant-system/authorino-5d4b67c446-m2x8g" Jun 10 13:12:26.676339 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.676310 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mr4fk\" (UniqueName: \"kubernetes.io/projected/e88fe386-aef2-4cf6-952c-b7ce65a51e32-kube-api-access-mr4fk\") pod \"authorino-5d4b67c446-m2x8g\" (UID: \"e88fe386-aef2-4cf6-952c-b7ce65a51e32\") " pod="kuadrant-system/authorino-5d4b67c446-m2x8g" Jun 10 13:12:26.731596 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.731575 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m2x8g"] Jun 10 13:12:26.731773 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.731762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" Jun 10 13:12:26.769905 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.769871 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84df7867d9-b8zd8"] Jun 10 13:12:26.773689 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.773663 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df7867d9-b8zd8" Jun 10 13:12:26.786908 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.786701 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84df7867d9-b8zd8"] Jun 10 13:12:26.864084 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.864051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nrj5\" (UniqueName: \"kubernetes.io/projected/c1e07d14-51e1-40e4-8769-3b5fb3a4f522-kube-api-access-8nrj5\") pod \"authorino-84df7867d9-b8zd8\" (UID: \"c1e07d14-51e1-40e4-8769-3b5fb3a4f522\") " pod="kuadrant-system/authorino-84df7867d9-b8zd8" Jun 10 13:12:26.870005 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.869983 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m2x8g"] Jun 10 13:12:26.871829 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:12:26.871806 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode88fe386_aef2_4cf6_952c_b7ce65a51e32.slice/crio-4f15aea27c4c3a4c2bd456243ee4e591c929ba16ca04aae4fa892a25adac1f95 WatchSource:0}: Error finding container 4f15aea27c4c3a4c2bd456243ee4e591c929ba16ca04aae4fa892a25adac1f95: Status 404 returned error can't find the container with id 4f15aea27c4c3a4c2bd456243ee4e591c929ba16ca04aae4fa892a25adac1f95 Jun 10 13:12:26.942839 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.942811 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84df7867d9-b8zd8"] Jun 10 13:12:26.943073 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:12:26.943055 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-8nrj5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-84df7867d9-b8zd8" podUID="c1e07d14-51e1-40e4-8769-3b5fb3a4f522" Jun 10 13:12:26.965153 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.965122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nrj5\" (UniqueName: \"kubernetes.io/projected/c1e07d14-51e1-40e4-8769-3b5fb3a4f522-kube-api-access-8nrj5\") pod \"authorino-84df7867d9-b8zd8\" (UID: \"c1e07d14-51e1-40e4-8769-3b5fb3a4f522\") " pod="kuadrant-system/authorino-84df7867d9-b8zd8" Jun 10 13:12:26.968965 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.968945 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b74495df-bbk5l"] Jun 10 13:12:26.972459 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.972444 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:26.975160 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.975144 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 13:12:26.983658 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.983611 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b74495df-bbk5l"] Jun 10 13:12:26.987850 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:26.987831 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nrj5\" (UniqueName: \"kubernetes.io/projected/c1e07d14-51e1-40e4-8769-3b5fb3a4f522-kube-api-access-8nrj5\") pod \"authorino-84df7867d9-b8zd8\" (UID: \"c1e07d14-51e1-40e4-8769-3b5fb3a4f522\") " pod="kuadrant-system/authorino-84df7867d9-b8zd8" Jun 10 13:12:27.065714 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.065687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn9sr\" (UniqueName: \"kubernetes.io/projected/4ac241dd-d260-42d9-a231-f3a2f81b71a9-kube-api-access-hn9sr\") pod \"authorino-b74495df-bbk5l\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:27.065837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.065741 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ac241dd-d260-42d9-a231-f3a2f81b71a9-tls-cert\") pod \"authorino-b74495df-bbk5l\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:27.167105 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.167081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ac241dd-d260-42d9-a231-f3a2f81b71a9-tls-cert\") pod \"authorino-b74495df-bbk5l\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:27.167206 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.167142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn9sr\" (UniqueName: \"kubernetes.io/projected/4ac241dd-d260-42d9-a231-f3a2f81b71a9-kube-api-access-hn9sr\") pod \"authorino-b74495df-bbk5l\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:27.169401 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.169382 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ac241dd-d260-42d9-a231-f3a2f81b71a9-tls-cert\") pod \"authorino-b74495df-bbk5l\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:27.179429 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.179408 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn9sr\" (UniqueName: \"kubernetes.io/projected/4ac241dd-d260-42d9-a231-f3a2f81b71a9-kube-api-access-hn9sr\") pod \"authorino-b74495df-bbk5l\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:27.281535 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.281508 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:12:27.419538 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.419513 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b74495df-bbk5l"] Jun 10 13:12:27.421697 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:12:27.421674 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ac241dd_d260_42d9_a231_f3a2f81b71a9.slice/crio-8e6cb3f491638e2f23a306edba54d4cdc3983556644cdde20e42b70d2ff587ee WatchSource:0}: Error finding container 8e6cb3f491638e2f23a306edba54d4cdc3983556644cdde20e42b70d2ff587ee: Status 404 returned error can't find the container with id 8e6cb3f491638e2f23a306edba54d4cdc3983556644cdde20e42b70d2ff587ee Jun 10 13:12:27.498485 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.498419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" event={"ID":"e88fe386-aef2-4cf6-952c-b7ce65a51e32","Type":"ContainerStarted","Data":"de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e"} Jun 10 13:12:27.498485 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.498455 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" event={"ID":"e88fe386-aef2-4cf6-952c-b7ce65a51e32","Type":"ContainerStarted","Data":"4f15aea27c4c3a4c2bd456243ee4e591c929ba16ca04aae4fa892a25adac1f95"} Jun 10 13:12:27.498651 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.498476 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" podUID="e88fe386-aef2-4cf6-952c-b7ce65a51e32" containerName="authorino" containerID="cri-o://de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e" gracePeriod=30 Jun 10 13:12:27.499653 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.499632 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b74495df-bbk5l" event={"ID":"4ac241dd-d260-42d9-a231-f3a2f81b71a9","Type":"ContainerStarted","Data":"8e6cb3f491638e2f23a306edba54d4cdc3983556644cdde20e42b70d2ff587ee"} Jun 10 13:12:27.499752 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.499685 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df7867d9-b8zd8" Jun 10 13:12:27.507101 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.507083 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df7867d9-b8zd8" Jun 10 13:12:27.519698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.519659 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" podStartSLOduration=1.205060182 podStartE2EDuration="1.519645997s" totalImagesPullingTime="314.585815ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:12:27.51810874 +0000 UTC m=+519.929503324" watchObservedRunningTime="2026-06-10 13:12:27.519645997 +0000 UTC m=+519.931040604" Jun 10 13:12:27.571571 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.571512 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nrj5\" (UniqueName: \"kubernetes.io/projected/c1e07d14-51e1-40e4-8769-3b5fb3a4f522-kube-api-access-8nrj5\") pod \"c1e07d14-51e1-40e4-8769-3b5fb3a4f522\" (UID: \"c1e07d14-51e1-40e4-8769-3b5fb3a4f522\") " Jun 10 13:12:27.573383 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.573362 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e07d14-51e1-40e4-8769-3b5fb3a4f522-kube-api-access-8nrj5" (OuterVolumeSpecName: "kube-api-access-8nrj5") pod "c1e07d14-51e1-40e4-8769-3b5fb3a4f522" (UID: "c1e07d14-51e1-40e4-8769-3b5fb3a4f522"). InnerVolumeSpecName "kube-api-access-8nrj5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:12:27.673076 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.673048 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nrj5\" (UniqueName: \"kubernetes.io/projected/c1e07d14-51e1-40e4-8769-3b5fb3a4f522-kube-api-access-8nrj5\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:12:27.746023 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.745999 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" Jun 10 13:12:27.773803 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.773528 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mr4fk\" (UniqueName: \"kubernetes.io/projected/e88fe386-aef2-4cf6-952c-b7ce65a51e32-kube-api-access-mr4fk\") pod \"e88fe386-aef2-4cf6-952c-b7ce65a51e32\" (UID: \"e88fe386-aef2-4cf6-952c-b7ce65a51e32\") " Jun 10 13:12:27.775697 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.775662 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e88fe386-aef2-4cf6-952c-b7ce65a51e32-kube-api-access-mr4fk" (OuterVolumeSpecName: "kube-api-access-mr4fk") pod "e88fe386-aef2-4cf6-952c-b7ce65a51e32" (UID: "e88fe386-aef2-4cf6-952c-b7ce65a51e32"). InnerVolumeSpecName "kube-api-access-mr4fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:12:27.874472 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:27.874451 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mr4fk\" (UniqueName: \"kubernetes.io/projected/e88fe386-aef2-4cf6-952c-b7ce65a51e32-kube-api-access-mr4fk\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:12:28.507437 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.507408 2558 generic.go:356] "Generic (PLEG): container finished" podID="e88fe386-aef2-4cf6-952c-b7ce65a51e32" containerID="de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e" exitCode=0 Jun 10 13:12:28.507668 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.507451 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" Jun 10 13:12:28.507668 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.507501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" event={"ID":"e88fe386-aef2-4cf6-952c-b7ce65a51e32","Type":"ContainerDied","Data":"de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e"} Jun 10 13:12:28.507668 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.507548 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m2x8g" event={"ID":"e88fe386-aef2-4cf6-952c-b7ce65a51e32","Type":"ContainerDied","Data":"4f15aea27c4c3a4c2bd456243ee4e591c929ba16ca04aae4fa892a25adac1f95"} Jun 10 13:12:28.507668 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.507574 2558 scope.go:117] "RemoveContainer" containerID="de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e" Jun 10 13:12:28.509089 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.509065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b74495df-bbk5l" event={"ID":"4ac241dd-d260-42d9-a231-f3a2f81b71a9","Type":"ContainerStarted","Data":"7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d"} Jun 10 13:12:28.509089 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.509087 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df7867d9-b8zd8" Jun 10 13:12:28.516306 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.516260 2558 scope.go:117] "RemoveContainer" containerID="de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e" Jun 10 13:12:28.516606 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:12:28.516590 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e\": container with ID starting with de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e not found: ID does not exist" containerID="de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e" Jun 10 13:12:28.516661 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.516616 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e"} err="failed to get container status \"de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e\": rpc error: code = NotFound desc = could not find container \"de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e\": container with ID starting with de72ff5befefa91f56362094cd376b429ccd9d9bf102a9876d1d5c3240476e1e not found: ID does not exist" Jun 10 13:12:28.527823 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.527801 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m2x8g"] Jun 10 13:12:28.533678 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.533658 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m2x8g"] Jun 10 13:12:28.561670 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.561643 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84df7867d9-b8zd8"] Jun 10 13:12:28.566765 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.566742 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84df7867d9-b8zd8"] Jun 10 13:12:28.584198 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.584158 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b74495df-bbk5l" podStartSLOduration=2.20749625 podStartE2EDuration="2.584145852s" totalImagesPullingTime="376.649602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:12:28.583202625 +0000 UTC m=+520.994597208" watchObservedRunningTime="2026-06-10 13:12:28.584145852 +0000 UTC m=+520.995540434" Jun 10 13:12:28.620344 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.620319 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xnnfz"] Jun 10 13:12:28.620506 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.620486 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xnnfz" podUID="8627c1f4-4560-47de-868e-916bc179aec4" containerName="authorino" containerID="cri-o://615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4" gracePeriod=30 Jun 10 13:12:28.859293 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.859254 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xnnfz" Jun 10 13:12:28.883198 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.883175 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m5p9\" (UniqueName: \"kubernetes.io/projected/8627c1f4-4560-47de-868e-916bc179aec4-kube-api-access-2m5p9\") pod \"8627c1f4-4560-47de-868e-916bc179aec4\" (UID: \"8627c1f4-4560-47de-868e-916bc179aec4\") " Jun 10 13:12:28.885372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.885337 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8627c1f4-4560-47de-868e-916bc179aec4-kube-api-access-2m5p9" (OuterVolumeSpecName: "kube-api-access-2m5p9") pod "8627c1f4-4560-47de-868e-916bc179aec4" (UID: "8627c1f4-4560-47de-868e-916bc179aec4"). InnerVolumeSpecName "kube-api-access-2m5p9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:12:28.984015 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:28.983990 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m5p9\" (UniqueName: \"kubernetes.io/projected/8627c1f4-4560-47de-868e-916bc179aec4-kube-api-access-2m5p9\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:12:29.515990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.515958 2558 generic.go:356] "Generic (PLEG): container finished" podID="8627c1f4-4560-47de-868e-916bc179aec4" containerID="615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4" exitCode=0 Jun 10 13:12:29.516164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.516000 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xnnfz" Jun 10 13:12:29.516164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.516044 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xnnfz" event={"ID":"8627c1f4-4560-47de-868e-916bc179aec4","Type":"ContainerDied","Data":"615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4"} Jun 10 13:12:29.516164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.516082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xnnfz" event={"ID":"8627c1f4-4560-47de-868e-916bc179aec4","Type":"ContainerDied","Data":"16569402e6e65cbf661de4b5e089157e4ac8271963eb75fcd1f228b2b3ec63af"} Jun 10 13:12:29.516164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.516103 2558 scope.go:117] "RemoveContainer" containerID="615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4" Jun 10 13:12:29.524919 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.524903 2558 scope.go:117] "RemoveContainer" containerID="615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4" Jun 10 13:12:29.525163 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:12:29.525147 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4\": container with ID starting with 615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4 not found: ID does not exist" containerID="615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4" Jun 10 13:12:29.525206 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.525171 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4"} err="failed to get container status \"615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4\": rpc error: code = NotFound desc = could not find container \"615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4\": container with ID starting with 615b3fb43cea4f33459c58bc69f7991eda0cfe7d496cc2d47f2232deeefe3db4 not found: ID does not exist" Jun 10 13:12:29.545844 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.545822 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xnnfz"] Jun 10 13:12:29.550203 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.550182 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xnnfz"] Jun 10 13:12:29.983932 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.983902 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8627c1f4-4560-47de-868e-916bc179aec4" path="/var/lib/kubelet/pods/8627c1f4-4560-47de-868e-916bc179aec4/volumes" Jun 10 13:12:29.984299 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.984203 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e07d14-51e1-40e4-8769-3b5fb3a4f522" path="/var/lib/kubelet/pods/c1e07d14-51e1-40e4-8769-3b5fb3a4f522/volumes" Jun 10 13:12:29.984424 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:29.984411 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e88fe386-aef2-4cf6-952c-b7ce65a51e32" path="/var/lib/kubelet/pods/e88fe386-aef2-4cf6-952c-b7ce65a51e32/volumes" Jun 10 13:12:32.434528 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.434492 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64ccc6b944-rgwr5"] Jun 10 13:12:32.435016 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.434997 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8627c1f4-4560-47de-868e-916bc179aec4" containerName="authorino" Jun 10 13:12:32.435095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.435018 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8627c1f4-4560-47de-868e-916bc179aec4" containerName="authorino" Jun 10 13:12:32.435095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.435048 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e88fe386-aef2-4cf6-952c-b7ce65a51e32" containerName="authorino" Jun 10 13:12:32.435095 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.435058 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e88fe386-aef2-4cf6-952c-b7ce65a51e32" containerName="authorino" Jun 10 13:12:32.435248 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.435152 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8627c1f4-4560-47de-868e-916bc179aec4" containerName="authorino" Jun 10 13:12:32.435248 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.435168 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e88fe386-aef2-4cf6-952c-b7ce65a51e32" containerName="authorino" Jun 10 13:12:32.439728 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.439707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.443487 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.443468 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nvpxs\"" Jun 10 13:12:32.445022 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.445007 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:12:32.445106 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.445046 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:12:32.458986 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.458963 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ccc6b944-rgwr5"] Jun 10 13:12:32.511040 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.511015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-webhook-cert\") pod \"maas-controller-64ccc6b944-rgwr5\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.511150 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.511048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-527jm\" (UniqueName: \"kubernetes.io/projected/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-kube-api-access-527jm\") pod \"maas-controller-64ccc6b944-rgwr5\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.611495 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.611471 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-webhook-cert\") pod \"maas-controller-64ccc6b944-rgwr5\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.611649 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.611502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-527jm\" (UniqueName: \"kubernetes.io/projected/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-kube-api-access-527jm\") pod \"maas-controller-64ccc6b944-rgwr5\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.613836 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.613815 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-webhook-cert\") pod \"maas-controller-64ccc6b944-rgwr5\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.625748 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.625722 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-527jm\" (UniqueName: \"kubernetes.io/projected/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-kube-api-access-527jm\") pod \"maas-controller-64ccc6b944-rgwr5\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.628077 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.628057 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-566cd7474-kpfks"] Jun 10 13:12:32.631741 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.631723 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:32.643706 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.643685 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-566cd7474-kpfks"] Jun 10 13:12:32.711976 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.711897 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca08198a-9cb6-4a45-a5c5-952108364a9f-webhook-cert\") pod \"maas-controller-566cd7474-kpfks\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:32.712085 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.712020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sph6n\" (UniqueName: \"kubernetes.io/projected/ca08198a-9cb6-4a45-a5c5-952108364a9f-kube-api-access-sph6n\") pod \"maas-controller-566cd7474-kpfks\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:32.751321 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.751300 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:32.813544 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.813014 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sph6n\" (UniqueName: \"kubernetes.io/projected/ca08198a-9cb6-4a45-a5c5-952108364a9f-kube-api-access-sph6n\") pod \"maas-controller-566cd7474-kpfks\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:32.813544 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.813094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca08198a-9cb6-4a45-a5c5-952108364a9f-webhook-cert\") pod \"maas-controller-566cd7474-kpfks\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:32.816734 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.816685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca08198a-9cb6-4a45-a5c5-952108364a9f-webhook-cert\") pod \"maas-controller-566cd7474-kpfks\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:32.825871 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.825846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sph6n\" (UniqueName: \"kubernetes.io/projected/ca08198a-9cb6-4a45-a5c5-952108364a9f-kube-api-access-sph6n\") pod \"maas-controller-566cd7474-kpfks\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:32.893702 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.893680 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64ccc6b944-rgwr5"] Jun 10 13:12:32.894674 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:12:32.894652 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb7370f_fc15_4f57_a71f_f5f69678c6d8.slice/crio-e4078cd941b5b5ce1e3540831d520a35cac31250a9ff8c65307892bddebfd684 WatchSource:0}: Error finding container e4078cd941b5b5ce1e3540831d520a35cac31250a9ff8c65307892bddebfd684: Status 404 returned error can't find the container with id e4078cd941b5b5ce1e3540831d520a35cac31250a9ff8c65307892bddebfd684 Jun 10 13:12:32.943745 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:32.943719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:33.099131 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:33.099106 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-566cd7474-kpfks"] Jun 10 13:12:33.100851 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:12:33.100823 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca08198a_9cb6_4a45_a5c5_952108364a9f.slice/crio-9ee7edc4011c9edcb99232655d4278e4e4305d241765e7509f40aaebb6a5c4d0 WatchSource:0}: Error finding container 9ee7edc4011c9edcb99232655d4278e4e4305d241765e7509f40aaebb6a5c4d0: Status 404 returned error can't find the container with id 9ee7edc4011c9edcb99232655d4278e4e4305d241765e7509f40aaebb6a5c4d0 Jun 10 13:12:33.545585 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:33.545538 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566cd7474-kpfks" event={"ID":"ca08198a-9cb6-4a45-a5c5-952108364a9f","Type":"ContainerStarted","Data":"9ee7edc4011c9edcb99232655d4278e4e4305d241765e7509f40aaebb6a5c4d0"} Jun 10 13:12:33.547729 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:33.547701 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" event={"ID":"ebb7370f-fc15-4f57-a71f-f5f69678c6d8","Type":"ContainerStarted","Data":"e4078cd941b5b5ce1e3540831d520a35cac31250a9ff8c65307892bddebfd684"} Jun 10 13:12:36.567006 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:36.566969 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566cd7474-kpfks" event={"ID":"ca08198a-9cb6-4a45-a5c5-952108364a9f","Type":"ContainerStarted","Data":"3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0"} Jun 10 13:12:36.567500 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:36.567037 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:36.568559 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:36.568537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" event={"ID":"ebb7370f-fc15-4f57-a71f-f5f69678c6d8","Type":"ContainerStarted","Data":"bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd"} Jun 10 13:12:36.568638 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:36.568587 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:36.595440 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:36.595400 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-566cd7474-kpfks" podStartSLOduration=2.14204742 podStartE2EDuration="4.595386281s" totalImagesPullingTime="2.453338861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:12:36.59309259 +0000 UTC m=+529.004487174" watchObservedRunningTime="2026-06-10 13:12:36.595386281 +0000 UTC m=+529.006780863" Jun 10 13:12:36.620246 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:36.620196 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" podStartSLOduration=1.9501767380000001 podStartE2EDuration="4.620177736s" totalImagesPullingTime="2.670000998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:12:36.61822249 +0000 UTC m=+529.029617075" watchObservedRunningTime="2026-06-10 13:12:36.620177736 +0000 UTC m=+529.031572321" Jun 10 13:12:47.580078 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:47.580050 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:12:47.580467 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:47.580411 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:47.651399 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:47.651371 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ccc6b944-rgwr5"] Jun 10 13:12:47.651613 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:47.651576 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" podUID="ebb7370f-fc15-4f57-a71f-f5f69678c6d8" containerName="manager" containerID="cri-o://bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd" gracePeriod=30 Jun 10 13:12:47.894568 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:47.894537 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:48.045971 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.045940 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-527jm\" (UniqueName: \"kubernetes.io/projected/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-kube-api-access-527jm\") pod \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " Jun 10 13:12:48.046115 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.046025 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-webhook-cert\") pod \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\" (UID: \"ebb7370f-fc15-4f57-a71f-f5f69678c6d8\") " Jun 10 13:12:48.048181 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.048153 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-kube-api-access-527jm" (OuterVolumeSpecName: "kube-api-access-527jm") pod "ebb7370f-fc15-4f57-a71f-f5f69678c6d8" (UID: "ebb7370f-fc15-4f57-a71f-f5f69678c6d8"). InnerVolumeSpecName "kube-api-access-527jm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:12:48.048181 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.048151 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ebb7370f-fc15-4f57-a71f-f5f69678c6d8" (UID: "ebb7370f-fc15-4f57-a71f-f5f69678c6d8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:12:48.147588 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.147519 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-webhook-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:12:48.147588 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.147545 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-527jm\" (UniqueName: \"kubernetes.io/projected/ebb7370f-fc15-4f57-a71f-f5f69678c6d8-kube-api-access-527jm\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:12:48.634541 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.634507 2558 generic.go:356] "Generic (PLEG): container finished" podID="ebb7370f-fc15-4f57-a71f-f5f69678c6d8" containerID="bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd" exitCode=0 Jun 10 13:12:48.634990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.634554 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" Jun 10 13:12:48.634990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.634598 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" event={"ID":"ebb7370f-fc15-4f57-a71f-f5f69678c6d8","Type":"ContainerDied","Data":"bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd"} Jun 10 13:12:48.634990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.634657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64ccc6b944-rgwr5" event={"ID":"ebb7370f-fc15-4f57-a71f-f5f69678c6d8","Type":"ContainerDied","Data":"e4078cd941b5b5ce1e3540831d520a35cac31250a9ff8c65307892bddebfd684"} Jun 10 13:12:48.634990 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.634694 2558 scope.go:117] "RemoveContainer" containerID="bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd" Jun 10 13:12:48.643599 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.643584 2558 scope.go:117] "RemoveContainer" containerID="bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd" Jun 10 13:12:48.643839 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:12:48.643821 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd\": container with ID starting with bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd not found: ID does not exist" containerID="bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd" Jun 10 13:12:48.643880 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.643848 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd"} err="failed to get container status \"bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd\": rpc error: code = NotFound desc = could not find container \"bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd\": container with ID starting with bd9ced0ea20d1a684bfbf8947042f978ff4b4832150695d436397fa88404d7cd not found: ID does not exist" Jun 10 13:12:48.660124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.660101 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64ccc6b944-rgwr5"] Jun 10 13:12:48.665660 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:48.665637 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64ccc6b944-rgwr5"] Jun 10 13:12:49.984281 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:12:49.984235 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebb7370f-fc15-4f57-a71f-f5f69678c6d8" path="/var/lib/kubelet/pods/ebb7370f-fc15-4f57-a71f-f5f69678c6d8/volumes" Jun 10 13:13:07.604546 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.604515 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-n499w"] Jun 10 13:13:07.604995 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.604976 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb7370f-fc15-4f57-a71f-f5f69678c6d8" containerName="manager" Jun 10 13:13:07.604995 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.604992 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb7370f-fc15-4f57-a71f-f5f69678c6d8" containerName="manager" Jun 10 13:13:07.605069 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.605054 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb7370f-fc15-4f57-a71f-f5f69678c6d8" containerName="manager" Jun 10 13:13:07.608207 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.608192 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-n499w" Jun 10 13:13:07.611627 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.611601 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-b76cm\"" Jun 10 13:13:07.611758 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.611600 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 13:13:07.618587 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.618563 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-n499w"] Jun 10 13:13:07.699649 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.699611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq9vv\" (UniqueName: \"kubernetes.io/projected/8ba5994d-310c-4630-b132-1f8d3a951f32-kube-api-access-vq9vv\") pod \"payload-processing-699b6cd6c-n499w\" (UID: \"8ba5994d-310c-4630-b132-1f8d3a951f32\") " pod="openshift-ingress/payload-processing-699b6cd6c-n499w" Jun 10 13:13:07.800931 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.800897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9vv\" (UniqueName: \"kubernetes.io/projected/8ba5994d-310c-4630-b132-1f8d3a951f32-kube-api-access-vq9vv\") pod \"payload-processing-699b6cd6c-n499w\" (UID: \"8ba5994d-310c-4630-b132-1f8d3a951f32\") " pod="openshift-ingress/payload-processing-699b6cd6c-n499w" Jun 10 13:13:07.816575 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.816538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq9vv\" (UniqueName: \"kubernetes.io/projected/8ba5994d-310c-4630-b132-1f8d3a951f32-kube-api-access-vq9vv\") pod \"payload-processing-699b6cd6c-n499w\" (UID: \"8ba5994d-310c-4630-b132-1f8d3a951f32\") " pod="openshift-ingress/payload-processing-699b6cd6c-n499w" Jun 10 13:13:07.919799 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:07.919717 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-n499w" Jun 10 13:13:08.069491 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:08.069457 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-n499w"] Jun 10 13:13:08.070643 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:13:08.070613 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba5994d_310c_4630_b132_1f8d3a951f32.slice/crio-f6838443c40833833259081755e6c0033f87714566f06440aff43813b9fb452a WatchSource:0}: Error finding container f6838443c40833833259081755e6c0033f87714566f06440aff43813b9fb452a: Status 404 returned error can't find the container with id f6838443c40833833259081755e6c0033f87714566f06440aff43813b9fb452a Jun 10 13:13:08.746828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:08.746787 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-n499w" event={"ID":"8ba5994d-310c-4630-b132-1f8d3a951f32","Type":"ContainerStarted","Data":"f6838443c40833833259081755e6c0033f87714566f06440aff43813b9fb452a"} Jun 10 13:13:11.764648 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:11.764613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-n499w" event={"ID":"8ba5994d-310c-4630-b132-1f8d3a951f32","Type":"ContainerStarted","Data":"197dadc11c76125f404bfbdb4b5bb50ef5e82ebea56f208e314b1aa68241f779"} Jun 10 13:13:11.765031 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:11.764884 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-n499w" Jun 10 13:13:11.790995 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:11.790943 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-n499w" podStartSLOduration=2.037216056 podStartE2EDuration="4.790924787s" totalImagesPullingTime="2.753708731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:11.789510372 +0000 UTC m=+564.200904955" watchObservedRunningTime="2026-06-10 13:13:11.790924787 +0000 UTC m=+564.202319362" Jun 10 13:13:13.977426 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:13.977389 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-qj6c7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 10 13:13:13.977925 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:13.977452 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" podUID="36bc21f6-fd42-41ab-8a64-95ad8037ccb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 10 13:13:15.795064 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:15.795031 2558 generic.go:356] "Generic (PLEG): container finished" podID="36bc21f6-fd42-41ab-8a64-95ad8037ccb6" containerID="86684a725b5466d88822856363e81cac35e0ec2fa4eecc8586f822b089458e64" exitCode=0 Jun 10 13:13:15.795505 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:15.795090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" event={"ID":"36bc21f6-fd42-41ab-8a64-95ad8037ccb6","Type":"ContainerDied","Data":"86684a725b5466d88822856363e81cac35e0ec2fa4eecc8586f822b089458e64"} Jun 10 13:13:15.795505 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:15.795453 2558 scope.go:117] "RemoveContainer" containerID="86684a725b5466d88822856363e81cac35e0ec2fa4eecc8586f822b089458e64" Jun 10 13:13:15.796480 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:15.796452 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:13:15.796551 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:15.796523 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:13:15.796588 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:15.796557 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 10 13:13:16.802124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:16.802090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" event={"ID":"36bc21f6-fd42-41ab-8a64-95ad8037ccb6","Type":"ContainerStarted","Data":"a57a469ccc7e45b0601bc60fb0a2caece3b7ae57cc5a806caa74001340184ba8"} Jun 10 13:13:17.502191 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:17.501470 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:13:17.502191 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:17.501874 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-qj6c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 10 13:13:17.502191 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:17.501922 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" podUID="36bc21f6-fd42-41ab-8a64-95ad8037ccb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 10 13:13:18.501220 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:18.501181 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-qj6c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 10 13:13:18.501822 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:18.501786 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" podUID="36bc21f6-fd42-41ab-8a64-95ad8037ccb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 10 13:13:19.501769 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:19.501731 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-qj6c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 10 13:13:19.502346 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:19.502312 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" podUID="36bc21f6-fd42-41ab-8a64-95ad8037ccb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 10 13:13:19.822021 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:19.821942 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:13:19.822179 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:19.822151 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" containerID="cri-o://64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c" gracePeriod=30 Jun 10 13:13:20.501767 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:20.501301 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-qj6c7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jun 10 13:13:20.501767 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:20.501366 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" podUID="36bc21f6-fd42-41ab-8a64-95ad8037ccb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jun 10 13:13:21.468211 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.468186 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:21.504997 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.504968 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:13:21.505478 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.505458 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:13:21.506250 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.506228 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-qj6c7" Jun 10 13:13:21.525964 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.525909 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ch7j\" (UniqueName: \"kubernetes.io/projected/816f1634-ebf7-4a98-adeb-7a83b945bef1-kube-api-access-2ch7j\") pod \"816f1634-ebf7-4a98-adeb-7a83b945bef1\" (UID: \"816f1634-ebf7-4a98-adeb-7a83b945bef1\") " Jun 10 13:13:21.528411 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.528257 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/816f1634-ebf7-4a98-adeb-7a83b945bef1-kube-api-access-2ch7j" (OuterVolumeSpecName: "kube-api-access-2ch7j") pod "816f1634-ebf7-4a98-adeb-7a83b945bef1" (UID: "816f1634-ebf7-4a98-adeb-7a83b945bef1"). InnerVolumeSpecName "kube-api-access-2ch7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:13:21.627379 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.627350 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ch7j\" (UniqueName: \"kubernetes.io/projected/816f1634-ebf7-4a98-adeb-7a83b945bef1-kube-api-access-2ch7j\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:13:21.833406 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.833317 2558 generic.go:356] "Generic (PLEG): container finished" podID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerID="64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c" exitCode=143 Jun 10 13:13:21.833406 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.833360 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:21.833406 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.833393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"816f1634-ebf7-4a98-adeb-7a83b945bef1","Type":"ContainerDied","Data":"64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c"} Jun 10 13:13:21.833694 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.833442 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"816f1634-ebf7-4a98-adeb-7a83b945bef1","Type":"ContainerDied","Data":"3daabd39c56c6e0ed1af64058c1ae669c41fee2a1ff718fcb2e0c834eac88d2b"} Jun 10 13:13:21.833694 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.833466 2558 scope.go:117] "RemoveContainer" containerID="64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c" Jun 10 13:13:21.842909 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.842894 2558 scope.go:117] "RemoveContainer" containerID="64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c" Jun 10 13:13:21.843140 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:13:21.843122 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c\": container with ID starting with 64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c not found: ID does not exist" containerID="64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c" Jun 10 13:13:21.843187 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.843150 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c"} err="failed to get container status \"64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c\": rpc error: code = NotFound desc = could not find container \"64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c\": container with ID starting with 64c5eaf86160ddc7712596973d2fce5752ec1d385d571c3953d023e59792748c not found: ID does not exist" Jun 10 13:13:21.860128 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.860104 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:13:21.868180 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.868161 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:13:21.895196 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.895177 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:13:21.895532 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.895520 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" Jun 10 13:13:21.895585 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.895534 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" Jun 10 13:13:21.895619 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.895595 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" containerName="keycloak" Jun 10 13:13:21.900181 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.900167 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:21.903155 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.903138 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 13:13:21.903285 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.903189 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 13:13:21.903285 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.903206 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-rqpw6\"" Jun 10 13:13:21.903285 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.903252 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 13:13:21.903460 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.903281 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 13:13:21.908499 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.908477 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:13:21.929812 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.929788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/749bf23a-1855-405e-9ab2-e465278155a7-test-realms\") pod \"maas-keycloak-0\" (UID: \"749bf23a-1855-405e-9ab2-e465278155a7\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:21.929911 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.929818 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wt6m\" (UniqueName: \"kubernetes.io/projected/749bf23a-1855-405e-9ab2-e465278155a7-kube-api-access-9wt6m\") pod \"maas-keycloak-0\" (UID: \"749bf23a-1855-405e-9ab2-e465278155a7\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:21.983956 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:21.983933 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="816f1634-ebf7-4a98-adeb-7a83b945bef1" path="/var/lib/kubelet/pods/816f1634-ebf7-4a98-adeb-7a83b945bef1/volumes" Jun 10 13:13:22.032295 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.031075 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/749bf23a-1855-405e-9ab2-e465278155a7-test-realms\") pod \"maas-keycloak-0\" (UID: \"749bf23a-1855-405e-9ab2-e465278155a7\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:22.032295 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.031129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wt6m\" (UniqueName: \"kubernetes.io/projected/749bf23a-1855-405e-9ab2-e465278155a7-kube-api-access-9wt6m\") pod \"maas-keycloak-0\" (UID: \"749bf23a-1855-405e-9ab2-e465278155a7\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:22.036219 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.032460 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/749bf23a-1855-405e-9ab2-e465278155a7-test-realms\") pod \"maas-keycloak-0\" (UID: \"749bf23a-1855-405e-9ab2-e465278155a7\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:22.041469 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.041447 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wt6m\" (UniqueName: \"kubernetes.io/projected/749bf23a-1855-405e-9ab2-e465278155a7-kube-api-access-9wt6m\") pod \"maas-keycloak-0\" (UID: \"749bf23a-1855-405e-9ab2-e465278155a7\") " pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:22.210762 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.210699 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:22.342620 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.342592 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 13:13:22.343936 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:13:22.343911 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749bf23a_1855_405e_9ab2_e465278155a7.slice/crio-4092bbb9ca6edfaf4372991e08ab072efd1190ac0ab7ff7992843d36a83d7922 WatchSource:0}: Error finding container 4092bbb9ca6edfaf4372991e08ab072efd1190ac0ab7ff7992843d36a83d7922: Status 404 returned error can't find the container with id 4092bbb9ca6edfaf4372991e08ab072efd1190ac0ab7ff7992843d36a83d7922 Jun 10 13:13:22.778219 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.778198 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-n499w" Jun 10 13:13:22.843253 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.843215 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"749bf23a-1855-405e-9ab2-e465278155a7","Type":"ContainerStarted","Data":"2b549164efd922922a3bc0289a5c012134981edc567bc39b4db86bf9fa9a7d24"} Jun 10 13:13:22.843412 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.843310 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"749bf23a-1855-405e-9ab2-e465278155a7","Type":"ContainerStarted","Data":"4092bbb9ca6edfaf4372991e08ab072efd1190ac0ab7ff7992843d36a83d7922"} Jun 10 13:13:22.865437 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:22.865389 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.4835985329999999 podStartE2EDuration="1.865374569s" totalImagesPullingTime="381.776036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:13:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:22.86389182 +0000 UTC m=+575.275286404" watchObservedRunningTime="2026-06-10 13:13:22.865374569 +0000 UTC m=+575.276769152" Jun 10 13:13:23.211408 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:23.211374 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:23.213347 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:23.213309 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:24.211841 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:24.211779 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:25.211395 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:25.211346 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:26.211709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:26.211655 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:27.211869 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:27.211829 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:28.212717 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:28.212677 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:29.212047 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:29.211996 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:30.211385 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:30.211336 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:31.211785 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:31.211745 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:32.211179 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:32.211139 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:32.211478 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:32.211450 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:33.211427 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:33.211383 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:34.211881 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:34.211832 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:35.211753 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:35.211699 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.53:9000/health/started\": dial tcp 10.133.0.53:9000: connect: connection refused" Jun 10 13:13:36.334392 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:36.334355 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:36.348680 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:36.348627 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="749bf23a-1855-405e-9ab2-e465278155a7" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 13:13:46.340165 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:46.340131 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 13:13:57.074758 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.074717 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-567856c6c7-2w8rs"] Jun 10 13:13:57.082698 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.082670 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.085862 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.085840 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 13:13:57.089141 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.089116 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-567856c6c7-2w8rs"] Jun 10 13:13:57.160570 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.160536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0031f4e5-8089-40e7-b559-a5409f14c925-tls-cert\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.160720 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.160600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0031f4e5-8089-40e7-b559-a5409f14c925-oidc-ca\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.160720 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.160692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8vqq\" (UniqueName: \"kubernetes.io/projected/0031f4e5-8089-40e7-b559-a5409f14c925-kube-api-access-t8vqq\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.261205 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.261175 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0031f4e5-8089-40e7-b559-a5409f14c925-oidc-ca\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.261334 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.261224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8vqq\" (UniqueName: \"kubernetes.io/projected/0031f4e5-8089-40e7-b559-a5409f14c925-kube-api-access-t8vqq\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.261334 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.261300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0031f4e5-8089-40e7-b559-a5409f14c925-tls-cert\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.261923 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.261895 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0031f4e5-8089-40e7-b559-a5409f14c925-oidc-ca\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.263771 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.263752 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0031f4e5-8089-40e7-b559-a5409f14c925-tls-cert\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.274975 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.274948 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8vqq\" (UniqueName: \"kubernetes.io/projected/0031f4e5-8089-40e7-b559-a5409f14c925-kube-api-access-t8vqq\") pod \"authorino-567856c6c7-2w8rs\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.392482 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.392419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:13:57.524589 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.524562 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-567856c6c7-2w8rs"] Jun 10 13:13:57.525666 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:13:57.525643 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0031f4e5_8089_40e7_b559_a5409f14c925.slice/crio-288869cdc666ed1ce69f0376f6775b491a643243bf8c4297a452231bb17284c1 WatchSource:0}: Error finding container 288869cdc666ed1ce69f0376f6775b491a643243bf8c4297a452231bb17284c1: Status 404 returned error can't find the container with id 288869cdc666ed1ce69f0376f6775b491a643243bf8c4297a452231bb17284c1 Jun 10 13:13:57.526829 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:57.526809 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 13:13:58.089888 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.089850 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-567856c6c7-2w8rs" event={"ID":"0031f4e5-8089-40e7-b559-a5409f14c925","Type":"ContainerStarted","Data":"699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66"} Jun 10 13:13:58.089888 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.089887 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-567856c6c7-2w8rs" event={"ID":"0031f4e5-8089-40e7-b559-a5409f14c925","Type":"ContainerStarted","Data":"288869cdc666ed1ce69f0376f6775b491a643243bf8c4297a452231bb17284c1"} Jun 10 13:13:58.109088 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.109048 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-567856c6c7-2w8rs" podStartSLOduration=0.691574846 podStartE2EDuration="1.109034097s" totalImagesPullingTime="417.459251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:13:58.1076488 +0000 UTC m=+610.519043385" watchObservedRunningTime="2026-06-10 13:13:58.109034097 +0000 UTC m=+610.520428680" Jun 10 13:13:58.152044 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.152011 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b74495df-bbk5l"] Jun 10 13:13:58.152597 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.152191 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-b74495df-bbk5l" podUID="4ac241dd-d260-42d9-a231-f3a2f81b71a9" containerName="authorino" containerID="cri-o://7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d" gracePeriod=30 Jun 10 13:13:58.438691 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.438663 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:13:58.473173 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.473139 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn9sr\" (UniqueName: \"kubernetes.io/projected/4ac241dd-d260-42d9-a231-f3a2f81b71a9-kube-api-access-hn9sr\") pod \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " Jun 10 13:13:58.473372 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.473196 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ac241dd-d260-42d9-a231-f3a2f81b71a9-tls-cert\") pod \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\" (UID: \"4ac241dd-d260-42d9-a231-f3a2f81b71a9\") " Jun 10 13:13:58.475251 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.475223 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ac241dd-d260-42d9-a231-f3a2f81b71a9-kube-api-access-hn9sr" (OuterVolumeSpecName: "kube-api-access-hn9sr") pod "4ac241dd-d260-42d9-a231-f3a2f81b71a9" (UID: "4ac241dd-d260-42d9-a231-f3a2f81b71a9"). InnerVolumeSpecName "kube-api-access-hn9sr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:13:58.483400 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.483373 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ac241dd-d260-42d9-a231-f3a2f81b71a9-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4ac241dd-d260-42d9-a231-f3a2f81b71a9" (UID: "4ac241dd-d260-42d9-a231-f3a2f81b71a9"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:13:58.574578 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.574511 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn9sr\" (UniqueName: \"kubernetes.io/projected/4ac241dd-d260-42d9-a231-f3a2f81b71a9-kube-api-access-hn9sr\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:13:58.574578 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:58.574538 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4ac241dd-d260-42d9-a231-f3a2f81b71a9-tls-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:13:59.096834 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.096801 2558 generic.go:356] "Generic (PLEG): container finished" podID="4ac241dd-d260-42d9-a231-f3a2f81b71a9" containerID="7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d" exitCode=0 Jun 10 13:13:59.097318 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.096846 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b74495df-bbk5l" Jun 10 13:13:59.097318 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.096888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b74495df-bbk5l" event={"ID":"4ac241dd-d260-42d9-a231-f3a2f81b71a9","Type":"ContainerDied","Data":"7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d"} Jun 10 13:13:59.097318 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.096931 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b74495df-bbk5l" event={"ID":"4ac241dd-d260-42d9-a231-f3a2f81b71a9","Type":"ContainerDied","Data":"8e6cb3f491638e2f23a306edba54d4cdc3983556644cdde20e42b70d2ff587ee"} Jun 10 13:13:59.097318 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.096950 2558 scope.go:117] "RemoveContainer" containerID="7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d" Jun 10 13:13:59.106336 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.106314 2558 scope.go:117] "RemoveContainer" containerID="7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d" Jun 10 13:13:59.106574 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:13:59.106557 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d\": container with ID starting with 7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d not found: ID does not exist" containerID="7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d" Jun 10 13:13:59.106635 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.106583 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d"} err="failed to get container status \"7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d\": rpc error: code = NotFound desc = could not find container \"7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d\": container with ID starting with 7b49e0b83eb5512faa8bc84cf510e70d74771a4589cbeed6dbd61ab5d36f441d not found: ID does not exist" Jun 10 13:13:59.120978 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.120957 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b74495df-bbk5l"] Jun 10 13:13:59.128117 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.128096 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b74495df-bbk5l"] Jun 10 13:13:59.985120 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:13:59.985087 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ac241dd-d260-42d9-a231-f3a2f81b71a9" path="/var/lib/kubelet/pods/4ac241dd-d260-42d9-a231-f3a2f81b71a9/volumes" Jun 10 13:14:25.563327 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.563289 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb"] Jun 10 13:14:25.563858 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.563839 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ac241dd-d260-42d9-a231-f3a2f81b71a9" containerName="authorino" Jun 10 13:14:25.563918 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.563863 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ac241dd-d260-42d9-a231-f3a2f81b71a9" containerName="authorino" Jun 10 13:14:25.563988 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.563976 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ac241dd-d260-42d9-a231-f3a2f81b71a9" containerName="authorino" Jun 10 13:14:25.569017 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.568994 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.573853 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.573830 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 13:14:25.573985 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.573853 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 13:14:25.573985 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.573832 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-58d9f\"" Jun 10 13:14:25.573985 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.573883 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 13:14:25.578675 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.578653 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb"] Jun 10 13:14:25.703424 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.703383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83e7ff65-d878-449a-9326-5dcc3d4494cc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.703620 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.703502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.703620 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.703574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.703732 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.703650 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.703732 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.703706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmsqd\" (UniqueName: \"kubernetes.io/projected/83e7ff65-d878-449a-9326-5dcc3d4494cc-kube-api-access-mmsqd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.703823 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.703732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804233 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmsqd\" (UniqueName: \"kubernetes.io/projected/83e7ff65-d878-449a-9326-5dcc3d4494cc-kube-api-access-mmsqd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83e7ff65-d878-449a-9326-5dcc3d4494cc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804690 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.804800 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.804712 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.806608 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.806585 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83e7ff65-d878-449a-9326-5dcc3d4494cc-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.806833 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.806816 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83e7ff65-d878-449a-9326-5dcc3d4494cc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.814414 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.814355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmsqd\" (UniqueName: \"kubernetes.io/projected/83e7ff65-d878-449a-9326-5dcc3d4494cc-kube-api-access-mmsqd\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb\" (UID: \"83e7ff65-d878-449a-9326-5dcc3d4494cc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:25.881449 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:25.881426 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:14:26.028830 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:26.028804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb"] Jun 10 13:14:26.030126 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:14:26.030096 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e7ff65_d878_449a_9326_5dcc3d4494cc.slice/crio-73f664001b996bf5ed9ae4c06aafc86de84748b8d2ca79e7df3689eaebd1056f WatchSource:0}: Error finding container 73f664001b996bf5ed9ae4c06aafc86de84748b8d2ca79e7df3689eaebd1056f: Status 404 returned error can't find the container with id 73f664001b996bf5ed9ae4c06aafc86de84748b8d2ca79e7df3689eaebd1056f Jun 10 13:14:26.236411 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:26.236375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" event={"ID":"83e7ff65-d878-449a-9326-5dcc3d4494cc","Type":"ContainerStarted","Data":"73f664001b996bf5ed9ae4c06aafc86de84748b8d2ca79e7df3689eaebd1056f"} Jun 10 13:14:30.265924 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:14:30.265885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" event={"ID":"83e7ff65-d878-449a-9326-5dcc3d4494cc","Type":"ContainerStarted","Data":"c12d49318265912b0ce9b04a16f9825a95fe90a193352eeed1b9b2ead9344182"} Jun 10 13:15:00.163742 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.163709 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684955-7qkvf"] Jun 10 13:15:00.167135 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.167119 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" Jun 10 13:15:00.170184 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.170167 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9x8xm\"" Jun 10 13:15:00.180576 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.180553 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684955-7qkvf"] Jun 10 13:15:00.271819 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.271794 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt7c5\" (UniqueName: \"kubernetes.io/projected/dd07ff68-b839-4010-8ad4-f42b576faac9-kube-api-access-bt7c5\") pod \"maas-api-key-cleanup-29684955-7qkvf\" (UID: \"dd07ff68-b839-4010-8ad4-f42b576faac9\") " pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" Jun 10 13:15:00.372339 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.372313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt7c5\" (UniqueName: \"kubernetes.io/projected/dd07ff68-b839-4010-8ad4-f42b576faac9-kube-api-access-bt7c5\") pod \"maas-api-key-cleanup-29684955-7qkvf\" (UID: \"dd07ff68-b839-4010-8ad4-f42b576faac9\") " pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" Jun 10 13:15:00.384016 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.383999 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt7c5\" (UniqueName: \"kubernetes.io/projected/dd07ff68-b839-4010-8ad4-f42b576faac9-kube-api-access-bt7c5\") pod \"maas-api-key-cleanup-29684955-7qkvf\" (UID: \"dd07ff68-b839-4010-8ad4-f42b576faac9\") " pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" Jun 10 13:15:00.477234 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.477155 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" Jun 10 13:15:00.607682 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:00.607649 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684955-7qkvf"] Jun 10 13:15:00.608289 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:15:00.608248 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd07ff68_b839_4010_8ad4_f42b576faac9.slice/crio-2e8f8a665bb8f287e1f6afced7f6db71dc98790067c6a8189016770b45bee692 WatchSource:0}: Error finding container 2e8f8a665bb8f287e1f6afced7f6db71dc98790067c6a8189016770b45bee692: Status 404 returned error can't find the container with id 2e8f8a665bb8f287e1f6afced7f6db71dc98790067c6a8189016770b45bee692 Jun 10 13:15:01.436153 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:01.436117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" event={"ID":"dd07ff68-b839-4010-8ad4-f42b576faac9","Type":"ContainerStarted","Data":"2e8f8a665bb8f287e1f6afced7f6db71dc98790067c6a8189016770b45bee692"} Jun 10 13:15:03.451451 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:03.451414 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" event={"ID":"dd07ff68-b839-4010-8ad4-f42b576faac9","Type":"ContainerStarted","Data":"7204c85511e4d9d1bd062e58ba72f6f0c7693f1c7866abca6f382872a17edfc9"} Jun 10 13:15:03.469923 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:03.469874 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" podStartSLOduration=0.844996103 podStartE2EDuration="3.469860644s" totalImagesPullingTime="2.624864541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:03.4685506 +0000 UTC m=+675.879945187" watchObservedRunningTime="2026-06-10 13:15:03.469860644 +0000 UTC m=+675.881255226" Jun 10 13:15:04.457625 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:04.457532 2558 generic.go:356] "Generic (PLEG): container finished" podID="dd07ff68-b839-4010-8ad4-f42b576faac9" containerID="7204c85511e4d9d1bd062e58ba72f6f0c7693f1c7866abca6f382872a17edfc9" exitCode=0 Jun 10 13:15:04.457625 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:04.457569 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" event={"ID":"dd07ff68-b839-4010-8ad4-f42b576faac9","Type":"ContainerDied","Data":"7204c85511e4d9d1bd062e58ba72f6f0c7693f1c7866abca6f382872a17edfc9"} Jun 10 13:15:05.594082 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.594056 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" Jun 10 13:15:05.619580 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.619556 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt7c5\" (UniqueName: \"kubernetes.io/projected/dd07ff68-b839-4010-8ad4-f42b576faac9-kube-api-access-bt7c5\") pod \"dd07ff68-b839-4010-8ad4-f42b576faac9\" (UID: \"dd07ff68-b839-4010-8ad4-f42b576faac9\") " Jun 10 13:15:05.621527 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.621506 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd07ff68-b839-4010-8ad4-f42b576faac9-kube-api-access-bt7c5" (OuterVolumeSpecName: "kube-api-access-bt7c5") pod "dd07ff68-b839-4010-8ad4-f42b576faac9" (UID: "dd07ff68-b839-4010-8ad4-f42b576faac9"). InnerVolumeSpecName "kube-api-access-bt7c5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:15:05.657059 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.657032 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts"] Jun 10 13:15:05.657505 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.657487 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd07ff68-b839-4010-8ad4-f42b576faac9" containerName="cleanup" Jun 10 13:15:05.657603 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.657506 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd07ff68-b839-4010-8ad4-f42b576faac9" containerName="cleanup" Jun 10 13:15:05.662778 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.658180 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd07ff68-b839-4010-8ad4-f42b576faac9" containerName="cleanup" Jun 10 13:15:05.666487 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.666468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.669477 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.669456 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 10 13:15:05.672061 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.672037 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts"] Jun 10 13:15:05.721247 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.721178 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.721247 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.721229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.721406 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.721303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r62c7\" (UniqueName: \"kubernetes.io/projected/dbeca54b-038b-451f-8af3-23ddbd8e27f0-kube-api-access-r62c7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.721406 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.721343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.721472 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.721438 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.721472 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.721463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbeca54b-038b-451f-8af3-23ddbd8e27f0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.721583 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.721538 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt7c5\" (UniqueName: \"kubernetes.io/projected/dd07ff68-b839-4010-8ad4-f42b576faac9-kube-api-access-bt7c5\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:15:05.822560 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.822520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.822560 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.822562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbeca54b-038b-451f-8af3-23ddbd8e27f0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.822785 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.822620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.822785 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.822672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.822785 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.822700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r62c7\" (UniqueName: \"kubernetes.io/projected/dbeca54b-038b-451f-8af3-23ddbd8e27f0-kube-api-access-r62c7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.822785 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.822727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.823156 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.823127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.823294 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.823150 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.823384 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.823365 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.824996 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.824965 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dbeca54b-038b-451f-8af3-23ddbd8e27f0-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.825704 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.825679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dbeca54b-038b-451f-8af3-23ddbd8e27f0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.832961 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.832938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r62c7\" (UniqueName: \"kubernetes.io/projected/dbeca54b-038b-451f-8af3-23ddbd8e27f0-kube-api-access-r62c7\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-hv2ts\" (UID: \"dbeca54b-038b-451f-8af3-23ddbd8e27f0\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:05.977192 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:05.977124 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:15:06.120420 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:06.120392 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts"] Jun 10 13:15:06.121129 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:15:06.121104 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbeca54b_038b_451f_8af3_23ddbd8e27f0.slice/crio-cd3bbcf8aea7c459382feef9738786f2fab7525d22d157f7e8211a83eb435864 WatchSource:0}: Error finding container cd3bbcf8aea7c459382feef9738786f2fab7525d22d157f7e8211a83eb435864: Status 404 returned error can't find the container with id cd3bbcf8aea7c459382feef9738786f2fab7525d22d157f7e8211a83eb435864 Jun 10 13:15:06.470033 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:06.469976 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" Jun 10 13:15:06.470227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:06.470027 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684955-7qkvf" event={"ID":"dd07ff68-b839-4010-8ad4-f42b576faac9","Type":"ContainerDied","Data":"2e8f8a665bb8f287e1f6afced7f6db71dc98790067c6a8189016770b45bee692"} Jun 10 13:15:06.470227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:06.470080 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e8f8a665bb8f287e1f6afced7f6db71dc98790067c6a8189016770b45bee692" Jun 10 13:15:06.471682 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:06.471655 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" event={"ID":"dbeca54b-038b-451f-8af3-23ddbd8e27f0","Type":"ContainerStarted","Data":"bc41e993eb67db1b372b418c1dfadc4c84c9878ecaf3cd351d1c5de4a4138143"} Jun 10 13:15:06.471808 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:06.471694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" event={"ID":"dbeca54b-038b-451f-8af3-23ddbd8e27f0","Type":"ContainerStarted","Data":"cd3bbcf8aea7c459382feef9738786f2fab7525d22d157f7e8211a83eb435864"} Jun 10 13:15:24.569789 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:24.569753 2558 generic.go:356] "Generic (PLEG): container finished" podID="83e7ff65-d878-449a-9326-5dcc3d4494cc" containerID="c12d49318265912b0ce9b04a16f9825a95fe90a193352eeed1b9b2ead9344182" exitCode=0 Jun 10 13:15:24.570225 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:24.569810 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" event={"ID":"83e7ff65-d878-449a-9326-5dcc3d4494cc","Type":"ContainerDied","Data":"c12d49318265912b0ce9b04a16f9825a95fe90a193352eeed1b9b2ead9344182"} Jun 10 13:15:26.581618 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:26.581579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" event={"ID":"83e7ff65-d878-449a-9326-5dcc3d4494cc","Type":"ContainerStarted","Data":"2793d9b49884f516879fe30e37901eec164bfb14a33ff302fe97e47fac659d83"} Jun 10 13:15:26.602461 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:26.602420 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" podStartSLOduration=2.242524346 podStartE2EDuration="1m1.602405876s" totalImagesPullingTime="5.040093755s" totalInitContainerRuntime="54.319787775s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:14:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:26.601499773 +0000 UTC m=+699.012894357" watchObservedRunningTime="2026-06-10 13:15:26.602405876 +0000 UTC m=+699.013800459" Jun 10 13:15:35.881964 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:35.881886 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:15:35.882437 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:35.882037 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:15:35.898736 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:35.898717 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:15:36.646824 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:36.646795 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb" Jun 10 13:15:57.750274 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:57.750230 2558 generic.go:356] "Generic (PLEG): container finished" podID="dbeca54b-038b-451f-8af3-23ddbd8e27f0" containerID="bc41e993eb67db1b372b418c1dfadc4c84c9878ecaf3cd351d1c5de4a4138143" exitCode=0 Jun 10 13:15:57.750608 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:57.750306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" event={"ID":"dbeca54b-038b-451f-8af3-23ddbd8e27f0","Type":"ContainerDied","Data":"bc41e993eb67db1b372b418c1dfadc4c84c9878ecaf3cd351d1c5de4a4138143"} Jun 10 13:15:58.757737 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:58.757706 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" event={"ID":"dbeca54b-038b-451f-8af3-23ddbd8e27f0","Type":"ContainerStarted","Data":"f027e043f88d8b9468a895a86443f1eec4d549b5bab9659ce5f2894f287319e5"} Jun 10 13:15:58.782356 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:15:58.782306 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" podStartSLOduration=2.050650944 podStartE2EDuration="53.782290302s" totalImagesPullingTime="277.463851ms" totalInitContainerRuntime="51.454175507s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:15:58.779413159 +0000 UTC m=+731.190807734" watchObservedRunningTime="2026-06-10 13:15:58.782290302 +0000 UTC m=+731.193684930" Jun 10 13:16:05.977349 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:05.977321 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:16:05.977761 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:05.977362 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:16:05.989964 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:05.989943 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:16:06.814005 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:06.813979 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-hv2ts" Jun 10 13:16:40.494460 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.494429 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ddfc4698d-tcfnk"] Jun 10 13:16:40.497936 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.497915 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.506328 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.506303 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ddfc4698d-tcfnk"] Jun 10 13:16:40.596505 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.596470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-tls-cert\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.596660 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.596529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9jc6\" (UniqueName: \"kubernetes.io/projected/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-kube-api-access-l9jc6\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.596660 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.596604 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-oidc-ca\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.697602 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.697570 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-tls-cert\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.697760 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.697625 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9jc6\" (UniqueName: \"kubernetes.io/projected/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-kube-api-access-l9jc6\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.697760 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.697658 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-oidc-ca\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.698201 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.698180 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-oidc-ca\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.699982 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.699959 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-tls-cert\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.710192 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.710166 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9jc6\" (UniqueName: \"kubernetes.io/projected/b5db2df5-fc5b-42bd-ad07-01c0e4365fae-kube-api-access-l9jc6\") pod \"authorino-7ddfc4698d-tcfnk\" (UID: \"b5db2df5-fc5b-42bd-ad07-01c0e4365fae\") " pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.808378 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.808295 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" Jun 10 13:16:40.951912 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:40.951878 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ddfc4698d-tcfnk"] Jun 10 13:16:40.952045 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:16:40.952018 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5db2df5_fc5b_42bd_ad07_01c0e4365fae.slice/crio-fabedf6be0f3e59f2e8f177c109442a1231f88e4fc3051fdcf6033a87292f659 WatchSource:0}: Error finding container fabedf6be0f3e59f2e8f177c109442a1231f88e4fc3051fdcf6033a87292f659: Status 404 returned error can't find the container with id fabedf6be0f3e59f2e8f177c109442a1231f88e4fc3051fdcf6033a87292f659 Jun 10 13:16:41.009627 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:41.009592 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" event={"ID":"b5db2df5-fc5b-42bd-ad07-01c0e4365fae","Type":"ContainerStarted","Data":"fabedf6be0f3e59f2e8f177c109442a1231f88e4fc3051fdcf6033a87292f659"} Jun 10 13:16:42.017969 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.017921 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" event={"ID":"b5db2df5-fc5b-42bd-ad07-01c0e4365fae","Type":"ContainerStarted","Data":"de2311424684c30aa657650843cf5f7f90f997694379a4aa7f8547664a5b7d9c"} Jun 10 13:16:42.151993 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.151941 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ddfc4698d-tcfnk" podStartSLOduration=1.685833167 podStartE2EDuration="2.151923601s" totalImagesPullingTime="466.090434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:16:42.146527191 +0000 UTC m=+774.557921775" watchObservedRunningTime="2026-06-10 13:16:42.151923601 +0000 UTC m=+774.563318191" Jun 10 13:16:42.270585 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.270491 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-567856c6c7-2w8rs"] Jun 10 13:16:42.270758 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.270690 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-567856c6c7-2w8rs" podUID="0031f4e5-8089-40e7-b559-a5409f14c925" containerName="authorino" containerID="cri-o://699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66" gracePeriod=30 Jun 10 13:16:42.545809 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.545779 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:16:42.616719 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.616677 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0031f4e5-8089-40e7-b559-a5409f14c925-tls-cert\") pod \"0031f4e5-8089-40e7-b559-a5409f14c925\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " Jun 10 13:16:42.616891 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.616823 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0031f4e5-8089-40e7-b559-a5409f14c925-oidc-ca\") pod \"0031f4e5-8089-40e7-b559-a5409f14c925\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " Jun 10 13:16:42.616972 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.616891 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8vqq\" (UniqueName: \"kubernetes.io/projected/0031f4e5-8089-40e7-b559-a5409f14c925-kube-api-access-t8vqq\") pod \"0031f4e5-8089-40e7-b559-a5409f14c925\" (UID: \"0031f4e5-8089-40e7-b559-a5409f14c925\") " Jun 10 13:16:42.619685 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.619616 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0031f4e5-8089-40e7-b559-a5409f14c925-kube-api-access-t8vqq" (OuterVolumeSpecName: "kube-api-access-t8vqq") pod "0031f4e5-8089-40e7-b559-a5409f14c925" (UID: "0031f4e5-8089-40e7-b559-a5409f14c925"). InnerVolumeSpecName "kube-api-access-t8vqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:16:42.623721 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.623690 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0031f4e5-8089-40e7-b559-a5409f14c925-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "0031f4e5-8089-40e7-b559-a5409f14c925" (UID: "0031f4e5-8089-40e7-b559-a5409f14c925"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:16:42.631657 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.631628 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0031f4e5-8089-40e7-b559-a5409f14c925-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0031f4e5-8089-40e7-b559-a5409f14c925" (UID: "0031f4e5-8089-40e7-b559-a5409f14c925"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:16:42.718333 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.718298 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8vqq\" (UniqueName: \"kubernetes.io/projected/0031f4e5-8089-40e7-b559-a5409f14c925-kube-api-access-t8vqq\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:16:42.718333 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.718328 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0031f4e5-8089-40e7-b559-a5409f14c925-tls-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:16:42.718333 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:42.718339 2558 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0031f4e5-8089-40e7-b559-a5409f14c925-oidc-ca\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:16:43.025391 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.025352 2558 generic.go:356] "Generic (PLEG): container finished" podID="0031f4e5-8089-40e7-b559-a5409f14c925" containerID="699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66" exitCode=0 Jun 10 13:16:43.025391 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.025394 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-567856c6c7-2w8rs" Jun 10 13:16:43.025926 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.025438 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-567856c6c7-2w8rs" event={"ID":"0031f4e5-8089-40e7-b559-a5409f14c925","Type":"ContainerDied","Data":"699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66"} Jun 10 13:16:43.025926 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.025480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-567856c6c7-2w8rs" event={"ID":"0031f4e5-8089-40e7-b559-a5409f14c925","Type":"ContainerDied","Data":"288869cdc666ed1ce69f0376f6775b491a643243bf8c4297a452231bb17284c1"} Jun 10 13:16:43.025926 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.025501 2558 scope.go:117] "RemoveContainer" containerID="699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66" Jun 10 13:16:43.035233 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.035218 2558 scope.go:117] "RemoveContainer" containerID="699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66" Jun 10 13:16:43.035485 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:16:43.035465 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66\": container with ID starting with 699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66 not found: ID does not exist" containerID="699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66" Jun 10 13:16:43.035563 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.035496 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66"} err="failed to get container status \"699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66\": rpc error: code = NotFound desc = could not find container \"699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66\": container with ID starting with 699a0e5e0b93cd5825e28410a9f38b177984821f2042723ec137678d5a4abd66 not found: ID does not exist" Jun 10 13:16:43.051532 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.051511 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-567856c6c7-2w8rs"] Jun 10 13:16:43.062687 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.062667 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-567856c6c7-2w8rs"] Jun 10 13:16:43.989146 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:16:43.989112 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0031f4e5-8089-40e7-b559-a5409f14c925" path="/var/lib/kubelet/pods/0031f4e5-8089-40e7-b559-a5409f14c925/volumes" Jun 10 13:18:21.095153 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.095119 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-566cd7474-kpfks"] Jun 10 13:18:21.097549 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.095339 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-566cd7474-kpfks" podUID="ca08198a-9cb6-4a45-a5c5-952108364a9f" containerName="manager" containerID="cri-o://3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0" gracePeriod=30 Jun 10 13:18:21.344443 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.344416 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:18:21.439443 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.439345 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sph6n\" (UniqueName: \"kubernetes.io/projected/ca08198a-9cb6-4a45-a5c5-952108364a9f-kube-api-access-sph6n\") pod \"ca08198a-9cb6-4a45-a5c5-952108364a9f\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " Jun 10 13:18:21.439443 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.439401 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca08198a-9cb6-4a45-a5c5-952108364a9f-webhook-cert\") pod \"ca08198a-9cb6-4a45-a5c5-952108364a9f\" (UID: \"ca08198a-9cb6-4a45-a5c5-952108364a9f\") " Jun 10 13:18:21.441242 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.441215 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca08198a-9cb6-4a45-a5c5-952108364a9f-kube-api-access-sph6n" (OuterVolumeSpecName: "kube-api-access-sph6n") pod "ca08198a-9cb6-4a45-a5c5-952108364a9f" (UID: "ca08198a-9cb6-4a45-a5c5-952108364a9f"). InnerVolumeSpecName "kube-api-access-sph6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:18:21.441368 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.441286 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca08198a-9cb6-4a45-a5c5-952108364a9f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ca08198a-9cb6-4a45-a5c5-952108364a9f" (UID: "ca08198a-9cb6-4a45-a5c5-952108364a9f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:18:21.540285 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.540239 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sph6n\" (UniqueName: \"kubernetes.io/projected/ca08198a-9cb6-4a45-a5c5-952108364a9f-kube-api-access-sph6n\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:18:21.540285 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.540283 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca08198a-9cb6-4a45-a5c5-952108364a9f-webhook-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:18:21.566028 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.566000 2558 generic.go:356] "Generic (PLEG): container finished" podID="ca08198a-9cb6-4a45-a5c5-952108364a9f" containerID="3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0" exitCode=0 Jun 10 13:18:21.566139 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.566043 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566cd7474-kpfks" Jun 10 13:18:21.566139 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.566085 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566cd7474-kpfks" event={"ID":"ca08198a-9cb6-4a45-a5c5-952108364a9f","Type":"ContainerDied","Data":"3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0"} Jun 10 13:18:21.566215 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.566139 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566cd7474-kpfks" event={"ID":"ca08198a-9cb6-4a45-a5c5-952108364a9f","Type":"ContainerDied","Data":"9ee7edc4011c9edcb99232655d4278e4e4305d241765e7509f40aaebb6a5c4d0"} Jun 10 13:18:21.566215 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.566167 2558 scope.go:117] "RemoveContainer" containerID="3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0" Jun 10 13:18:21.575145 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.575129 2558 scope.go:117] "RemoveContainer" containerID="3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0" Jun 10 13:18:21.575426 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:18:21.575408 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0\": container with ID starting with 3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0 not found: ID does not exist" containerID="3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0" Jun 10 13:18:21.575510 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.575437 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0"} err="failed to get container status \"3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0\": rpc error: code = NotFound desc = could not find container \"3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0\": container with ID starting with 3d15964eec460ed17a4cbf480d00041c8bc3f6db93ef781680c9ec75c09b10b0 not found: ID does not exist" Jun 10 13:18:21.594531 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.594508 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-566cd7474-kpfks"] Jun 10 13:18:21.599915 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.599892 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-566cd7474-kpfks"] Jun 10 13:18:21.985130 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:21.985104 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca08198a-9cb6-4a45-a5c5-952108364a9f" path="/var/lib/kubelet/pods/ca08198a-9cb6-4a45-a5c5-952108364a9f/volumes" Jun 10 13:18:22.449790 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.449713 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-566cd7474-qmnxk"] Jun 10 13:18:22.450124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.450077 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0031f4e5-8089-40e7-b559-a5409f14c925" containerName="authorino" Jun 10 13:18:22.450124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.450088 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0031f4e5-8089-40e7-b559-a5409f14c925" containerName="authorino" Jun 10 13:18:22.450124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.450104 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca08198a-9cb6-4a45-a5c5-952108364a9f" containerName="manager" Jun 10 13:18:22.450124 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.450110 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca08198a-9cb6-4a45-a5c5-952108364a9f" containerName="manager" Jun 10 13:18:22.450260 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.450171 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0031f4e5-8089-40e7-b559-a5409f14c925" containerName="authorino" Jun 10 13:18:22.450260 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.450184 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca08198a-9cb6-4a45-a5c5-952108364a9f" containerName="manager" Jun 10 13:18:22.454555 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.454540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.458925 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.458906 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 13:18:22.459039 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.458908 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 13:18:22.459039 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.458908 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nvpxs\"" Jun 10 13:18:22.465535 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.465502 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-566cd7474-qmnxk"] Jun 10 13:18:22.548561 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.548533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5facdcaa-9e73-4695-a994-5f3eecb2a398-webhook-cert\") pod \"maas-controller-566cd7474-qmnxk\" (UID: \"5facdcaa-9e73-4695-a994-5f3eecb2a398\") " pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.548700 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.548570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n28x\" (UniqueName: \"kubernetes.io/projected/5facdcaa-9e73-4695-a994-5f3eecb2a398-kube-api-access-8n28x\") pod \"maas-controller-566cd7474-qmnxk\" (UID: \"5facdcaa-9e73-4695-a994-5f3eecb2a398\") " pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.649160 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.649129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5facdcaa-9e73-4695-a994-5f3eecb2a398-webhook-cert\") pod \"maas-controller-566cd7474-qmnxk\" (UID: \"5facdcaa-9e73-4695-a994-5f3eecb2a398\") " pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.649322 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.649168 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n28x\" (UniqueName: \"kubernetes.io/projected/5facdcaa-9e73-4695-a994-5f3eecb2a398-kube-api-access-8n28x\") pod \"maas-controller-566cd7474-qmnxk\" (UID: \"5facdcaa-9e73-4695-a994-5f3eecb2a398\") " pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.651607 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.651587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5facdcaa-9e73-4695-a994-5f3eecb2a398-webhook-cert\") pod \"maas-controller-566cd7474-qmnxk\" (UID: \"5facdcaa-9e73-4695-a994-5f3eecb2a398\") " pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.661875 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.661849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n28x\" (UniqueName: \"kubernetes.io/projected/5facdcaa-9e73-4695-a994-5f3eecb2a398-kube-api-access-8n28x\") pod \"maas-controller-566cd7474-qmnxk\" (UID: \"5facdcaa-9e73-4695-a994-5f3eecb2a398\") " pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.764465 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.764441 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:22.913163 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:22.913140 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-566cd7474-qmnxk"] Jun 10 13:18:22.915702 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:18:22.915676 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5facdcaa_9e73_4695_a994_5f3eecb2a398.slice/crio-d393b6a2f404959f894dbde013d80257e9e187f7ab52d21067b2cb5f23c18224 WatchSource:0}: Error finding container d393b6a2f404959f894dbde013d80257e9e187f7ab52d21067b2cb5f23c18224: Status 404 returned error can't find the container with id d393b6a2f404959f894dbde013d80257e9e187f7ab52d21067b2cb5f23c18224 Jun 10 13:18:23.578251 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:23.578155 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566cd7474-qmnxk" event={"ID":"5facdcaa-9e73-4695-a994-5f3eecb2a398","Type":"ContainerStarted","Data":"60cb533876f508ad03c6e7489faf5b32d2e9e106119ecbed00e3448ff9149cc5"} Jun 10 13:18:23.578251 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:23.578213 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:18:23.578251 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:23.578229 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-566cd7474-qmnxk" event={"ID":"5facdcaa-9e73-4695-a994-5f3eecb2a398","Type":"ContainerStarted","Data":"d393b6a2f404959f894dbde013d80257e9e187f7ab52d21067b2cb5f23c18224"} Jun 10 13:18:23.609928 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:23.609886 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-566cd7474-qmnxk" podStartSLOduration=1.228006378 podStartE2EDuration="1.609871909s" totalImagesPullingTime="381.865531ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:18:23.60857611 +0000 UTC m=+876.019970695" watchObservedRunningTime="2026-06-10 13:18:23.609871909 +0000 UTC m=+876.021266491" Jun 10 13:18:34.589958 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:18:34.589927 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-566cd7474-qmnxk" Jun 10 13:28:34.638122 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.638091 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94"] Jun 10 13:28:34.638663 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.638256 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" podUID="c3218de4-9b3c-42c3-ae82-9e64ce6950a2" containerName="manager" containerID="cri-o://48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad" gracePeriod=10 Jun 10 13:28:34.893094 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.893040 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:28:34.989306 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.989249 2558 generic.go:356] "Generic (PLEG): container finished" podID="c3218de4-9b3c-42c3-ae82-9e64ce6950a2" containerID="48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad" exitCode=0 Jun 10 13:28:34.989474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.989313 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" Jun 10 13:28:34.989474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.989335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" event={"ID":"c3218de4-9b3c-42c3-ae82-9e64ce6950a2","Type":"ContainerDied","Data":"48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad"} Jun 10 13:28:34.989474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.989382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94" event={"ID":"c3218de4-9b3c-42c3-ae82-9e64ce6950a2","Type":"ContainerDied","Data":"ce65b006790ac10d78000ce9fcf6f8b1420ef20bcea6caa7beb4b62fc0d48140"} Jun 10 13:28:34.989474 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.989405 2558 scope.go:117] "RemoveContainer" containerID="48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad" Jun 10 13:28:34.998973 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.998953 2558 scope.go:117] "RemoveContainer" containerID="48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad" Jun 10 13:28:34.999200 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:28:34.999181 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad\": container with ID starting with 48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad not found: ID does not exist" containerID="48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad" Jun 10 13:28:34.999292 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:34.999211 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad"} err="failed to get container status \"48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad\": rpc error: code = NotFound desc = could not find container \"48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad\": container with ID starting with 48461099c01985544ef60a6020eea961f2e0b3d25ef152fb3eb2e92f2e45fdad not found: ID does not exist" Jun 10 13:28:35.012369 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.012346 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr8g8\" (UniqueName: \"kubernetes.io/projected/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-kube-api-access-pr8g8\") pod \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " Jun 10 13:28:35.012465 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.012436 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-extensions-socket-volume\") pod \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\" (UID: \"c3218de4-9b3c-42c3-ae82-9e64ce6950a2\") " Jun 10 13:28:35.012784 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.012765 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c3218de4-9b3c-42c3-ae82-9e64ce6950a2" (UID: "c3218de4-9b3c-42c3-ae82-9e64ce6950a2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 13:28:35.023624 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.023602 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-kube-api-access-pr8g8" (OuterVolumeSpecName: "kube-api-access-pr8g8") pod "c3218de4-9b3c-42c3-ae82-9e64ce6950a2" (UID: "c3218de4-9b3c-42c3-ae82-9e64ce6950a2"). InnerVolumeSpecName "kube-api-access-pr8g8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:28:35.113585 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.113560 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr8g8\" (UniqueName: \"kubernetes.io/projected/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-kube-api-access-pr8g8\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:28:35.113585 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.113581 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3218de4-9b3c-42c3-ae82-9e64ce6950a2-extensions-socket-volume\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:28:35.323779 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.323754 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94"] Jun 10 13:28:35.332433 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.332411 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jtg94"] Jun 10 13:28:35.984282 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:28:35.984245 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3218de4-9b3c-42c3-ae82-9e64ce6950a2" path="/var/lib/kubelet/pods/c3218de4-9b3c-42c3-ae82-9e64ce6950a2/volumes" Jun 10 13:29:40.896523 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.896492 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m"] Jun 10 13:29:40.898879 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.896841 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3218de4-9b3c-42c3-ae82-9e64ce6950a2" containerName="manager" Jun 10 13:29:40.898879 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.896852 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3218de4-9b3c-42c3-ae82-9e64ce6950a2" containerName="manager" Jun 10 13:29:40.898879 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.896926 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3218de4-9b3c-42c3-ae82-9e64ce6950a2" containerName="manager" Jun 10 13:29:40.899919 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.899904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:40.903726 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.903705 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5b5d2\"" Jun 10 13:29:40.917585 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.917563 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m"] Jun 10 13:29:40.952030 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.952005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xv2w\" (UniqueName: \"kubernetes.io/projected/bcbf36bd-458b-44f1-a8e3-4c3749a9dffe-kube-api-access-4xv2w\") pod \"kuadrant-operator-controller-manager-86878c769f-2lh7m\" (UID: \"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:40.952128 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:40.952064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcbf36bd-458b-44f1-a8e3-4c3749a9dffe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2lh7m\" (UID: \"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:41.052502 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:41.052479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xv2w\" (UniqueName: \"kubernetes.io/projected/bcbf36bd-458b-44f1-a8e3-4c3749a9dffe-kube-api-access-4xv2w\") pod \"kuadrant-operator-controller-manager-86878c769f-2lh7m\" (UID: \"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:41.052607 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:41.052541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcbf36bd-458b-44f1-a8e3-4c3749a9dffe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2lh7m\" (UID: \"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:41.052856 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:41.052840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcbf36bd-458b-44f1-a8e3-4c3749a9dffe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2lh7m\" (UID: \"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:41.065480 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:41.065455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xv2w\" (UniqueName: \"kubernetes.io/projected/bcbf36bd-458b-44f1-a8e3-4c3749a9dffe-kube-api-access-4xv2w\") pod \"kuadrant-operator-controller-manager-86878c769f-2lh7m\" (UID: \"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:41.209865 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:41.209794 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:41.371706 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:41.371679 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m"] Jun 10 13:29:41.373955 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:29:41.373926 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcbf36bd_458b_44f1_a8e3_4c3749a9dffe.slice/crio-8d1bce2c484cbf0fb9f7937f267568be4c4507b66c34d71667abab421f9fcd5d WatchSource:0}: Error finding container 8d1bce2c484cbf0fb9f7937f267568be4c4507b66c34d71667abab421f9fcd5d: Status 404 returned error can't find the container with id 8d1bce2c484cbf0fb9f7937f267568be4c4507b66c34d71667abab421f9fcd5d Jun 10 13:29:42.361318 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:42.361260 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" event={"ID":"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe","Type":"ContainerStarted","Data":"507af3ab074e4687d283945ab53cc132585e16a6c45dfafdf34d2ca712ab0c10"} Jun 10 13:29:42.361712 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:42.361335 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" event={"ID":"bcbf36bd-458b-44f1-a8e3-4c3749a9dffe","Type":"ContainerStarted","Data":"8d1bce2c484cbf0fb9f7937f267568be4c4507b66c34d71667abab421f9fcd5d"} Jun 10 13:29:42.361712 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:42.361404 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:29:42.398291 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:42.398233 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" podStartSLOduration=2.398217083 podStartE2EDuration="2.398217083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:29:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:29:42.39109649 +0000 UTC m=+1554.802491074" watchObservedRunningTime="2026-06-10 13:29:42.398217083 +0000 UTC m=+1554.809611665" Jun 10 13:29:53.368501 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:29:53.368472 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2lh7m" Jun 10 13:31:04.544398 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.544363 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8d6697fdf-9jf56"] Jun 10 13:31:04.549808 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.549779 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.573151 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.573117 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d6697fdf-9jf56"] Jun 10 13:31:04.653326 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.653299 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48b2093-7056-42f6-a392-0ec3a765f4de-console-serving-cert\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.653452 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.653332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gsrt\" (UniqueName: \"kubernetes.io/projected/c48b2093-7056-42f6-a392-0ec3a765f4de-kube-api-access-2gsrt\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.653452 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.653376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-trusted-ca-bundle\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.653452 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.653407 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-oauth-serving-cert\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.653569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.653487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48b2093-7056-42f6-a392-0ec3a765f4de-console-oauth-config\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.653569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.653508 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-service-ca\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.653569 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.653538 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-console-config\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.753975 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.753947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-console-config\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754088 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.753984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48b2093-7056-42f6-a392-0ec3a765f4de-console-serving-cert\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754088 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.754005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gsrt\" (UniqueName: \"kubernetes.io/projected/c48b2093-7056-42f6-a392-0ec3a765f4de-kube-api-access-2gsrt\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.754130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-trusted-ca-bundle\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754213 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.754185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-oauth-serving-cert\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754292 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.754253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48b2093-7056-42f6-a392-0ec3a765f4de-console-oauth-config\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754365 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.754301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-service-ca\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.754685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-console-config\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.754878 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.754858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-oauth-serving-cert\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.755043 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.755020 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-service-ca\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.755101 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.755022 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c48b2093-7056-42f6-a392-0ec3a765f4de-trusted-ca-bundle\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.756530 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.756507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c48b2093-7056-42f6-a392-0ec3a765f4de-console-oauth-config\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.756614 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.756596 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c48b2093-7056-42f6-a392-0ec3a765f4de-console-serving-cert\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.766891 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.766870 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gsrt\" (UniqueName: \"kubernetes.io/projected/c48b2093-7056-42f6-a392-0ec3a765f4de-kube-api-access-2gsrt\") pod \"console-8d6697fdf-9jf56\" (UID: \"c48b2093-7056-42f6-a392-0ec3a765f4de\") " pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.859025 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.858964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:04.995183 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:04.995157 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8d6697fdf-9jf56"] Jun 10 13:31:04.996374 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:31:04.996346 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48b2093_7056_42f6_a392_0ec3a765f4de.slice/crio-709bf4b698cdf4960e0e3f15b6b6415ae707159a2effccb2c711b13d1ea4ffc2 WatchSource:0}: Error finding container 709bf4b698cdf4960e0e3f15b6b6415ae707159a2effccb2c711b13d1ea4ffc2: Status 404 returned error can't find the container with id 709bf4b698cdf4960e0e3f15b6b6415ae707159a2effccb2c711b13d1ea4ffc2 Jun 10 13:31:05.823774 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:05.823739 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d6697fdf-9jf56" event={"ID":"c48b2093-7056-42f6-a392-0ec3a765f4de","Type":"ContainerStarted","Data":"2ca5cfaf68555e5937de37555d3cd650e1bc7f3f0075b108908ad8714206236d"} Jun 10 13:31:05.824231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:05.823798 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8d6697fdf-9jf56" event={"ID":"c48b2093-7056-42f6-a392-0ec3a765f4de","Type":"ContainerStarted","Data":"709bf4b698cdf4960e0e3f15b6b6415ae707159a2effccb2c711b13d1ea4ffc2"} Jun 10 13:31:05.847899 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:05.847810 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8d6697fdf-9jf56" podStartSLOduration=1.847794268 podStartE2EDuration="1.847794268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 13:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:31:05.845540041 +0000 UTC m=+1638.256934624" watchObservedRunningTime="2026-06-10 13:31:05.847794268 +0000 UTC m=+1638.259188850" Jun 10 13:31:14.859304 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:14.859244 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:14.859655 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:14.859335 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:14.864013 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:14.863994 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:14.879897 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:14.879878 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8d6697fdf-9jf56" Jun 10 13:31:14.957227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:14.957202 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ccbb68ccb-bspvz"] Jun 10 13:31:39.977314 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:39.977242 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7ccbb68ccb-bspvz" podUID="44b73609-3329-420d-b2c4-ac9c182421ee" containerName="console" containerID="cri-o://3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d" gracePeriod=15 Jun 10 13:31:40.228075 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.228015 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:31:40.369847 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.369817 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-console-config\") pod \"44b73609-3329-420d-b2c4-ac9c182421ee\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " Jun 10 13:31:40.370001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.369895 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-oauth-config\") pod \"44b73609-3329-420d-b2c4-ac9c182421ee\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " Jun 10 13:31:40.370001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.369919 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-service-ca\") pod \"44b73609-3329-420d-b2c4-ac9c182421ee\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " Jun 10 13:31:40.370001 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.369956 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-oauth-serving-cert\") pod \"44b73609-3329-420d-b2c4-ac9c182421ee\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " Jun 10 13:31:40.370128 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370105 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-serving-cert\") pod \"44b73609-3329-420d-b2c4-ac9c182421ee\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " Jun 10 13:31:40.370164 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370148 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrbg2\" (UniqueName: \"kubernetes.io/projected/44b73609-3329-420d-b2c4-ac9c182421ee-kube-api-access-zrbg2\") pod \"44b73609-3329-420d-b2c4-ac9c182421ee\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " Jun 10 13:31:40.370210 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370184 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-trusted-ca-bundle\") pod \"44b73609-3329-420d-b2c4-ac9c182421ee\" (UID: \"44b73609-3329-420d-b2c4-ac9c182421ee\") " Jun 10 13:31:40.370281 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370248 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-console-config" (OuterVolumeSpecName: "console-config") pod "44b73609-3329-420d-b2c4-ac9c182421ee" (UID: "44b73609-3329-420d-b2c4-ac9c182421ee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:31:40.370386 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370353 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "44b73609-3329-420d-b2c4-ac9c182421ee" (UID: "44b73609-3329-420d-b2c4-ac9c182421ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:31:40.370455 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370361 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44b73609-3329-420d-b2c4-ac9c182421ee" (UID: "44b73609-3329-420d-b2c4-ac9c182421ee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:31:40.370657 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370636 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "44b73609-3329-420d-b2c4-ac9c182421ee" (UID: "44b73609-3329-420d-b2c4-ac9c182421ee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 13:31:40.370754 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370661 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-oauth-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:31:40.370754 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370682 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-console-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:31:40.370754 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.370696 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-service-ca\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:31:40.372162 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.372142 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44b73609-3329-420d-b2c4-ac9c182421ee" (UID: "44b73609-3329-420d-b2c4-ac9c182421ee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:31:40.372253 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.372163 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44b73609-3329-420d-b2c4-ac9c182421ee" (UID: "44b73609-3329-420d-b2c4-ac9c182421ee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 13:31:40.372253 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.372183 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b73609-3329-420d-b2c4-ac9c182421ee-kube-api-access-zrbg2" (OuterVolumeSpecName: "kube-api-access-zrbg2") pod "44b73609-3329-420d-b2c4-ac9c182421ee" (UID: "44b73609-3329-420d-b2c4-ac9c182421ee"). InnerVolumeSpecName "kube-api-access-zrbg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 13:31:40.471037 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.471003 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-serving-cert\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:31:40.471037 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.471036 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrbg2\" (UniqueName: \"kubernetes.io/projected/44b73609-3329-420d-b2c4-ac9c182421ee-kube-api-access-zrbg2\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:31:40.471037 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.471046 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44b73609-3329-420d-b2c4-ac9c182421ee-trusted-ca-bundle\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:31:40.471223 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:40.471056 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44b73609-3329-420d-b2c4-ac9c182421ee-console-oauth-config\") on node \"ip-10-0-138-87.ec2.internal\" DevicePath \"\"" Jun 10 13:31:41.029422 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.029389 2558 generic.go:356] "Generic (PLEG): container finished" podID="44b73609-3329-420d-b2c4-ac9c182421ee" containerID="3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d" exitCode=0 Jun 10 13:31:41.029881 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.029435 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ccbb68ccb-bspvz" Jun 10 13:31:41.029881 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.029479 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbb68ccb-bspvz" event={"ID":"44b73609-3329-420d-b2c4-ac9c182421ee","Type":"ContainerDied","Data":"3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d"} Jun 10 13:31:41.029881 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.029537 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ccbb68ccb-bspvz" event={"ID":"44b73609-3329-420d-b2c4-ac9c182421ee","Type":"ContainerDied","Data":"a2de17ef18e3913c0d8ef7536089ee5e71de9080b03e89acd5e1faa5a1391c5e"} Jun 10 13:31:41.029881 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.029568 2558 scope.go:117] "RemoveContainer" containerID="3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d" Jun 10 13:31:41.039639 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.039623 2558 scope.go:117] "RemoveContainer" containerID="3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d" Jun 10 13:31:41.039882 ip-10-0-138-87 kubenswrapper[2558]: E0610 13:31:41.039864 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d\": container with ID starting with 3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d not found: ID does not exist" containerID="3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d" Jun 10 13:31:41.039931 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.039890 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d"} err="failed to get container status \"3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d\": rpc error: code = NotFound desc = could not find container \"3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d\": container with ID starting with 3ac6e4ef7e30afea3311f65c92c8d6cfdc11d0d84cf42a391b51e81184473a8d not found: ID does not exist" Jun 10 13:31:41.056870 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.056847 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ccbb68ccb-bspvz"] Jun 10 13:31:41.062828 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.062807 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ccbb68ccb-bspvz"] Jun 10 13:31:41.984418 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:31:41.984385 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b73609-3329-420d-b2c4-ac9c182421ee" path="/var/lib/kubelet/pods/44b73609-3329-420d-b2c4-ac9c182421ee/volumes" Jun 10 13:35:40.743884 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:40.743854 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ddfc4698d-tcfnk_b5db2df5-fc5b-42bd-ad07-01c0e4365fae/authorino/0.log" Jun 10 13:35:45.669109 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:45.669081 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-85c8dc5456-cklk6_d50e1d95-5024-47c3-9dc2-1906f8a241e3/nginx/0.log" Jun 10 13:35:46.074549 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:46.074523 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-cgclv_ed2a5742-c878-4052-98da-e8d44861caac/manager/0.log" Jun 10 13:35:46.363753 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:46.363681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684955-7qkvf_dd07ff68-b839-4010-8ad4-f42b576faac9/cleanup/0.log" Jun 10 13:35:46.619812 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:46.619731 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-566cd7474-qmnxk_5facdcaa-9e73-4695-a994-5f3eecb2a398/manager/0.log" Jun 10 13:35:47.299979 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:47.299955 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-tqvz2_9f672853-25a9-4e0e-8b0d-0b95a3c68d49/copy-manifests/0.log" Jun 10 13:35:47.310664 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:47.310643 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-tqvz2_9f672853-25a9-4e0e-8b0d-0b95a3c68d49/manager/0.log" Jun 10 13:35:48.260057 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.260031 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv_6866e96b-59ff-49c3-ae6e-56529829541d/util/0.log" Jun 10 13:35:48.268331 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.268308 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv_6866e96b-59ff-49c3-ae6e-56529829541d/pull/0.log" Jun 10 13:35:48.275492 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.275475 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv_6866e96b-59ff-49c3-ae6e-56529829541d/extract/0.log" Jun 10 13:35:48.397016 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.396995 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk_39b389c0-4c5d-4c69-9c64-9a419067bf06/util/0.log" Jun 10 13:35:48.404607 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.404591 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk_39b389c0-4c5d-4c69-9c64-9a419067bf06/pull/0.log" Jun 10 13:35:48.412018 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.411999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk_39b389c0-4c5d-4c69-9c64-9a419067bf06/extract/0.log" Jun 10 13:35:48.531762 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.531701 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv_ac1d6c58-c532-424e-82eb-5d420d8d626e/util/0.log" Jun 10 13:35:48.541028 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.541008 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv_ac1d6c58-c532-424e-82eb-5d420d8d626e/pull/0.log" Jun 10 13:35:48.554652 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.554631 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv_ac1d6c58-c532-424e-82eb-5d420d8d626e/extract/0.log" Jun 10 13:35:48.676886 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.676864 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2_5f8f1993-a627-456e-b0be-5343ae0fa776/util/0.log" Jun 10 13:35:48.684766 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.684742 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2_5f8f1993-a627-456e-b0be-5343ae0fa776/pull/0.log" Jun 10 13:35:48.692822 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.692804 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2_5f8f1993-a627-456e-b0be-5343ae0fa776/extract/0.log" Jun 10 13:35:48.818294 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:48.818226 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ddfc4698d-tcfnk_b5db2df5-fc5b-42bd-ad07-01c0e4365fae/authorino/0.log" Jun 10 13:35:49.308627 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:49.308598 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2n9bp_b275a4a6-d547-4026-8aeb-c93c3e2c0db4/registry-server/0.log" Jun 10 13:35:49.444409 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:49.444381 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2lh7m_bcbf36bd-458b-44f1-a8e3-4c3749a9dffe/manager/0.log" Jun 10 13:35:49.714323 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:49.714233 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d54db_7a10699d-eed8-40dd-9723-6f1be9979c6c/manager/0.log" Jun 10 13:35:50.095104 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:50.095068 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjgp5l_33392bfe-e8be-4409-a2ab-d3178ddf10ca/istio-proxy/0.log" Jun 10 13:35:50.590524 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:50.590495 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/1.log" Jun 10 13:35:50.844929 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:50.844854 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-n499w_8ba5994d-310c-4630-b132-1f8d3a951f32/payload-processing/0.log" Jun 10 13:35:51.607709 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:51.607685 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb_83e7ff65-d878-449a-9326-5dcc3d4494cc/storage-initializer/0.log" Jun 10 13:35:51.615634 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:51.615612 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-7drqb_83e7ff65-d878-449a-9326-5dcc3d4494cc/main/0.log" Jun 10 13:35:52.007915 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:52.007880 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-hv2ts_dbeca54b-038b-451f-8af3-23ddbd8e27f0/storage-initializer/0.log" Jun 10 13:35:52.026135 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:35:52.026109 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-hv2ts_dbeca54b-038b-451f-8af3-23ddbd8e27f0/main/0.log" Jun 10 13:36:00.098956 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:00.098928 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pj8zt_2d19bf21-6f90-411e-8268-61e8d42366be/global-pull-secret-syncer/0.log" Jun 10 13:36:00.221811 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:00.221786 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c2ssx_717b46a7-f2c5-4d2b-9e9e-0bda2f1601ab/konnectivity-agent/0.log" Jun 10 13:36:00.304770 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:00.304745 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-87.ec2.internal_2fb07b914d529e0d28e0b79b4f8456ed/haproxy/0.log" Jun 10 13:36:05.204073 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.204045 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv_6866e96b-59ff-49c3-ae6e-56529829541d/extract/0.log" Jun 10 13:36:05.229572 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.229550 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv_6866e96b-59ff-49c3-ae6e-56529829541d/util/0.log" Jun 10 13:36:05.256747 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.256726 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7599x9dv_6866e96b-59ff-49c3-ae6e-56529829541d/pull/0.log" Jun 10 13:36:05.296231 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.296211 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk_39b389c0-4c5d-4c69-9c64-9a419067bf06/extract/0.log" Jun 10 13:36:05.323689 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.323669 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk_39b389c0-4c5d-4c69-9c64-9a419067bf06/util/0.log" Jun 10 13:36:05.348120 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.348104 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0fpqkk_39b389c0-4c5d-4c69-9c64-9a419067bf06/pull/0.log" Jun 10 13:36:05.388772 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.388749 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv_ac1d6c58-c532-424e-82eb-5d420d8d626e/extract/0.log" Jun 10 13:36:05.416099 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.416080 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv_ac1d6c58-c532-424e-82eb-5d420d8d626e/util/0.log" Jun 10 13:36:05.447542 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.447527 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fpthv_ac1d6c58-c532-424e-82eb-5d420d8d626e/pull/0.log" Jun 10 13:36:05.482963 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.482943 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2_5f8f1993-a627-456e-b0be-5343ae0fa776/extract/0.log" Jun 10 13:36:05.509349 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.509331 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2_5f8f1993-a627-456e-b0be-5343ae0fa776/util/0.log" Jun 10 13:36:05.531668 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.531652 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1jf4k2_5f8f1993-a627-456e-b0be-5343ae0fa776/pull/0.log" Jun 10 13:36:05.703409 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.703376 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7ddfc4698d-tcfnk_b5db2df5-fc5b-42bd-ad07-01c0e4365fae/authorino/0.log" Jun 10 13:36:05.844466 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.844397 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-2n9bp_b275a4a6-d547-4026-8aeb-c93c3e2c0db4/registry-server/0.log" Jun 10 13:36:05.885414 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.885380 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-2lh7m_bcbf36bd-458b-44f1-a8e3-4c3749a9dffe/manager/0.log" Jun 10 13:36:05.962283 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:05.962249 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-d54db_7a10699d-eed8-40dd-9723-6f1be9979c6c/manager/0.log" Jun 10 13:36:07.801713 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:07.801689 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54c68bbfff-qbqsk_efaad110-fef1-4588-8d90-d95b2189ed97/metrics-server/0.log" Jun 10 13:36:07.843449 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:07.843421 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-fz6l4_bf7f1646-bab0-4639-a8ff-c2c97a6317d9/monitoring-plugin/0.log" Jun 10 13:36:07.900968 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:07.900917 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ppwx9_6a18b01d-de44-431a-a89a-87a75a4cf76f/node-exporter/0.log" Jun 10 13:36:07.946090 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:07.946068 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ppwx9_6a18b01d-de44-431a-a89a-87a75a4cf76f/kube-rbac-proxy/0.log" Jun 10 13:36:07.971171 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:07.971154 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ppwx9_6a18b01d-de44-431a-a89a-87a75a4cf76f/init-textfile/0.log" Jun 10 13:36:08.194679 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.194621 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wcz6k_b53c0cbc-f268-42a1-a537-b760e5470a56/kube-rbac-proxy-main/0.log" Jun 10 13:36:08.222822 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.222804 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wcz6k_b53c0cbc-f268-42a1-a537-b760e5470a56/kube-rbac-proxy-self/0.log" Jun 10 13:36:08.249203 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.249187 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wcz6k_b53c0cbc-f268-42a1-a537-b760e5470a56/openshift-state-metrics/0.log" Jun 10 13:36:08.727127 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.727100 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b56fcb9cd-2247t_3e65304c-6968-48dc-a83c-7c7f64793f17/thanos-query/0.log" Jun 10 13:36:08.754554 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.754533 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b56fcb9cd-2247t_3e65304c-6968-48dc-a83c-7c7f64793f17/kube-rbac-proxy-web/0.log" Jun 10 13:36:08.788954 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.788932 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b56fcb9cd-2247t_3e65304c-6968-48dc-a83c-7c7f64793f17/kube-rbac-proxy/0.log" Jun 10 13:36:08.812687 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.812666 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b56fcb9cd-2247t_3e65304c-6968-48dc-a83c-7c7f64793f17/prom-label-proxy/0.log" Jun 10 13:36:08.839629 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.839613 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b56fcb9cd-2247t_3e65304c-6968-48dc-a83c-7c7f64793f17/kube-rbac-proxy-rules/0.log" Jun 10 13:36:08.864008 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:08.863985 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b56fcb9cd-2247t_3e65304c-6968-48dc-a83c-7c7f64793f17/kube-rbac-proxy-metrics/0.log" Jun 10 13:36:10.929428 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.929397 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt"] Jun 10 13:36:10.929837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.929769 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b73609-3329-420d-b2c4-ac9c182421ee" containerName="console" Jun 10 13:36:10.929837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.929780 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b73609-3329-420d-b2c4-ac9c182421ee" containerName="console" Jun 10 13:36:10.929837 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.929835 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b73609-3329-420d-b2c4-ac9c182421ee" containerName="console" Jun 10 13:36:10.932952 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.932925 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:10.935801 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.935783 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpk5r\"/\"openshift-service-ca.crt\"" Jun 10 13:36:10.937293 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.937260 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bpk5r\"/\"kube-root-ca.crt\"" Jun 10 13:36:10.937375 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.937330 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bpk5r\"/\"default-dockercfg-xzn8r\"" Jun 10 13:36:10.944410 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.944390 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt"] Jun 10 13:36:10.994177 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.994156 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-proc\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:10.994337 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.994184 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-podres\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:10.994337 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.994207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55pt\" (UniqueName: \"kubernetes.io/projected/ff49cbb6-d676-4230-b04b-a1c2bd31469d-kube-api-access-t55pt\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:10.994337 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.994321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-lib-modules\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:10.994500 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:10.994365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-sys\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095383 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095356 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-sys\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095499 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-proc\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095565 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095513 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-podres\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095565 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095547 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-proc\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095686 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095581 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55pt\" (UniqueName: \"kubernetes.io/projected/ff49cbb6-d676-4230-b04b-a1c2bd31469d-kube-api-access-t55pt\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095742 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-lib-modules\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095809 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095749 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-podres\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095862 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-sys\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.095862 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.095846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff49cbb6-d676-4230-b04b-a1c2bd31469d-lib-modules\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.105968 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.105947 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55pt\" (UniqueName: \"kubernetes.io/projected/ff49cbb6-d676-4230-b04b-a1c2bd31469d-kube-api-access-t55pt\") pod \"perf-node-gather-daemonset-k7svt\" (UID: \"ff49cbb6-d676-4230-b04b-a1c2bd31469d\") " pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.243623 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.243605 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.386467 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.386441 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt"] Jun 10 13:36:11.388523 ip-10-0-138-87 kubenswrapper[2558]: W0610 13:36:11.388494 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podff49cbb6_d676_4230_b04b_a1c2bd31469d.slice/crio-73807a60a791a976063647110454e2de5e7381df0e32c64eb04b56083480489f WatchSource:0}: Error finding container 73807a60a791a976063647110454e2de5e7381df0e32c64eb04b56083480489f: Status 404 returned error can't find the container with id 73807a60a791a976063647110454e2de5e7381df0e32c64eb04b56083480489f Jun 10 13:36:11.468016 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.467996 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8d6697fdf-9jf56_c48b2093-7056-42f6-a392-0ec3a765f4de/console/0.log" Jun 10 13:36:11.504455 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.504431 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-rl85m_6efccd99-887f-43b2-94f2-2e3b248b952d/download-server/0.log" Jun 10 13:36:11.521614 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.521587 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" event={"ID":"ff49cbb6-d676-4230-b04b-a1c2bd31469d","Type":"ContainerStarted","Data":"03715286bba4605c3dfbc3bf6abd3b6c541bfa6e82a52f7347b1d9a2a50a63f8"} Jun 10 13:36:11.521720 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.521648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" event={"ID":"ff49cbb6-d676-4230-b04b-a1c2bd31469d","Type":"ContainerStarted","Data":"73807a60a791a976063647110454e2de5e7381df0e32c64eb04b56083480489f"} Jun 10 13:36:11.521779 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.521764 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:11.545011 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:11.544965 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" podStartSLOduration=1.54495136 podStartE2EDuration="1.54495136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 13:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 13:36:11.54248433 +0000 UTC m=+1943.953878912" watchObservedRunningTime="2026-06-10 13:36:11.54495136 +0000 UTC m=+1943.956345942" Jun 10 13:36:13.329055 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:13.329026 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bpds_e3971888-c652-4a5c-baf8-1172ccffa13b/dns/0.log" Jun 10 13:36:13.351954 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:13.351932 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8bpds_e3971888-c652-4a5c-baf8-1172ccffa13b/kube-rbac-proxy/0.log" Jun 10 13:36:13.477914 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:13.477887 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4n29w_75815153-68d2-46a9-92f6-0c997d983cbe/dns-node-resolver/0.log" Jun 10 13:36:14.101128 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:14.101098 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-56b975f959-8fmls_344bb8f7-93f7-4092-a37a-bd564d0c0599/registry/0.log" Jun 10 13:36:14.147976 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:14.147939 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nxc4h_7f59a632-66ab-4eeb-b763-dcd0d57fbf67/node-ca/0.log" Jun 10 13:36:15.143515 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:15.143488 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjgp5l_33392bfe-e8be-4409-a2ab-d3178ddf10ca/istio-proxy/0.log" Jun 10 13:36:15.317075 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:15.317047 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/0.log" Jun 10 13:36:15.338090 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:15.338063 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/1.log" Jun 10 13:36:15.427750 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:15.427685 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-n499w_8ba5994d-310c-4630-b132-1f8d3a951f32/payload-processing/0.log" Jun 10 13:36:16.088227 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:16.088199 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bw4nm_bc343bc5-1c73-4951-9773-9c13ea4b7ad5/serve-healthcheck-canary/0.log" Jun 10 13:36:16.771783 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:16.771757 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7s8g2_f15ea878-02a2-46c2-867d-817a7cff2ac7/kube-rbac-proxy/0.log" Jun 10 13:36:16.798549 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:16.798522 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7s8g2_f15ea878-02a2-46c2-867d-817a7cff2ac7/exporter/0.log" Jun 10 13:36:16.822522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:16.822503 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7s8g2_f15ea878-02a2-46c2-867d-817a7cff2ac7/extractor/0.log" Jun 10 13:36:17.543414 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:17.543390 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bpk5r/perf-node-gather-daemonset-k7svt" Jun 10 13:36:19.383942 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:19.383915 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-85c8dc5456-cklk6_d50e1d95-5024-47c3-9dc2-1906f8a241e3/nginx/0.log" Jun 10 13:36:19.506075 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:19.506048 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-cgclv_ed2a5742-c878-4052-98da-e8d44861caac/manager/0.log" Jun 10 13:36:19.567943 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:19.567918 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684955-7qkvf_dd07ff68-b839-4010-8ad4-f42b576faac9/cleanup/0.log" Jun 10 13:36:19.651367 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:19.651302 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-566cd7474-qmnxk_5facdcaa-9e73-4695-a994-5f3eecb2a398/manager/0.log" Jun 10 13:36:19.983186 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:19.983161 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-tqvz2_9f672853-25a9-4e0e-8b0d-0b95a3c68d49/manager/0.log" Jun 10 13:36:20.005530 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:20.005508 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-798cb5c965-tqvz2_9f672853-25a9-4e0e-8b0d-0b95a3c68d49/copy-manifests/0.log" Jun 10 13:36:21.747971 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:21.747937 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d9fc7975b-lshj4_3b8b9262-d545-4867-b786-e4dfbe60bc07/manager/0.log" Jun 10 13:36:24.708403 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:24.708370 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjgp5l_33392bfe-e8be-4409-a2ab-d3178ddf10ca/istio-proxy/0.log" Jun 10 13:36:24.850775 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:24.850741 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/0.log" Jun 10 13:36:24.872056 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:24.872028 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/1.log" Jun 10 13:36:24.938920 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:24.938894 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-n499w_8ba5994d-310c-4630-b132-1f8d3a951f32/payload-processing/0.log" Jun 10 13:36:26.069915 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:26.069885 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjgp5l_33392bfe-e8be-4409-a2ab-d3178ddf10ca/istio-proxy/0.log" Jun 10 13:36:26.214643 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:26.214614 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/0.log" Jun 10 13:36:26.234720 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:26.234693 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/1.log" Jun 10 13:36:26.305824 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:26.305796 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-n499w_8ba5994d-310c-4630-b132-1f8d3a951f32/payload-processing/0.log" Jun 10 13:36:28.016129 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:28.016051 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcjgp5l_33392bfe-e8be-4409-a2ab-d3178ddf10ca/istio-proxy/0.log" Jun 10 13:36:28.195434 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:28.195406 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/0.log" Jun 10 13:36:28.216790 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:28.216766 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-qj6c7_36bc21f6-fd42-41ab-8a64-95ad8037ccb6/istio-proxy/1.log" Jun 10 13:36:28.278522 ip-10-0-138-87 kubenswrapper[2558]: I0610 13:36:28.278461 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-n499w_8ba5994d-310c-4630-b132-1f8d3a951f32/payload-processing/0.log"