Jun 10 16:44:45.896197 ip-10-0-128-59 systemd[1]: Starting Kubernetes Kubelet... Jun 10 16:44:46.293391 ip-10-0-128-59 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:46.293391 ip-10-0-128-59 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 16:44:46.293391 ip-10-0-128-59 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:46.293391 ip-10-0-128-59 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 16:44:46.293391 ip-10-0-128-59 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 16:44:46.296243 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.296112 2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 16:44:46.300479 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300464 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:46.300479 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300479 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300483 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300488 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300491 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300494 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300497 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300500 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300502 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300505 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300508 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300511 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300513 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300515 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300518 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300521 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300529 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300532 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300534 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300537 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:46.300540 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300539 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300543 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300547 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300550 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300553 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300556 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300558 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300561 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300565 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300569 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300572 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300574 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300577 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300579 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300582 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300584 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300587 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300589 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300592 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:46.301027 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300594 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300597 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300599 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300602 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300605 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300607 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300610 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300612 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300617 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300620 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300623 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300626 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300628 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300631 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300634 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300637 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300639 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300642 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300645 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300648 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:46.301475 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300650 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300653 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300656 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300658 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300660 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300663 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300665 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300668 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300670 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300673 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300675 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300678 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300680 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300683 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300685 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300688 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300691 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300693 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300696 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300699 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:46.301956 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300703 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300705 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300708 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300710 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300713 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300715 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300717 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300721 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300724 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300727 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300730 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300733 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300735 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300738 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300741 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300743 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300745 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300748 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300750 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.300753 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:46.302457 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301432 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301439 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301444 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301446 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301449 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301452 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301455 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301458 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301460 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301464 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301467 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301469 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301472 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301474 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301477 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301479 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301482 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301485 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301487 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:46.302965 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301491 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301493 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301496 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301498 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301501 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301503 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301506 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301508 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301511 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301513 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301516 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301518 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301521 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301524 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301526 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301529 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301531 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301534 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301536 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:46.303462 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301538 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301541 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301543 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301547 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301552 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301554 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301557 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301560 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301562 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301565 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301568 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301570 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301573 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301577 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301580 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301583 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301586 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301588 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301591 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:46.303922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301593 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301595 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301598 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301601 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301603 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301606 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301608 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301610 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301613 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301615 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301618 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301620 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301622 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301625 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301628 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301630 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301634 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301636 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301639 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301642 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:46.304385 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301644 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301647 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301649 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301652 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301654 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301657 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301660 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301663 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301665 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301667 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301670 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301672 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301675 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301677 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301681 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301684 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301687 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301689 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301692 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301695 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:46.304874 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301698 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.301700 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302057 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302062 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302065 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302067 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302070 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302073 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302076 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302078 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302081 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302084 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302087 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302093 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302095 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302098 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302100 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302103 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302105 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302108 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:46.305379 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302110 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302112 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302115 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302117 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302120 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302122 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302125 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302127 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302130 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302132 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302135 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302138 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302140 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302144 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302148 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302151 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302153 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302156 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302159 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:46.305869 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302161 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302164 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302167 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302169 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302173 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302177 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302181 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302184 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302186 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302190 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302192 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302195 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302197 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302199 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302202 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302204 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302207 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302209 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302212 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:46.306338 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302214 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302216 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302219 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302221 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302224 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302227 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302229 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302232 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302234 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302237 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302239 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302241 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302244 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302246 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302249 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302253 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302255 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302257 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302261 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302264 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:46.306776 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302269 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302271 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302273 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302276 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302278 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302281 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302283 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302286 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302288 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302291 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302293 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302296 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302298 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302301 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302303 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302306 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302308 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302311 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302314 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302316 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:46.307837 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302319 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302321 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.302324 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302395 2553 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302402 2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302407 2553 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302412 2553 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302416 2553 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302419 2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302422 2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302426 2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302431 2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302434 2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302438 2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302441 2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302444 2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302446 2553 flags.go:64] FLAG: --cgroup-root="" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302449 2553 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302452 2553 flags.go:64] FLAG: --client-ca-file="" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302455 2553 flags.go:64] FLAG: --cloud-provider="external" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302458 2553 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302462 2553 flags.go:64] FLAG: --cluster-domain="" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302464 2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302468 2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 16:44:46.308341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302471 2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302475 2553 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302478 2553 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302481 2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302486 2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302489 2553 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302492 2553 flags.go:64] FLAG: --contention-profiling="false" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302495 2553 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302498 2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302501 2553 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302504 2553 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302507 2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302510 2553 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302513 2553 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302516 2553 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302519 2553 flags.go:64] FLAG: --enable-server="true" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302522 2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302526 2553 flags.go:64] FLAG: --event-burst="100" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302529 2553 flags.go:64] FLAG: --event-qps="50" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302533 2553 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302537 2553 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302540 2553 flags.go:64] FLAG: --eviction-hard="" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302543 2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302546 2553 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302549 2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 16:44:46.308922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302552 2553 flags.go:64] FLAG: --eviction-soft="" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302555 2553 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302557 2553 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302560 2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302563 2553 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302565 2553 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302568 2553 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302571 2553 flags.go:64] FLAG: --feature-gates="" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302574 2553 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302577 2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302580 2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302585 2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302588 2553 flags.go:64] FLAG: --healthz-port="10248" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302591 2553 flags.go:64] FLAG: --help="false" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302594 2553 flags.go:64] FLAG: --hostname-override="ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302597 2553 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302600 2553 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302603 2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302606 2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302609 2553 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302612 2553 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302615 2553 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302617 2553 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 16:44:46.309499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302620 2553 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302623 2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302626 2553 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302629 2553 flags.go:64] FLAG: --kube-reserved="" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302632 2553 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302635 2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302639 2553 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302641 2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302644 2553 flags.go:64] FLAG: --lock-file="" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302647 2553 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302650 2553 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302653 2553 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302658 2553 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302660 2553 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302663 2553 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302666 2553 flags.go:64] FLAG: --logging-format="text" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302669 2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302672 2553 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302674 2553 flags.go:64] FLAG: --manifest-url="" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302677 2553 flags.go:64] FLAG: --manifest-url-header="" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302683 2553 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302686 2553 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302690 2553 flags.go:64] FLAG: --max-pods="110" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302692 2553 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302695 2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 16:44:46.310072 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302698 2553 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302701 2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302703 2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302706 2553 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302709 2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302715 2553 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302718 2553 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302721 2553 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302724 2553 flags.go:64] FLAG: --pod-cidr="" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302727 2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302732 2553 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302736 2553 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302739 2553 flags.go:64] FLAG: --pods-per-core="0" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302745 2553 flags.go:64] FLAG: --port="10250" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302748 2553 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302751 2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0440b0366424a480d" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302754 2553 flags.go:64] FLAG: --qos-reserved="" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302756 2553 flags.go:64] FLAG: --read-only-port="10255" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302759 2553 flags.go:64] FLAG: --register-node="true" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302762 2553 flags.go:64] FLAG: --register-with-taints="" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302766 2553 flags.go:64] FLAG: --registry-burst="10" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302769 2553 flags.go:64] FLAG: --registry-qps="5" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302771 2553 flags.go:64] FLAG: --reserved-cpus="" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302774 2553 flags.go:64] FLAG: --reserved-memory="" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302778 2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 16:44:46.310692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302780 2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302783 2553 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302787 2553 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302789 2553 flags.go:64] FLAG: --runonce="false" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302792 2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302795 2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302798 2553 flags.go:64] FLAG: --seccomp-default="false" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302800 2553 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302803 2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302806 2553 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302809 2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302812 2553 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302815 2553 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302817 2553 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302820 2553 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302823 2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302826 2553 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302828 2553 flags.go:64] FLAG: --system-cgroups="" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302833 2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302838 2553 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302841 2553 flags.go:64] FLAG: --tls-cert-file="" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302844 2553 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302848 2553 flags.go:64] FLAG: --tls-min-version="" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302850 2553 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302853 2553 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 16:44:46.311362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302856 2553 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302859 2553 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302861 2553 flags.go:64] FLAG: --v="2" Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302865 2553 flags.go:64] FLAG: --version="false" Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302873 2553 flags.go:64] FLAG: --vmodule="" Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302876 2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.302879 2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303010 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303015 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303020 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303023 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303026 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303029 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303032 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303035 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303038 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303041 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303043 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303047 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303051 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303053 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:46.311950 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303056 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303059 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303061 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303064 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303067 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303069 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303072 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303075 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303077 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303080 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303082 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303085 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303087 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303090 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303092 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303095 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303097 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303100 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303102 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303104 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:46.312498 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303108 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303111 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303113 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303115 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303118 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303120 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303123 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303125 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303128 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303130 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303134 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303137 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303139 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303142 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303145 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303147 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303150 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303152 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303155 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:46.312996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303157 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303160 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303164 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303166 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303169 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303171 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303174 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303176 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303179 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303181 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303184 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303186 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303188 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303192 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303195 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303197 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303200 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303203 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303205 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303208 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:46.313466 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303211 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303213 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303216 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303218 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303221 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303223 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303226 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303230 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303233 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303236 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303239 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303242 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303244 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303246 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303249 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303251 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303254 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303256 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303259 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303261 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:46.313958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303264 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303266 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303269 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303271 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303273 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.303277 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.303285 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.309663 2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.309678 2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.310492 2553 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.310499 2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310556 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310563 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310566 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310570 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:46.314438 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310573 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310576 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310578 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310581 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310584 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310586 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310589 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310592 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310595 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310597 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310600 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310604 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310609 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310612 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310615 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310617 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310620 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310622 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310625 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:46.314803 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310627 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310630 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310633 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310635 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310638 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310640 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310644 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310647 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310649 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310651 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310654 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310657 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310659 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310662 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310665 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310667 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310670 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310672 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310675 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310677 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:46.315329 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310680 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310682 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310686 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310690 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310693 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310696 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310699 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310702 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310705 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310708 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310711 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310714 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310716 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310719 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310721 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310724 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310726 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310729 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310732 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:46.315802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310735 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310737 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310740 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310743 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310746 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310748 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310751 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310753 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310756 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310758 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310761 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310763 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310766 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310768 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310771 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310773 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310776 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310778 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310781 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310783 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:46.316272 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310786 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310788 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310791 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310793 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310796 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310798 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310801 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310803 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310806 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310808 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310810 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310814 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310816 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310818 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310821 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310823 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:46.316762 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310826 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.310831 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310969 2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310974 2553 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310977 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310980 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310983 2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310986 2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310988 2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310991 2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310994 2553 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310996 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.310998 2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311001 2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311003 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 16:44:46.317163 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311006 2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311008 2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311011 2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311013 2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311016 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311018 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311021 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311023 2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311025 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311028 2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311030 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311033 2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311036 2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311038 2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311041 2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311044 2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311046 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311048 2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311051 2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 16:44:46.317522 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311054 2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311056 2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311059 2553 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311061 2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311064 2553 feature_gate.go:328] unrecognized feature gate: Example Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311066 2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311068 2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311071 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311073 2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311075 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311078 2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311080 2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311083 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311085 2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311087 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311090 2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311093 2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311097 2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311100 2553 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311103 2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 16:44:46.318116 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311105 2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311108 2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311110 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311113 2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311116 2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311118 2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311121 2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311124 2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311126 2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311129 2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311131 2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311133 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311136 2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311138 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311141 2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311143 2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311146 2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311148 2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311150 2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311153 2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 16:44:46.318922 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311155 2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311158 2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311160 2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311162 2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311166 2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311169 2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311173 2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311176 2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311180 2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311183 2553 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311186 2553 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311188 2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311190 2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311193 2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311195 2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311198 2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311200 2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311203 2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 16:44:46.319628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311205 2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311208 2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311210 2553 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311212 2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311215 2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311217 2553 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311220 2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311222 2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:46.311225 2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.311229 2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.311323 2553 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.313456 2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.314925 2553 server.go:1019] "Starting client certificate rotation" Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.315022 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 16:44:46.320080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.315056 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 16:44:46.320500 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.319136 2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 16:44:46.320948 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.320931 2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 16:44:46.332078 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.332059 2553 log.go:25] "Validated CRI v1 runtime API" Jun 10 16:44:46.334434 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.334420 2553 log.go:25] "Validated CRI v1 image API" Jun 10 16:44:46.335170 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.335156 2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 16:44:46.337473 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.337456 2553 fs.go:135] Filesystem UUIDs: map[628063ca-025b-465e-b813-159097067fca:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c324961d-06ea-47b9-9e62-e6525a9dd5c1:/dev/nvme0n1p3] Jun 10 16:44:46.337521 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.337473 2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 16:44:46.342421 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.342406 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 16:44:46.343485 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.343361 2553 manager.go:216] Machine: {Timestamp:2026-06-10 16:44:46.342187618 +0000 UTC m=+0.333490265 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200271 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2445a1efd9612e9f648618fedaee7b SystemUUID:ec2445a1-efd9-612e-9f64-8618fedaee7b BootID:228d651d-411d-4614-b548-2e7b5c546244 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:fb:80:22:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:fb:80:22:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:07:1c:9c:58:50 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 16:44:46.343485 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.343480 2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 16:44:46.343583 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.343552 2553 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 16:44:46.345817 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.345788 2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 16:44:46.345961 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.345820 2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-59.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 16:44:46.346660 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.346651 2553 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 16:44:46.346697 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.346662 2553 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 16:44:46.346697 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.346670 2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 16:44:46.347598 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.347587 2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 16:44:46.348421 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.348411 2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 16:44:46.351430 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351419 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 10 16:44:46.351557 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351548 2553 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 16:44:46.351590 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351575 2553 kubelet.go:486] "Attempting to sync node with API server" Jun 10 16:44:46.351590 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351584 2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 16:44:46.351644 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351595 2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 16:44:46.351644 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351604 2553 kubelet.go:398] "Adding apiserver pod source" Jun 10 16:44:46.351644 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351613 2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 16:44:46.351998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.351987 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 16:44:46.352037 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.352010 2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 16:44:46.355795 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.355778 2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 16:44:46.357103 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.357091 2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 16:44:46.357148 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.357119 2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 16:44:46.358188 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358175 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 16:44:46.358188 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358191 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 16:44:46.358188 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358198 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358203 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358215 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358221 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358228 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358233 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358239 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358245 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358253 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358258 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358278 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 16:44:46.358321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.358286 2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 16:44:46.360034 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.360006 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 16:44:46.360034 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.360021 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 16:44:46.360160 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.360020 2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-59.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 16:44:46.361678 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.361662 2553 server.go:1268] "Started kubelet" Jun 10 16:44:46.361766 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.361721 2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 16:44:46.361803 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.361759 2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 16:44:46.361836 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.361821 2553 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 16:44:46.362481 ip-10-0-128-59 systemd[1]: Started Kubernetes Kubelet. Jun 10 16:44:46.363600 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.363584 2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 16:44:46.364560 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.364542 2553 server.go:310] "Adding debug handlers to kubelet server" Jun 10 16:44:46.368315 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.368296 2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 16:44:46.368315 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.368308 2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 16:44:46.368452 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.368344 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7frbw" Jun 10 16:44:46.368452 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.368375 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:46.368867 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.368848 2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 16:44:46.368949 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.368854 2553 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 16:44:46.368949 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.368891 2553 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 16:44:46.369030 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.368997 2553 factory.go:55] Registering systemd factory Jun 10 16:44:46.369030 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369011 2553 factory.go:223] Registration of the systemd container factory successfully Jun 10 16:44:46.369030 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369022 2553 reconstruct.go:97] "Volume reconstruction finished" Jun 10 16:44:46.369030 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369030 2553 reconciler.go:29] "Reconciler: start to sync state" Jun 10 16:44:46.369254 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.369236 2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 16:44:46.369254 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369244 2553 factory.go:153] Registering CRI-O factory Jun 10 16:44:46.369348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369266 2553 factory.go:223] Registration of the crio container factory successfully Jun 10 16:44:46.369348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369314 2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 16:44:46.369348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369338 2553 factory.go:103] Registering Raw factory Jun 10 16:44:46.369348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369348 2553 manager.go:1196] Started watching for new ooms in manager Jun 10 16:44:46.369864 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.369849 2553 manager.go:349] Starting recovery of all containers Jun 10 16:44:46.376669 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.376643 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7frbw" Jun 10 16:44:46.376749 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.376713 2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 16:44:46.377446 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.377421 2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 16:44:46.379662 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.376738 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-59.ec2.internal.18b7c60142858a8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-59.ec2.internal,UID:ip-10-0-128-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-59.ec2.internal,},FirstTimestamp:2026-06-10 16:44:46.361635469 +0000 UTC m=+0.352938115,LastTimestamp:2026-06-10 16:44:46.361635469 +0000 UTC m=+0.352938115,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-59.ec2.internal,}" Jun 10 16:44:46.381380 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.381231 2553 manager.go:354] Recovery completed Jun 10 16:44:46.385728 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.385715 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:46.387381 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.387365 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:46.387476 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.387392 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:46.387476 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.387402 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:46.387867 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.387853 2553 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 16:44:46.387867 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.387863 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:46.387955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.387866 2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 16:44:46.387990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.387956 2553 state_mem.go:36] "Initialized new in-memory state store" Jun 10 16:44:46.388493 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.388481 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:46.388546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.388504 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:46.388546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.388513 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:46.388980 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.388964 2553 policy_none.go:49] "None policy: Start" Jun 10 16:44:46.389600 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.389586 2553 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 16:44:46.389677 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.389609 2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 16:44:46.389677 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.389598 2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-59.ec2.internal.18b7c601440e60a3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-59.ec2.internal,UID:ip-10-0-128-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-59.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-59.ec2.internal,},FirstTimestamp:2026-06-10 16:44:46.387380387 +0000 UTC m=+0.378683036,LastTimestamp:2026-06-10 16:44:46.387380387 +0000 UTC m=+0.378683036,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-59.ec2.internal,}" Jun 10 16:44:46.390647 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.390636 2553 policy_none.go:47] "Start" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.428202 2553 manager.go:337] "Starting Device Plugin manager" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.428237 2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.428251 2553 server.go:87] "Starting device plugin registration server" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.428569 2553 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.428582 2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.428674 2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.428759 2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.428768 2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.429163 2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 16:44:46.431402 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.429206 2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:46.431741 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.431408 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 16:44:46.432459 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.432441 2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 16:44:46.432499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.432489 2553 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 16:44:46.432531 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.432512 2553 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 16:44:46.432578 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.432549 2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 16:44:46.434685 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.434665 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:46.528984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.528946 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:46.529833 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.529816 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:46.529944 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.529845 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:46.529944 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.529855 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:46.529944 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.529880 2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.533635 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.533620 2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal"] Jun 10 16:44:46.533679 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.533670 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:46.535062 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.535046 2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.535145 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.535071 2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-59.ec2.internal\": node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:46.535194 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.535171 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:46.535227 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.535197 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:46.535268 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.535237 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:46.536408 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.536388 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:46.536504 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.536491 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.536563 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.536524 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:46.537032 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.537017 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:46.537032 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.537029 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:46.537133 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.537044 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:46.537133 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.537058 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:46.537133 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.537072 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:46.537133 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.537083 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:46.538000 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.537986 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.538077 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.538014 2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 16:44:46.538630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.538614 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientMemory" Jun 10 16:44:46.538709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.538640 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 16:44:46.538709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.538653 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeHasSufficientPID" Jun 10 16:44:46.548059 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.548019 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:46.553423 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.553407 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-59.ec2.internal\" not found" node="ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.556608 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.556593 2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-59.ec2.internal\" not found" node="ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.570641 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.570618 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/485c6d743a449b1b2f8c2fa7eb09fd53-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal\" (UID: \"485c6d743a449b1b2f8c2fa7eb09fd53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.570699 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.570645 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/886f69e135aed4c8da242a0cae9e59d4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-59.ec2.internal\" (UID: \"886f69e135aed4c8da242a0cae9e59d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.570699 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.570665 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/485c6d743a449b1b2f8c2fa7eb09fd53-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal\" (UID: \"485c6d743a449b1b2f8c2fa7eb09fd53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.648726 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.648709 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:46.671191 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.671174 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/886f69e135aed4c8da242a0cae9e59d4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-59.ec2.internal\" (UID: \"886f69e135aed4c8da242a0cae9e59d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.671266 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.671199 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/485c6d743a449b1b2f8c2fa7eb09fd53-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal\" (UID: \"485c6d743a449b1b2f8c2fa7eb09fd53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.671266 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.671235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/485c6d743a449b1b2f8c2fa7eb09fd53-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal\" (UID: \"485c6d743a449b1b2f8c2fa7eb09fd53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.671327 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.671277 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/485c6d743a449b1b2f8c2fa7eb09fd53-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal\" (UID: \"485c6d743a449b1b2f8c2fa7eb09fd53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.671327 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.671319 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/485c6d743a449b1b2f8c2fa7eb09fd53-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal\" (UID: \"485c6d743a449b1b2f8c2fa7eb09fd53\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.671386 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.671281 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/886f69e135aed4c8da242a0cae9e59d4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-59.ec2.internal\" (UID: \"886f69e135aed4c8da242a0cae9e59d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.749209 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.749191 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:46.849825 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.849758 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:46.857061 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.857043 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.861421 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:46.861401 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:46.950117 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:46.950087 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.050576 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:47.050554 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.151168 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:47.151106 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.251700 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:47.251674 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.312773 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:47.312734 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485c6d743a449b1b2f8c2fa7eb09fd53.slice/crio-6484bd584756ac934ae3faee393c133139f1f8099d166fb31d7d0676e90cd711 WatchSource:0}: Error finding container 6484bd584756ac934ae3faee393c133139f1f8099d166fb31d7d0676e90cd711: Status 404 returned error can't find the container with id 6484bd584756ac934ae3faee393c133139f1f8099d166fb31d7d0676e90cd711 Jun 10 16:44:47.313244 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:47.313006 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod886f69e135aed4c8da242a0cae9e59d4.slice/crio-ab4f803aa4d39c7c0fa2b83f92ca0a72fc179ab537ad055f6c5609c9869db58c WatchSource:0}: Error finding container ab4f803aa4d39c7c0fa2b83f92ca0a72fc179ab537ad055f6c5609c9869db58c: Status 404 returned error can't find the container with id ab4f803aa4d39c7c0fa2b83f92ca0a72fc179ab537ad055f6c5609c9869db58c Jun 10 16:44:47.314118 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.314103 2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 16:44:47.314226 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.314212 2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 16:44:47.317750 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.317736 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:44:47.351741 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:47.351725 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.379197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.379169 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 16:39:46 +0000 UTC" deadline="2028-03-24 16:47:29.625651424 +0000 UTC" Jun 10 16:44:47.379197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.379191 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15672h2m42.246462994s" Jun 10 16:44:47.435228 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.435151 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" event={"ID":"886f69e135aed4c8da242a0cae9e59d4","Type":"ContainerStarted","Data":"ab4f803aa4d39c7c0fa2b83f92ca0a72fc179ab537ad055f6c5609c9869db58c"} Jun 10 16:44:47.436187 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.436159 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" event={"ID":"485c6d743a449b1b2f8c2fa7eb09fd53","Type":"ContainerStarted","Data":"6484bd584756ac934ae3faee393c133139f1f8099d166fb31d7d0676e90cd711"} Jun 10 16:44:47.452298 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:47.452281 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.552774 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:47.552738 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.653209 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:47.653174 2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-59.ec2.internal\" not found" Jun 10 16:44:47.711138 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.711067 2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:47.722232 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.722212 2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:47.769095 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.769074 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" Jun 10 16:44:47.778825 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.778801 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 16:44:47.779777 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.779756 2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" Jun 10 16:44:47.790888 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.790869 2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 16:44:47.926538 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:47.926486 2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:48.352760 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.352728 2553 apiserver.go:52] "Watching apiserver" Jun 10 16:44:48.360330 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.360302 2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 16:44:48.360770 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.360744 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4mh5x","openshift-multus/multus-additional-cni-plugins-jmznj","openshift-network-operator/iptables-alerter-4d8bd","openshift-ovn-kubernetes/ovnkube-node-x4jnt","kube-system/global-pull-secret-syncer-9c5cl","kube-system/konnectivity-agent-tsflw","kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sps5j","openshift-dns/node-resolver-sfl8c","openshift-image-registry/node-ca-xh6hq","openshift-multus/network-metrics-daemon-7q2mx","openshift-network-diagnostics/network-check-target-2nfdt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal"] Jun 10 16:44:48.362214 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.362193 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.363244 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.363220 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.364461 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.364432 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.364766 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.364747 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 16:44:48.364864 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.364847 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 16:44:48.364941 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.364870 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 16:44:48.364941 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.364850 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-762t9\"" Jun 10 16:44:48.365279 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.365258 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 16:44:48.365618 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.365526 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 16:44:48.365618 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.365571 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.366048 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.365979 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n2ntb\"" Jun 10 16:44:48.366342 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.366320 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 16:44:48.366484 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.366446 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kzbsn\"" Jun 10 16:44:48.366564 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.366481 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 16:44:48.366630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.366543 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:44:48.366952 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.366779 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.366952 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.366839 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:44:48.367088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.367079 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 16:44:48.368229 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.367965 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.368418 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.368403 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 16:44:48.368638 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.368621 2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 16:44:48.369093 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.368856 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 16:44:48.369093 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.368933 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 16:44:48.369093 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.368977 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 16:44:48.369093 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.369047 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q566h\"" Jun 10 16:44:48.369662 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.369642 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 16:44:48.370482 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.369957 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.370482 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.370245 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 16:44:48.372769 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.371117 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 16:44:48.372769 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.371241 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 16:44:48.372769 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.371347 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b9tsm\"" Jun 10 16:44:48.372769 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.372346 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 16:44:48.372769 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.372539 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 16:44:48.372769 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.372641 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ktsxs\"" Jun 10 16:44:48.373429 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.373381 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.375201 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.375183 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.376021 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.376002 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 16:44:48.376108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.376088 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4fjd7\"" Jun 10 16:44:48.376108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.376090 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:44:48.376237 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.376220 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.377302 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.377277 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 16:44:48.377443 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.377407 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 16:44:48.377650 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.377632 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bvjv2\"" Jun 10 16:44:48.377786 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.377646 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 16:44:48.377918 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.377872 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 16:44:48.378116 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:48.378199 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378117 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 16:44:48.378199 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.378121 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:44:48.378533 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378484 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 16:44:48.378603 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378581 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zt86\"" Jun 10 16:44:48.378659 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378640 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-kubelet\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.378723 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378670 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-slash\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.378884 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378810 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-registration-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.378884 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378844 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hphjk\" (UniqueName: \"kubernetes.io/projected/30e25393-8e4b-44b5-8369-0adfec527a9c-kube-api-access-hphjk\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.378884 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378868 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-log-socket\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379029 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378892 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-env-overrides\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379029 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378931 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-kubelet-config\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.379029 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378951 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30e25393-8e4b-44b5-8369-0adfec527a9c-host-slash\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.379029 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378972 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc2ea954-31aa-47f4-bb61-480edd611228-tmp-dir\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.379029 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.378994 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfmg\" (UniqueName: \"kubernetes.io/projected/dc2ea954-31aa-47f4-bb61-480edd611228-kube-api-access-mzfmg\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.379029 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379013 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-systemd\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379033 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-dbus\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379050 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-sys-fs\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379065 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f70d9be-a2e5-4082-aae2-76d968910a9e-agent-certs\") pod \"konnectivity-agent-tsflw\" (UID: \"0f70d9be-a2e5-4082-aae2-76d968910a9e\") " pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379079 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-node-log\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379098 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379122 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovnkube-config\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379164 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovnkube-script-lib\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379220 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f70d9be-a2e5-4082-aae2-76d968910a9e-konnectivity-ca\") pod \"konnectivity-agent-tsflw\" (UID: \"0f70d9be-a2e5-4082-aae2-76d968910a9e\") " pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.379288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379271 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-cni-bin\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379298 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32430c61-cd32-4363-a0e0-12385778222c-host\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379323 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6zxf\" (UniqueName: \"kubernetes.io/projected/32430c61-cd32-4363-a0e0-12385778222c-kube-api-access-b6zxf\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379347 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-socket-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379367 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-var-lib-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379401 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379448 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovn-node-metrics-cert\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379489 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhpd\" (UniqueName: \"kubernetes.io/projected/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-kube-api-access-5hhpd\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379527 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30e25393-8e4b-44b5-8369-0adfec527a9c-iptables-alerter-script\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379553 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc2ea954-31aa-47f4-bb61-480edd611228-hosts-file\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379583 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-systemd-units\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379612 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-run-netns\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.379665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379638 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq4t2\" (UniqueName: \"kubernetes.io/projected/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-kube-api-access-rq4t2\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379672 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379716 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32430c61-cd32-4363-a0e0-12385778222c-serviceca\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379775 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379804 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-device-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379834 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-etc-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379864 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379892 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-ovn\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379899 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.379996 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.379940 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-cni-netd\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.380185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.380040 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.383818 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.383791 2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 16:44:48.405838 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.405812 2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-488w6" Jun 10 16:44:48.413998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.413969 2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-488w6" Jun 10 16:44:48.469996 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.469965 2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 16:44:48.481193 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481168 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-kubelet\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481205 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-registration-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.481306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:48.481306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481256 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-tuned\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.481306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481280 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-log-socket\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481283 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-registration-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.481306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481304 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc2ea954-31aa-47f4-bb61-480edd611228-tmp-dir\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481277 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-kubelet\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481324 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-log-socket\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481327 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfmg\" (UniqueName: \"kubernetes.io/projected/dc2ea954-31aa-47f4-bb61-480edd611228-kube-api-access-mzfmg\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481358 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-cni-binary-copy\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481376 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-cni-bin\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481401 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-systemd\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481421 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-sys-fs\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481435 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-node-log\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481449 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovnkube-config\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481468 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-hostroot\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481476 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-systemd\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481491 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-daemon-config\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-node-log\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481514 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6zxf\" (UniqueName: \"kubernetes.io/projected/32430c61-cd32-4363-a0e0-12385778222c-kube-api-access-b6zxf\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481541 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-sys-fs\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481537 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-socket-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.481607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481612 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-os-release\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481613 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc2ea954-31aa-47f4-bb61-480edd611228-tmp-dir\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481636 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-multus-certs\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481659 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovn-node-metrics-cert\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481661 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-socket-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481674 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc2ea954-31aa-47f4-bb61-480edd611228-hosts-file\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481729 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-kubelet\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481744 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481772 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-run-netns\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481792 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32430c61-cd32-4363-a0e0-12385778222c-serviceca\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481790 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc2ea954-31aa-47f4-bb61-480edd611228-hosts-file\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481880 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-run-netns\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481940 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481961 2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.481967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482031 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-kubernetes\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.482497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482053 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482062 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovnkube-config\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482078 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-cni-multus\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482100 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-ovn\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482114 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-cni-netd\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482054 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482145 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-modprobe-d\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482161 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-cni-netd\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-ovn\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482188 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/32430c61-cd32-4363-a0e0-12385778222c-serviceca\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482212 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysctl-conf\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482244 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-host\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482273 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-cnibin\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482301 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482333 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-netns\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482368 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-slash\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482393 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hphjk\" (UniqueName: \"kubernetes.io/projected/30e25393-8e4b-44b5-8369-0adfec527a9c-kube-api-access-hphjk\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.483183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482417 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysconfig\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482422 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-slash\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482438 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-system-cni-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-k8s-cni-cncf-io\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482491 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc5rr\" (UniqueName: \"kubernetes.io/projected/a7fbb3c9-f5fb-4528-bd65-f8675caced84-kube-api-access-rc5rr\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482516 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-systemd\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482536 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-lib-modules\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482559 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-env-overrides\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482587 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-kubelet-config\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482642 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-kubelet-config\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482689 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30e25393-8e4b-44b5-8369-0adfec527a9c-host-slash\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482714 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysctl-d\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482736 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-dbus\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482756 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f70d9be-a2e5-4082-aae2-76d968910a9e-agent-certs\") pod \"konnectivity-agent-tsflw\" (UID: \"0f70d9be-a2e5-4082-aae2-76d968910a9e\") " pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482781 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvnld\" (UniqueName: \"kubernetes.io/projected/4866d76f-1de4-4d70-a6b6-18c277cb084e-kube-api-access-hvnld\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482787 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30e25393-8e4b-44b5-8369-0adfec527a9c-host-slash\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482808 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.483984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482835 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482899 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-env-overrides\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482919 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovnkube-script-lib\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482935 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-dbus\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482959 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f70d9be-a2e5-4082-aae2-76d968910a9e-konnectivity-ca\") pod \"konnectivity-agent-tsflw\" (UID: \"0f70d9be-a2e5-4082-aae2-76d968910a9e\") " pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.482964 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483045 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483093 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-cni-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483119 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-cnibin\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483145 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-conf-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483186 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-cni-bin\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483210 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32430c61-cd32-4363-a0e0-12385778222c-host\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483244 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-run\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483251 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32430c61-cd32-4363-a0e0-12385778222c-host\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483269 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-sys\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483291 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-var-lib-kubelet\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483299 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-cni-bin\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.484709 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483312 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-os-release\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483344 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-socket-dir-parent\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483367 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-etc-kubernetes\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483391 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-var-lib-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483412 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483417 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovnkube-script-lib\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483437 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhpd\" (UniqueName: \"kubernetes.io/projected/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-kube-api-access-5hhpd\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483446 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-var-lib-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483452 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30e25393-8e4b-44b5-8369-0adfec527a9c-iptables-alerter-script\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h5fh\" (UniqueName: \"kubernetes.io/projected/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-kube-api-access-5h5fh\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483481 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-host-run-ovn-kubernetes\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483493 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0f70d9be-a2e5-4082-aae2-76d968910a9e-konnectivity-ca\") pod \"konnectivity-agent-tsflw\" (UID: \"0f70d9be-a2e5-4082-aae2-76d968910a9e\") " pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483552 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-systemd-units\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483599 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq4t2\" (UniqueName: \"kubernetes.io/projected/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-kube-api-access-rq4t2\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483617 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-systemd-units\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483624 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483740 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-device-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.485391 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483767 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-system-cni-dir\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483798 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5vhm\" (UniqueName: \"kubernetes.io/projected/6309fe63-fdc2-48be-91f9-cffabda031de-kube-api-access-b5vhm\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483805 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-device-dir\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483821 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-etc-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.483745 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483884 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483921 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30e25393-8e4b-44b5-8369-0adfec527a9c-iptables-alerter-script\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483942 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-etc-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.483953 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret podName:a1cfb4be-8bf2-43ac-85b8-4d881a636eb4 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:48.98392499 +0000 UTC m=+2.975227647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret") pod "global-pull-secret-syncer-9c5cl" (UID: "a1cfb4be-8bf2-43ac-85b8-4d881a636eb4") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483927 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4866d76f-1de4-4d70-a6b6-18c277cb084e-tmp\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.483968 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-run-openvswitch\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.485489 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-ovn-node-metrics-cert\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.485990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.485552 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0f70d9be-a2e5-4082-aae2-76d968910a9e-agent-certs\") pod \"konnectivity-agent-tsflw\" (UID: \"0f70d9be-a2e5-4082-aae2-76d968910a9e\") " pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.488878 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.488856 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfmg\" (UniqueName: \"kubernetes.io/projected/dc2ea954-31aa-47f4-bb61-480edd611228-kube-api-access-mzfmg\") pod \"node-resolver-sfl8c\" (UID: \"dc2ea954-31aa-47f4-bb61-480edd611228\") " pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.489106 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.489091 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6zxf\" (UniqueName: \"kubernetes.io/projected/32430c61-cd32-4363-a0e0-12385778222c-kube-api-access-b6zxf\") pod \"node-ca-xh6hq\" (UID: \"32430c61-cd32-4363-a0e0-12385778222c\") " pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.489296 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.489281 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hphjk\" (UniqueName: \"kubernetes.io/projected/30e25393-8e4b-44b5-8369-0adfec527a9c-kube-api-access-hphjk\") pod \"iptables-alerter-4d8bd\" (UID: \"30e25393-8e4b-44b5-8369-0adfec527a9c\") " pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.493482 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.493464 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhpd\" (UniqueName: \"kubernetes.io/projected/c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1-kube-api-access-5hhpd\") pod \"aws-ebs-csi-driver-node-xxqgs\" (UID: \"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.494113 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.494091 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq4t2\" (UniqueName: \"kubernetes.io/projected/7cda8b7c-0c33-458a-bbb8-c3ac1a402868-kube-api-access-rq4t2\") pod \"ovnkube-node-x4jnt\" (UID: \"7cda8b7c-0c33-458a-bbb8-c3ac1a402868\") " pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.584990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.584957 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-cni-binary-copy\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.584990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.584992 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-cni-bin\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-hostroot\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-daemon-config\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585059 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-os-release\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585085 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-cni-bin\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585089 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-multus-certs\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585096 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-hostroot\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585145 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-kubelet\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585157 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-os-release\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585171 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585198 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-kubernetes\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585210 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-multus-certs\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585238 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-kubelet\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585254 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-kubernetes\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585272 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585299 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-cni-multus\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585324 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-modprobe-d\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585346 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysctl-conf\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585366 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-var-lib-cni-multus\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585370 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-host\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585410 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-host\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585415 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-cnibin\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585445 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585456 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-cnibin\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585477 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-netns\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585505 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysconfig\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585530 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-system-cni-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585513 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-modprobe-d\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.585705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585555 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-k8s-cni-cncf-io\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585579 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc5rr\" (UniqueName: \"kubernetes.io/projected/a7fbb3c9-f5fb-4528-bd65-f8675caced84-kube-api-access-rc5rr\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585583 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysctl-conf\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585584 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-netns\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585618 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-cni-binary-copy\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585633 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysconfig\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585672 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-host-run-k8s-cni-cncf-io\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585677 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-system-cni-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585724 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-systemd\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585728 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-systemd\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585727 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585749 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-lib-modules\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585765 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-cni-binary-copy\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585775 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysctl-d\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585800 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvnld\" (UniqueName: \"kubernetes.io/projected/4866d76f-1de4-4d70-a6b6-18c277cb084e-kube-api-access-hvnld\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585825 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585852 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.586474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585878 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-lib-modules\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585923 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-sysctl-d\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585935 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-cni-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585960 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-cnibin\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.585984 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-conf-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586009 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-run\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586030 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-sys\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586059 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-var-lib-kubelet\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586052 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-cni-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586059 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-conf-dir\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586059 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-cnibin\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586102 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-run\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586107 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-sys\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586114 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4866d76f-1de4-4d70-a6b6-18c277cb084e-var-lib-kubelet\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586133 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-os-release\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586159 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-socket-dir-parent\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-daemon-config\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586184 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-etc-kubernetes\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586218 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h5fh\" (UniqueName: \"kubernetes.io/projected/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-kube-api-access-5h5fh\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586228 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-multus-socket-dir-parent\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586219 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-etc-kubernetes\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586229 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-os-release\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586292 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-system-cni-dir\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586325 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586330 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5vhm\" (UniqueName: \"kubernetes.io/projected/6309fe63-fdc2-48be-91f9-cffabda031de-kube-api-access-b5vhm\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586330 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6309fe63-fdc2-48be-91f9-cffabda031de-system-cni-dir\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586372 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4866d76f-1de4-4d70-a6b6-18c277cb084e-tmp\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586386 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6309fe63-fdc2-48be-91f9-cffabda031de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586397 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.586421 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-tuned\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.586509 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:48.587757 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.586566 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:49.086549909 +0000 UTC m=+3.077852551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:48.588666 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.588644 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4866d76f-1de4-4d70-a6b6-18c277cb084e-tmp\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.588666 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.588657 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4866d76f-1de4-4d70-a6b6-18c277cb084e-etc-tuned\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.592480 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.592408 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:48.592480 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.592432 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:48.592480 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.592445 2553 projected.go:196] Error preparing data for projected volume kube-api-access-v4zgb for pod openshift-network-diagnostics/network-check-target-2nfdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:48.592682 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.592511 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb podName:ac52ae24-0231-4da7-b7fd-0acf57161254 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:49.092494358 +0000 UTC m=+3.083797018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v4zgb" (UniqueName: "kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb") pod "network-check-target-2nfdt" (UID: "ac52ae24-0231-4da7-b7fd-0acf57161254") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:48.593520 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.593499 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc5rr\" (UniqueName: \"kubernetes.io/projected/a7fbb3c9-f5fb-4528-bd65-f8675caced84-kube-api-access-rc5rr\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:48.594562 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.594539 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5vhm\" (UniqueName: \"kubernetes.io/projected/6309fe63-fdc2-48be-91f9-cffabda031de-kube-api-access-b5vhm\") pod \"multus-additional-cni-plugins-jmznj\" (UID: \"6309fe63-fdc2-48be-91f9-cffabda031de\") " pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.595141 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.595123 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvnld\" (UniqueName: \"kubernetes.io/projected/4866d76f-1de4-4d70-a6b6-18c277cb084e-kube-api-access-hvnld\") pod \"tuned-sps5j\" (UID: \"4866d76f-1de4-4d70-a6b6-18c277cb084e\") " pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.595230 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.595182 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h5fh\" (UniqueName: \"kubernetes.io/projected/fdd139f8-e13b-4112-b7e3-2ee1d65dc66c-kube-api-access-5h5fh\") pod \"multus-4mh5x\" (UID: \"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c\") " pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.676034 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.675965 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xh6hq" Jun 10 16:44:48.682932 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.682892 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" Jun 10 16:44:48.691568 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.691550 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4d8bd" Jun 10 16:44:48.699112 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.699092 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:44:48.704588 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.704571 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:44:48.710033 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.710011 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sfl8c" Jun 10 16:44:48.715762 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.715747 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sps5j" Jun 10 16:44:48.720317 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.720300 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jmznj" Jun 10 16:44:48.724785 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.724766 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4mh5x" Jun 10 16:44:48.730350 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.728468 2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 16:44:48.989863 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:48.989829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:48.990010 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.989988 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:48.990064 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:48.990044 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret podName:a1cfb4be-8bf2-43ac-85b8-4d881a636eb4 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:49.990030663 +0000 UTC m=+3.981333301 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret") pod "global-pull-secret-syncer-9c5cl" (UID: "a1cfb4be-8bf2-43ac-85b8-4d881a636eb4") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:49.090258 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.090235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:49.090430 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.090397 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:49.090482 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.090469 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.090449356 +0000 UTC m=+4.081752006 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:49.090802 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.090785 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc742d1a6_a2f8_4398_9fe9_9dbcfa7e99f1.slice/crio-6e72419728a5ac93988665e8cd668efd94777ded23106a92351af3b5cb3ed31e WatchSource:0}: Error finding container 6e72419728a5ac93988665e8cd668efd94777ded23106a92351af3b5cb3ed31e: Status 404 returned error can't find the container with id 6e72419728a5ac93988665e8cd668efd94777ded23106a92351af3b5cb3ed31e Jun 10 16:44:49.091894 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.091873 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdd139f8_e13b_4112_b7e3_2ee1d65dc66c.slice/crio-04fb4b8af82f02340eaae53c37557016bab75a6ce39a6e29c2cc1f24bacf83ae WatchSource:0}: Error finding container 04fb4b8af82f02340eaae53c37557016bab75a6ce39a6e29c2cc1f24bacf83ae: Status 404 returned error can't find the container with id 04fb4b8af82f02340eaae53c37557016bab75a6ce39a6e29c2cc1f24bacf83ae Jun 10 16:44:49.092868 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.092819 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cda8b7c_0c33_458a_bbb8_c3ac1a402868.slice/crio-7162f045f567b29d50739ef0da21ff11f544a0e110fea19b5b20dd9bdb0ed894 WatchSource:0}: Error finding container 7162f045f567b29d50739ef0da21ff11f544a0e110fea19b5b20dd9bdb0ed894: Status 404 returned error can't find the container with id 7162f045f567b29d50739ef0da21ff11f544a0e110fea19b5b20dd9bdb0ed894 Jun 10 16:44:49.096999 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.096983 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2ea954_31aa_47f4_bb61_480edd611228.slice/crio-08db9a9c9d6f82260d7f778a84b2159a93c83ded80704492ab5add6aa1a264f3 WatchSource:0}: Error finding container 08db9a9c9d6f82260d7f778a84b2159a93c83ded80704492ab5add6aa1a264f3: Status 404 returned error can't find the container with id 08db9a9c9d6f82260d7f778a84b2159a93c83ded80704492ab5add6aa1a264f3 Jun 10 16:44:49.118008 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.117987 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6309fe63_fdc2_48be_91f9_cffabda031de.slice/crio-47d631bd6dc020c1cf9d68d5c553f17ba7864a071da76dce9007fa84ba5d0e70 WatchSource:0}: Error finding container 47d631bd6dc020c1cf9d68d5c553f17ba7864a071da76dce9007fa84ba5d0e70: Status 404 returned error can't find the container with id 47d631bd6dc020c1cf9d68d5c553f17ba7864a071da76dce9007fa84ba5d0e70 Jun 10 16:44:49.119221 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.119183 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e25393_8e4b_44b5_8369_0adfec527a9c.slice/crio-3758a751a4f4adea091796c581abcde7ca2fa339f088b50ac9d4f20e7adf4ba2 WatchSource:0}: Error finding container 3758a751a4f4adea091796c581abcde7ca2fa339f088b50ac9d4f20e7adf4ba2: Status 404 returned error can't find the container with id 3758a751a4f4adea091796c581abcde7ca2fa339f088b50ac9d4f20e7adf4ba2 Jun 10 16:44:49.119829 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.119806 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4866d76f_1de4_4d70_a6b6_18c277cb084e.slice/crio-ca8f9590a5bd57edb4a990f5156e869aa29277424d80d18a51de6ed28be8aaf0 WatchSource:0}: Error finding container ca8f9590a5bd57edb4a990f5156e869aa29277424d80d18a51de6ed28be8aaf0: Status 404 returned error can't find the container with id ca8f9590a5bd57edb4a990f5156e869aa29277424d80d18a51de6ed28be8aaf0 Jun 10 16:44:49.121578 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.121551 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f70d9be_a2e5_4082_aae2_76d968910a9e.slice/crio-17137ec7fb1a938ae26891a14efd274c0192858ece13dfac28d9386609d42ba1 WatchSource:0}: Error finding container 17137ec7fb1a938ae26891a14efd274c0192858ece13dfac28d9386609d42ba1: Status 404 returned error can't find the container with id 17137ec7fb1a938ae26891a14efd274c0192858ece13dfac28d9386609d42ba1 Jun 10 16:44:49.122321 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:44:49.122298 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32430c61_cd32_4363_a0e0_12385778222c.slice/crio-75b4da3e0fd463423c0e7c9689c40e55cfbf3a036f039beb82c1909138450c8f WatchSource:0}: Error finding container 75b4da3e0fd463423c0e7c9689c40e55cfbf3a036f039beb82c1909138450c8f: Status 404 returned error can't find the container with id 75b4da3e0fd463423c0e7c9689c40e55cfbf3a036f039beb82c1909138450c8f Jun 10 16:44:49.191258 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.191150 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:49.191341 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.191309 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:49.191341 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.191326 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:49.191341 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.191338 2553 projected.go:196] Error preparing data for projected volume kube-api-access-v4zgb for pod openshift-network-diagnostics/network-check-target-2nfdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:49.191455 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.191388 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb podName:ac52ae24-0231-4da7-b7fd-0acf57161254 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:50.191375418 +0000 UTC m=+4.182678052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4zgb" (UniqueName: "kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb") pod "network-check-target-2nfdt" (UID: "ac52ae24-0231-4da7-b7fd-0acf57161254") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:49.416265 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.416202 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 16:39:48 +0000 UTC" deadline="2028-01-24 04:05:43.63460944 +0000 UTC" Jun 10 16:44:49.416265 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.416256 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14219h20m54.218356689s" Jun 10 16:44:49.432730 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.432703 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:49.432873 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.432825 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:44:49.443589 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.442954 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" event={"ID":"485c6d743a449b1b2f8c2fa7eb09fd53","Type":"ContainerStarted","Data":"7a777d5fb1acb39e14d327d941a2bb52838db3daf0b4cb34635abbb3c94dc3e3"} Jun 10 16:44:49.445613 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.445587 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xh6hq" event={"ID":"32430c61-cd32-4363-a0e0-12385778222c","Type":"ContainerStarted","Data":"75b4da3e0fd463423c0e7c9689c40e55cfbf3a036f039beb82c1909138450c8f"} Jun 10 16:44:49.447882 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.447771 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsflw" event={"ID":"0f70d9be-a2e5-4082-aae2-76d968910a9e","Type":"ContainerStarted","Data":"17137ec7fb1a938ae26891a14efd274c0192858ece13dfac28d9386609d42ba1"} Jun 10 16:44:49.451054 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.450994 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sps5j" event={"ID":"4866d76f-1de4-4d70-a6b6-18c277cb084e","Type":"ContainerStarted","Data":"ca8f9590a5bd57edb4a990f5156e869aa29277424d80d18a51de6ed28be8aaf0"} Jun 10 16:44:49.452458 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.452427 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4d8bd" event={"ID":"30e25393-8e4b-44b5-8369-0adfec527a9c","Type":"ContainerStarted","Data":"3758a751a4f4adea091796c581abcde7ca2fa339f088b50ac9d4f20e7adf4ba2"} Jun 10 16:44:49.453964 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.453929 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sfl8c" event={"ID":"dc2ea954-31aa-47f4-bb61-480edd611228","Type":"ContainerStarted","Data":"08db9a9c9d6f82260d7f778a84b2159a93c83ded80704492ab5add6aa1a264f3"} Jun 10 16:44:49.462501 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.462250 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" event={"ID":"886f69e135aed4c8da242a0cae9e59d4","Type":"ContainerStarted","Data":"97f4e84cac46c71541cf33dd98bc36d1a0b96027c4aed924721220796ce4b66d"} Jun 10 16:44:49.468647 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.468599 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerStarted","Data":"47d631bd6dc020c1cf9d68d5c553f17ba7864a071da76dce9007fa84ba5d0e70"} Jun 10 16:44:49.472517 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.472493 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"7162f045f567b29d50739ef0da21ff11f544a0e110fea19b5b20dd9bdb0ed894"} Jun 10 16:44:49.477070 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.476156 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-59.ec2.internal" podStartSLOduration=2.476140996 podStartE2EDuration="2.476140996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:44:49.476103118 +0000 UTC m=+3.467405788" watchObservedRunningTime="2026-06-10 16:44:49.476140996 +0000 UTC m=+3.467443653" Jun 10 16:44:49.477070 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.476451 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4mh5x" event={"ID":"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c","Type":"ContainerStarted","Data":"04fb4b8af82f02340eaae53c37557016bab75a6ce39a6e29c2cc1f24bacf83ae"} Jun 10 16:44:49.481430 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.481372 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" event={"ID":"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1","Type":"ContainerStarted","Data":"6e72419728a5ac93988665e8cd668efd94777ded23106a92351af3b5cb3ed31e"} Jun 10 16:44:49.996401 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:49.996355 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:49.996583 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.996561 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:49.996649 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:49.996624 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret podName:a1cfb4be-8bf2-43ac-85b8-4d881a636eb4 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:51.996606053 +0000 UTC m=+5.987908709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret") pod "global-pull-secret-syncer-9c5cl" (UID: "a1cfb4be-8bf2-43ac-85b8-4d881a636eb4") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:50.097444 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.097407 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:50.097628 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.097591 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:50.097688 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.097655 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:52.097636497 +0000 UTC m=+6.088939145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:50.197928 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.197868 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:50.198114 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.198064 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:50.198114 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.198092 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:50.198114 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.198105 2553 projected.go:196] Error preparing data for projected volume kube-api-access-v4zgb for pod openshift-network-diagnostics/network-check-target-2nfdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:50.198264 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.198165 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb podName:ac52ae24-0231-4da7-b7fd-0acf57161254 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:52.198146222 +0000 UTC m=+6.189448857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4zgb" (UniqueName: "kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb") pod "network-check-target-2nfdt" (UID: "ac52ae24-0231-4da7-b7fd-0acf57161254") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:50.419453 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.419365 2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 16:39:48 +0000 UTC" deadline="2028-03-10 21:07:03.939508388 +0000 UTC" Jun 10 16:44:50.419453 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.419406 2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15340h22m13.520106586s" Jun 10 16:44:50.434389 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.434028 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:50.434389 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.434146 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:44:50.434389 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.434193 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:50.434389 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:50.434313 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:44:50.493877 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.493193 2553 generic.go:356] "Generic (PLEG): container finished" podID="485c6d743a449b1b2f8c2fa7eb09fd53" containerID="7a777d5fb1acb39e14d327d941a2bb52838db3daf0b4cb34635abbb3c94dc3e3" exitCode=0 Jun 10 16:44:50.493877 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:50.493298 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" event={"ID":"485c6d743a449b1b2f8c2fa7eb09fd53","Type":"ContainerDied","Data":"7a777d5fb1acb39e14d327d941a2bb52838db3daf0b4cb34635abbb3c94dc3e3"} Jun 10 16:44:51.433388 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:51.433345 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:51.433815 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:51.433476 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:44:51.512964 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:51.512756 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" event={"ID":"485c6d743a449b1b2f8c2fa7eb09fd53","Type":"ContainerStarted","Data":"35351d1320a8bc8e39f1e23a7f72b1ccba4c6881c7c7d2f3d871c778da1717ea"} Jun 10 16:44:51.531882 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:51.527748 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-59.ec2.internal" podStartSLOduration=4.527728011 podStartE2EDuration="4.527728011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:44:51.527395063 +0000 UTC m=+5.518697721" watchObservedRunningTime="2026-06-10 16:44:51.527728011 +0000 UTC m=+5.519030660" Jun 10 16:44:52.012163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:52.012130 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:52.012347 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.012329 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:52.012418 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.012387 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret podName:a1cfb4be-8bf2-43ac-85b8-4d881a636eb4 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:56.012369978 +0000 UTC m=+10.003672633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret") pod "global-pull-secret-syncer-9c5cl" (UID: "a1cfb4be-8bf2-43ac-85b8-4d881a636eb4") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:52.112674 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:52.112644 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:52.112822 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.112786 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:52.112858 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.112842 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:56.11282438 +0000 UTC m=+10.104127015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:52.213149 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:52.213114 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:52.213304 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.213292 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:52.213436 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.213311 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:52.213436 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.213324 2553 projected.go:196] Error preparing data for projected volume kube-api-access-v4zgb for pod openshift-network-diagnostics/network-check-target-2nfdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:52.213436 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.213386 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb podName:ac52ae24-0231-4da7-b7fd-0acf57161254 nodeName:}" failed. No retries permitted until 2026-06-10 16:44:56.213367848 +0000 UTC m=+10.204670503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4zgb" (UniqueName: "kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb") pod "network-check-target-2nfdt" (UID: "ac52ae24-0231-4da7-b7fd-0acf57161254") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:52.433618 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:52.433547 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:52.434073 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.433703 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:44:52.436338 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:52.433502 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:52.436338 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:52.436301 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:44:53.433125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:53.432665 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:53.433125 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:53.432783 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:44:54.433077 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:54.433018 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:54.433077 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:54.433060 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:54.433628 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:54.433158 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:44:54.433628 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:54.433275 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:44:55.433534 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:55.433440 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:55.433997 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:55.433572 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:44:56.044379 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:56.044340 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:56.044649 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.044557 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:56.044649 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.044613 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret podName:a1cfb4be-8bf2-43ac-85b8-4d881a636eb4 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:04.044599218 +0000 UTC m=+18.035901852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret") pod "global-pull-secret-syncer-9c5cl" (UID: "a1cfb4be-8bf2-43ac-85b8-4d881a636eb4") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:44:56.145338 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:56.145296 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:56.145508 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.145439 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:56.145508 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.145507 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:04.145487717 +0000 UTC m=+18.136790353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:44:56.246378 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:56.246189 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:56.246563 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.246397 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:44:56.246563 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.246418 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:44:56.246563 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.246431 2553 projected.go:196] Error preparing data for projected volume kube-api-access-v4zgb for pod openshift-network-diagnostics/network-check-target-2nfdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:56.246563 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.246496 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb podName:ac52ae24-0231-4da7-b7fd-0acf57161254 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:04.246478625 +0000 UTC m=+18.237781284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4zgb" (UniqueName: "kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb") pod "network-check-target-2nfdt" (UID: "ac52ae24-0231-4da7-b7fd-0acf57161254") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:44:56.433820 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:56.433738 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:56.434255 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.433868 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:44:56.434255 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:56.433976 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:56.434255 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:56.434074 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:44:57.432957 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:57.432919 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:57.433139 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:57.433058 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:44:58.433202 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:58.433160 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:44:58.433202 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:58.433207 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:44:58.433644 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:58.433335 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:44:58.433644 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:58.433446 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:44:59.433719 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:44:59.433642 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:44:59.434142 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:44:59.433774 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:00.433615 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:00.433582 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:00.433615 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:00.433625 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:00.434167 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:00.433724 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:00.434167 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:00.433845 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:01.432680 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:01.432647 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:01.432851 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:01.432770 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:02.436025 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:02.435998 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:02.436403 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:02.436001 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:02.436403 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:02.436101 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:02.436403 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:02.436180 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:03.433756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:03.433721 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:03.433922 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:03.433853 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:04.103461 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:04.103425 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:04.103886 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.103596 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:04.103886 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.103675 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret podName:a1cfb4be-8bf2-43ac-85b8-4d881a636eb4 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:20.103654013 +0000 UTC m=+34.094956663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret") pod "global-pull-secret-syncer-9c5cl" (UID: "a1cfb4be-8bf2-43ac-85b8-4d881a636eb4") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:04.204631 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:04.204596 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:04.204854 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.204777 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:04.204854 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.204842 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:20.204825996 +0000 UTC m=+34.196128631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:04.305183 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:04.305147 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:04.305377 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.305299 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:45:04.305377 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.305322 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:45:04.305377 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.305334 2553 projected.go:196] Error preparing data for projected volume kube-api-access-v4zgb for pod openshift-network-diagnostics/network-check-target-2nfdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:04.305570 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.305395 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb podName:ac52ae24-0231-4da7-b7fd-0acf57161254 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:20.305376478 +0000 UTC m=+34.296679113 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4zgb" (UniqueName: "kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb") pod "network-check-target-2nfdt" (UID: "ac52ae24-0231-4da7-b7fd-0acf57161254") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:04.433210 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:04.433111 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:04.433472 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.433247 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:04.433472 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:04.433302 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:04.433472 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:04.433407 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:05.432894 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:05.432862 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:05.433458 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:05.432985 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:06.434428 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:06.434393 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:06.434862 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:06.434507 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:06.434862 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:06.434577 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:06.434862 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:06.434680 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:07.435103 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.434655 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:07.435103 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:07.434771 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:07.545831 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.545681 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" event={"ID":"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1","Type":"ContainerStarted","Data":"739cdbae9c0c5daa5ceb802d22f62af58a4088732c1e9fe0b196a850ca0f8948"} Jun 10 16:45:07.547662 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.547568 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xh6hq" event={"ID":"32430c61-cd32-4363-a0e0-12385778222c","Type":"ContainerStarted","Data":"68057854e25d935947030eef6495d2648b75442e8a56a6fc13096071fe0720da"} Jun 10 16:45:07.549502 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.549473 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tsflw" event={"ID":"0f70d9be-a2e5-4082-aae2-76d968910a9e","Type":"ContainerStarted","Data":"0be3eec67985550d663c143bfd9bfb833f3ce23eb8c1927d159ef8f7eaeb5666"} Jun 10 16:45:07.551139 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.551119 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sps5j" event={"ID":"4866d76f-1de4-4d70-a6b6-18c277cb084e","Type":"ContainerStarted","Data":"083a2dc8dbae1b92b6170790fa6c61ab3d76e7e635fde3475c9d4a0c62b79d3c"} Jun 10 16:45:07.552343 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.552306 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sfl8c" event={"ID":"dc2ea954-31aa-47f4-bb61-480edd611228","Type":"ContainerStarted","Data":"1648b6979bdb7b74eedd7167c5a771d8f6f81298d32af54c48d7025ac9cadc0b"} Jun 10 16:45:07.553495 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.553475 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerStarted","Data":"4e1a8843d89c49f0865a8e295c2b91c1c5d79be4b044bb004c183569d6d8af63"} Jun 10 16:45:07.554948 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.554929 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"21cd4959b90c597f775ec657f015b70265b3e531f588c1a18359a690402055d4"} Jun 10 16:45:07.559494 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.559437 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xh6hq" podStartSLOduration=3.47365533 podStartE2EDuration="21.5594221s" totalImagesPullingTime="18.08576677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.559311904 +0000 UTC m=+21.550614556" watchObservedRunningTime="2026-06-10 16:45:07.5594221 +0000 UTC m=+21.550724756" Jun 10 16:45:07.597088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.597042 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tsflw" podStartSLOduration=3.511301371 podStartE2EDuration="21.597021697s" totalImagesPullingTime="18.085720326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.596348759 +0000 UTC m=+21.587651436" watchObservedRunningTime="2026-06-10 16:45:07.597021697 +0000 UTC m=+21.588324356" Jun 10 16:45:07.611844 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.611804 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sfl8c" podStartSLOduration=3.491885527 podStartE2EDuration="21.611790058s" totalImagesPullingTime="18.119904531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.611391841 +0000 UTC m=+21.602694497" watchObservedRunningTime="2026-06-10 16:45:07.611790058 +0000 UTC m=+21.603092713" Jun 10 16:45:07.631741 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:07.631695 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sps5j" podStartSLOduration=3.542401485 podStartE2EDuration="21.631681803s" totalImagesPullingTime="18.089280318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:07.631308061 +0000 UTC m=+21.622610776" watchObservedRunningTime="2026-06-10 16:45:07.631681803 +0000 UTC m=+21.622984455" Jun 10 16:45:08.433466 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.433290 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:08.433608 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.433362 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:08.433608 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:08.433545 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:08.433679 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:08.433642 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:08.558645 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.558622 2553 generic.go:356] "Generic (PLEG): container finished" podID="6309fe63-fdc2-48be-91f9-cffabda031de" containerID="4e1a8843d89c49f0865a8e295c2b91c1c5d79be4b044bb004c183569d6d8af63" exitCode=0 Jun 10 16:45:08.559342 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.558698 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerDied","Data":"4e1a8843d89c49f0865a8e295c2b91c1c5d79be4b044bb004c183569d6d8af63"} Jun 10 16:45:08.561218 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.561202 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:45:08.561509 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.561478 2553 generic.go:356] "Generic (PLEG): container finished" podID="7cda8b7c-0c33-458a-bbb8-c3ac1a402868" containerID="1a5c17ebf844f8259b58ba104ed640d1069d35797310f45ddf8dc20bea3b5cf8" exitCode=1 Jun 10 16:45:08.561607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.561541 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"ef7a548ea984cb3d7757e9ecf5c5318cf4f84a90751e092a34af12e34d90e652"} Jun 10 16:45:08.561655 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.561606 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"1e6176a8163ed00a901607eb036d332ccda4d8a71d0a97db051059e2fe7b60b1"} Jun 10 16:45:08.561686 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.561654 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"9058df1ea6a0b3b16f9906b5a5030e5307e3b87602de6c83884276f662732140"} Jun 10 16:45:08.561723 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.561701 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"c23a2ee76709e1be0fa863fad917d6bc45cb77f9b702747527b4a58eaa858fa9"} Jun 10 16:45:08.561767 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.561735 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerDied","Data":"1a5c17ebf844f8259b58ba104ed640d1069d35797310f45ddf8dc20bea3b5cf8"} Jun 10 16:45:08.562740 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.562717 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4mh5x" event={"ID":"fdd139f8-e13b-4112-b7e3-2ee1d65dc66c","Type":"ContainerStarted","Data":"cfdc0af237651da318f3a0d97f03502dcf62a552edf9dc29806838a97259ab3d"} Jun 10 16:45:08.564012 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.563994 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4d8bd" event={"ID":"30e25393-8e4b-44b5-8369-0adfec527a9c","Type":"ContainerStarted","Data":"922a92ea90662faa0759d359f1573d9c1423fec2a610dc5e296bc24b73095ddd"} Jun 10 16:45:08.796797 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:08.796775 2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 16:45:09.433123 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:09.433087 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:09.433297 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:09.433219 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:09.436201 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:09.436117 2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T16:45:08.796789955Z","UUID":"3dd78f2d-b685-4e76-ae22-89670c351e43","Handler":null,"Name":"","Endpoint":""} Jun 10 16:45:09.438154 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:09.438134 2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 16:45:09.438263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:09.438176 2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 16:45:09.568652 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:09.568613 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" event={"ID":"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1","Type":"ContainerStarted","Data":"db016fb890c276b7703a90a646c20239e5840cde132f93e9bf084ae58d37dad6"} Jun 10 16:45:09.582560 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:09.582507 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4mh5x" podStartSLOduration=5.216259024 podStartE2EDuration="23.582490564s" totalImagesPullingTime="18.36623154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:08.591053206 +0000 UTC m=+22.582355862" watchObservedRunningTime="2026-06-10 16:45:09.582490564 +0000 UTC m=+23.573793221" Jun 10 16:45:09.582779 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:09.582754 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4d8bd" podStartSLOduration=5.492770934 podStartE2EDuration="23.582747921s" totalImagesPullingTime="18.089976987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:09.582184087 +0000 UTC m=+23.573486746" watchObservedRunningTime="2026-06-10 16:45:09.582747921 +0000 UTC m=+23.574050579" Jun 10 16:45:10.433618 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:10.433538 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:10.433618 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:10.433581 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:10.433813 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:10.433684 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:10.433862 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:10.433805 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:10.574834 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:10.574810 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:45:10.575313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:10.575288 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"abfb139fd7acdfb44bd9e60aed2f806ef41c75d7f98bbe95f1fc487200498b92"} Jun 10 16:45:10.577520 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:10.577490 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" event={"ID":"c742d1a6-a2f8-4398-9fe9-9dbcfa7e99f1","Type":"ContainerStarted","Data":"fc88e63f852d43a7e16cc4dd62c92ad6c645418e771bc457979b9526695fbe3d"} Jun 10 16:45:10.593088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:10.593032 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxqgs" podStartSLOduration=4.401457533 podStartE2EDuration="24.593016706s" totalImagesPullingTime="20.191559173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:10.592807492 +0000 UTC m=+24.584110148" watchObservedRunningTime="2026-06-10 16:45:10.593016706 +0000 UTC m=+24.584319361" Jun 10 16:45:11.433230 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:11.433002 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:11.433387 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:11.433327 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:11.775860 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:11.775830 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:45:11.776491 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:11.776468 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:45:12.433211 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.433186 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:12.433332 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:12.433304 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:12.433332 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.433329 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:12.433478 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:12.433426 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:12.586585 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.584102 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerStarted","Data":"3b39af44f13b6478e2ddff6c3509362106288699fc60db1a4a01a3e8f9401cd3"} Jun 10 16:45:12.590258 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.590241 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:45:12.590568 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.590546 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"06dd974c41bc09527f3128ae745980cd83e7cf1b74d3760f0b2cf16d82004bf8"} Jun 10 16:45:12.590854 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.590836 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:45:12.590938 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.590875 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:45:12.591005 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.590983 2553 scope.go:117] "RemoveContainer" containerID="1a5c17ebf844f8259b58ba104ed640d1069d35797310f45ddf8dc20bea3b5cf8" Jun 10 16:45:12.591298 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.591283 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tsflw" Jun 10 16:45:12.605369 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.605354 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:45:12.998755 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:12.998734 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:45:13.432735 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.432659 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:13.432879 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:13.432766 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:13.597060 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.596157 2553 generic.go:356] "Generic (PLEG): container finished" podID="6309fe63-fdc2-48be-91f9-cffabda031de" containerID="3b39af44f13b6478e2ddff6c3509362106288699fc60db1a4a01a3e8f9401cd3" exitCode=0 Jun 10 16:45:13.597060 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.596244 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerDied","Data":"3b39af44f13b6478e2ddff6c3509362106288699fc60db1a4a01a3e8f9401cd3"} Jun 10 16:45:13.603459 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.603430 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:45:13.604547 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.604521 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" event={"ID":"7cda8b7c-0c33-458a-bbb8-c3ac1a402868","Type":"ContainerStarted","Data":"3f7013e9c3d46ddce1f627f6d4ef528f71b6958953d085130002fe3988351678"} Jun 10 16:45:13.605022 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.605002 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:45:13.622439 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.622212 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:45:13.643092 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:13.643051 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" podStartSLOduration=9.480607981 podStartE2EDuration="27.643035745s" totalImagesPullingTime="18.162427764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:13.641680248 +0000 UTC m=+27.632982906" watchObservedRunningTime="2026-06-10 16:45:13.643035745 +0000 UTC m=+27.634338418" Jun 10 16:45:14.332179 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:14.332151 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2nfdt"] Jun 10 16:45:14.332537 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:14.332282 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:14.332537 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:14.332369 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:14.335145 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:14.335122 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7q2mx"] Jun 10 16:45:14.335265 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:14.335216 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:14.335319 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:14.335294 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:14.335877 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:14.335851 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9c5cl"] Jun 10 16:45:14.336005 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:14.335974 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:14.336085 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:14.336066 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:15.432892 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:15.432856 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:15.433275 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:15.432996 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:15.610295 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:15.610260 2553 generic.go:356] "Generic (PLEG): container finished" podID="6309fe63-fdc2-48be-91f9-cffabda031de" containerID="2e540e84270f10493c8df0b76e3f08a5bd342f19ada4f1c02e231779d9ba974e" exitCode=0 Jun 10 16:45:15.610443 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:15.610345 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerDied","Data":"2e540e84270f10493c8df0b76e3f08a5bd342f19ada4f1c02e231779d9ba974e"} Jun 10 16:45:16.437349 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:16.437094 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:16.437731 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:16.437156 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:16.437731 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:16.437388 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:16.437731 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:16.437435 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:16.614913 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:16.614873 2553 generic.go:356] "Generic (PLEG): container finished" podID="6309fe63-fdc2-48be-91f9-cffabda031de" containerID="6e4072afcbce803cab126eb2d73c195b05e55373425f5796efdc4e4486b9871c" exitCode=0 Jun 10 16:45:16.615059 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:16.614960 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerDied","Data":"6e4072afcbce803cab126eb2d73c195b05e55373425f5796efdc4e4486b9871c"} Jun 10 16:45:17.433099 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:17.433068 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:17.433259 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:17.433181 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:18.433122 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:18.433094 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:18.433821 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:18.433242 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:45:18.433821 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:18.433297 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:18.433821 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:18.433404 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2nfdt" podUID="ac52ae24-0231-4da7-b7fd-0acf57161254" Jun 10 16:45:19.433066 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:19.433029 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:19.433225 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:19.433146 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9c5cl" podUID="a1cfb4be-8bf2-43ac-85b8-4d881a636eb4" Jun 10 16:45:20.123876 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.123837 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:20.124073 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.124015 2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:20.124133 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.124092 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret podName:a1cfb4be-8bf2-43ac-85b8-4d881a636eb4 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:52.124074559 +0000 UTC m=+66.115377212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret") pod "global-pull-secret-syncer-9c5cl" (UID: "a1cfb4be-8bf2-43ac-85b8-4d881a636eb4") : object "kube-system"/"original-pull-secret" not registered Jun 10 16:45:20.224937 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.224881 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:20.225105 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.225032 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:20.225105 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.225101 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:52.225081209 +0000 UTC m=+66.216383845 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 16:45:20.326305 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.326259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:20.326469 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.326423 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 16:45:20.326469 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.326447 2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 16:45:20.326469 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.326462 2553 projected.go:196] Error preparing data for projected volume kube-api-access-v4zgb for pod openshift-network-diagnostics/network-check-target-2nfdt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:20.326627 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.326530 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb podName:ac52ae24-0231-4da7-b7fd-0acf57161254 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:52.326511654 +0000 UTC m=+66.317814292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v4zgb" (UniqueName: "kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb") pod "network-check-target-2nfdt" (UID: "ac52ae24-0231-4da7-b7fd-0acf57161254") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 16:45:20.334158 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.334135 2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-59.ec2.internal" event="NodeReady" Jun 10 16:45:20.334286 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.334268 2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 16:45:20.376131 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.376095 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rqszt"] Jun 10 16:45:20.389558 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.389458 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mfpx7"] Jun 10 16:45:20.389755 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.389720 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.392210 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.392186 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 16:45:20.392315 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.392195 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 16:45:20.392315 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.392246 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xq2hm\"" Jun 10 16:45:20.405376 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.405350 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rqszt"] Jun 10 16:45:20.405489 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.405392 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfpx7"] Jun 10 16:45:20.405489 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.405454 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.407735 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.407713 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 16:45:20.407879 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.407863 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 16:45:20.407974 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.407929 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6lxlw\"" Jun 10 16:45:20.407974 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.407966 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 16:45:20.433094 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.433070 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:20.433094 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.433084 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:20.436047 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.436026 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxq5w\"" Jun 10 16:45:20.436488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.436129 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 16:45:20.436488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.436370 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldbtp\"" Jun 10 16:45:20.436488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.436372 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 16:45:20.436488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.436446 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 16:45:20.528125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.528046 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-774s7\" (UniqueName: \"kubernetes.io/projected/a22a3418-26ff-47a4-a414-df0c496772a4-kube-api-access-774s7\") pod \"ingress-canary-mfpx7\" (UID: \"a22a3418-26ff-47a4-a414-df0c496772a4\") " pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.528125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.528100 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44cgq\" (UniqueName: \"kubernetes.io/projected/26987bde-f9c2-429f-aad6-87f7c4f6dd64-kube-api-access-44cgq\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.528321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.528130 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26987bde-f9c2-429f-aad6-87f7c4f6dd64-tmp-dir\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.528321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.528194 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.528321 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.528276 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a22a3418-26ff-47a4-a414-df0c496772a4-cert\") pod \"ingress-canary-mfpx7\" (UID: \"a22a3418-26ff-47a4-a414-df0c496772a4\") " pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.528446 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.528327 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26987bde-f9c2-429f-aad6-87f7c4f6dd64-config-volume\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.628661 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.628633 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26987bde-f9c2-429f-aad6-87f7c4f6dd64-tmp-dir\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.628823 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.628669 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.628823 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.628695 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a22a3418-26ff-47a4-a414-df0c496772a4-cert\") pod \"ingress-canary-mfpx7\" (UID: \"a22a3418-26ff-47a4-a414-df0c496772a4\") " pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.628823 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.628709 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26987bde-f9c2-429f-aad6-87f7c4f6dd64-config-volume\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.628823 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.628734 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-774s7\" (UniqueName: \"kubernetes.io/projected/a22a3418-26ff-47a4-a414-df0c496772a4-kube-api-access-774s7\") pod \"ingress-canary-mfpx7\" (UID: \"a22a3418-26ff-47a4-a414-df0c496772a4\") " pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.628823 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.628760 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44cgq\" (UniqueName: \"kubernetes.io/projected/26987bde-f9c2-429f-aad6-87f7c4f6dd64-kube-api-access-44cgq\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.628823 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.628799 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:20.629112 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:20.628868 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:21.128848821 +0000 UTC m=+35.120151469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:45:20.629167 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.629119 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/26987bde-f9c2-429f-aad6-87f7c4f6dd64-tmp-dir\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.629330 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.629310 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/26987bde-f9c2-429f-aad6-87f7c4f6dd64-config-volume\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.632833 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.632796 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a22a3418-26ff-47a4-a414-df0c496772a4-cert\") pod \"ingress-canary-mfpx7\" (UID: \"a22a3418-26ff-47a4-a414-df0c496772a4\") " pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.637798 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.637773 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44cgq\" (UniqueName: \"kubernetes.io/projected/26987bde-f9c2-429f-aad6-87f7c4f6dd64-kube-api-access-44cgq\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:20.638084 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.638067 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-774s7\" (UniqueName: \"kubernetes.io/projected/a22a3418-26ff-47a4-a414-df0c496772a4-kube-api-access-774s7\") pod \"ingress-canary-mfpx7\" (UID: \"a22a3418-26ff-47a4-a414-df0c496772a4\") " pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.713622 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.713599 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mfpx7" Jun 10 16:45:20.957829 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:20.957793 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mfpx7"] Jun 10 16:45:20.960551 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:45:20.960522 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda22a3418_26ff_47a4_a414_df0c496772a4.slice/crio-9db297c2657351c584642731f1175966eab20195ad838ca4925c16beddc5fef5 WatchSource:0}: Error finding container 9db297c2657351c584642731f1175966eab20195ad838ca4925c16beddc5fef5: Status 404 returned error can't find the container with id 9db297c2657351c584642731f1175966eab20195ad838ca4925c16beddc5fef5 Jun 10 16:45:21.132635 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:21.132606 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:21.132771 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:21.132756 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:21.132825 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:21.132816 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:22.132798557 +0000 UTC m=+36.124101207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:45:21.433374 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:21.433300 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:21.436041 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:21.436020 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 16:45:21.629066 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:21.629028 2553 generic.go:356] "Generic (PLEG): container finished" podID="6309fe63-fdc2-48be-91f9-cffabda031de" containerID="8edd32d334bbcb032f8513cab1e716de556874068c2384c85631e0e592c8e0f9" exitCode=0 Jun 10 16:45:21.629572 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:21.629086 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerDied","Data":"8edd32d334bbcb032f8513cab1e716de556874068c2384c85631e0e592c8e0f9"} Jun 10 16:45:21.630320 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:21.630296 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfpx7" event={"ID":"a22a3418-26ff-47a4-a414-df0c496772a4","Type":"ContainerStarted","Data":"9db297c2657351c584642731f1175966eab20195ad838ca4925c16beddc5fef5"} Jun 10 16:45:22.142919 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:22.142871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:22.143090 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:22.143013 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:22.143090 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:22.143072 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:24.143056269 +0000 UTC m=+38.134358910 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:45:22.635603 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:22.635562 2553 generic.go:356] "Generic (PLEG): container finished" podID="6309fe63-fdc2-48be-91f9-cffabda031de" containerID="56350da17461cf781716b332e8ffdc43a3d2511747f472a1938618cc257c646b" exitCode=0 Jun 10 16:45:22.636006 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:22.635626 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerDied","Data":"56350da17461cf781716b332e8ffdc43a3d2511747f472a1938618cc257c646b"} Jun 10 16:45:23.641449 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:23.641226 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jmznj" event={"ID":"6309fe63-fdc2-48be-91f9-cffabda031de","Type":"ContainerStarted","Data":"5427a176e2ecaeacc08c967018f2a3b0b64f9c7c998d2a642e47eb75d3d79c3a"} Jun 10 16:45:23.642537 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:23.642513 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mfpx7" event={"ID":"a22a3418-26ff-47a4-a414-df0c496772a4","Type":"ContainerStarted","Data":"2c8ae2ecbf8741d228deff8aeb3a779e4019002eeb283ea7254df7fc12926d62"} Jun 10 16:45:23.672758 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:23.672708 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jmznj" podStartSLOduration=10.175275864 podStartE2EDuration="37.672694487s" totalImagesPullingTime="27.497418623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:23.670917907 +0000 UTC m=+37.662220553" watchObservedRunningTime="2026-06-10 16:45:23.672694487 +0000 UTC m=+37.663997143" Jun 10 16:45:23.691237 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:23.691203 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mfpx7" podStartSLOduration=1.943306282 podStartE2EDuration="3.691191723s" totalImagesPullingTime="1.747885441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:23.690867283 +0000 UTC m=+37.682169952" watchObservedRunningTime="2026-06-10 16:45:23.691191723 +0000 UTC m=+37.682494357" Jun 10 16:45:24.157470 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:24.157434 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:24.157650 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:24.157597 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:24.157706 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:24.157678 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:28.157655931 +0000 UTC m=+42.148958579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:45:28.186357 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:28.186312 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:28.186842 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:28.186425 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:28.186842 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:28.186482 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:36.186468963 +0000 UTC m=+50.177771600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:45:36.241722 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:36.241679 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:36.242298 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:36.241810 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:36.242298 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:36.241893 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:45:52.241872329 +0000 UTC m=+66.233174982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:45:45.621312 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:45.621286 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x4jnt" Jun 10 16:45:52.151854 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.151815 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:52.154625 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.154605 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 16:45:52.166336 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.166308 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a1cfb4be-8bf2-43ac-85b8-4d881a636eb4-original-pull-secret\") pod \"global-pull-secret-syncer-9c5cl\" (UID: \"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4\") " pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:52.252505 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.252471 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:45:52.252657 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.252512 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:45:52.252710 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:52.252657 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:45:52.252746 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:52.252712 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:46:24.252695978 +0000 UTC m=+98.243998613 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:45:52.255115 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.255098 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 16:45:52.263404 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:52.263387 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 16:45:52.263482 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:45:52.263428 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:46:56.263415094 +0000 UTC m=+130.254717728 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : secret "metrics-daemon-secret" not found Jun 10 16:45:52.344440 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.344409 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9c5cl" Jun 10 16:45:52.352842 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.352817 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:52.355547 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.355532 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 16:45:52.365747 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.365730 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 16:45:52.376186 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.376161 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4zgb\" (UniqueName: \"kubernetes.io/projected/ac52ae24-0231-4da7-b7fd-0acf57161254-kube-api-access-v4zgb\") pod \"network-check-target-2nfdt\" (UID: \"ac52ae24-0231-4da7-b7fd-0acf57161254\") " pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:52.467041 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.467015 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9c5cl"] Jun 10 16:45:52.470479 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:45:52.470450 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1cfb4be_8bf2_43ac_85b8_4d881a636eb4.slice/crio-06398b016a3444fa5bbc7654faa6c6b1e36aca26b05afb4f479ea1088b00c553 WatchSource:0}: Error finding container 06398b016a3444fa5bbc7654faa6c6b1e36aca26b05afb4f479ea1088b00c553: Status 404 returned error can't find the container with id 06398b016a3444fa5bbc7654faa6c6b1e36aca26b05afb4f479ea1088b00c553 Jun 10 16:45:52.549300 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.549268 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ldbtp\"" Jun 10 16:45:52.557479 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.557455 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:52.695464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.695402 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2nfdt"] Jun 10 16:45:52.698387 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:45:52.698361 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac52ae24_0231_4da7_b7fd_0acf57161254.slice/crio-99a3ecda7c5f3ab01406b41dd44bba965fa902cd56ceb71e79455d17e057e147 WatchSource:0}: Error finding container 99a3ecda7c5f3ab01406b41dd44bba965fa902cd56ceb71e79455d17e057e147: Status 404 returned error can't find the container with id 99a3ecda7c5f3ab01406b41dd44bba965fa902cd56ceb71e79455d17e057e147 Jun 10 16:45:52.710714 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.710691 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2nfdt" event={"ID":"ac52ae24-0231-4da7-b7fd-0acf57161254","Type":"ContainerStarted","Data":"99a3ecda7c5f3ab01406b41dd44bba965fa902cd56ceb71e79455d17e057e147"} Jun 10 16:45:52.711587 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:52.711565 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9c5cl" event={"ID":"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4","Type":"ContainerStarted","Data":"06398b016a3444fa5bbc7654faa6c6b1e36aca26b05afb4f479ea1088b00c553"} Jun 10 16:45:57.725755 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:57.725714 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2nfdt" event={"ID":"ac52ae24-0231-4da7-b7fd-0acf57161254","Type":"ContainerStarted","Data":"4a1773e6e024c2ac71e84a6a9fc95ebc8c52951c200d2128f639aa354a4d7d36"} Jun 10 16:45:57.726369 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:57.725857 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:45:57.727081 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:57.727062 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9c5cl" event={"ID":"a1cfb4be-8bf2-43ac-85b8-4d881a636eb4","Type":"ContainerStarted","Data":"b56784ccdfdfbf44a21bf2d202cded93d6c202488b9b7eb44336afa432948ce6"} Jun 10 16:45:57.742517 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:45:57.742480 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2nfdt" podStartSLOduration=67.593158704 podStartE2EDuration="1m11.742468097s" totalImagesPullingTime="4.149309393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:57.741813294 +0000 UTC m=+71.733115949" watchObservedRunningTime="2026-06-10 16:45:57.742468097 +0000 UTC m=+71.733770731" Jun 10 16:46:24.264850 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:46:24.264822 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:46:24.265241 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:46:24.264952 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:46:24.265241 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:46:24.265001 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:28.264988632 +0000 UTC m=+162.256291267 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:46:28.732007 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:46:28.731975 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2nfdt" Jun 10 16:46:28.750840 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:46:28.750798 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9c5cl" podStartSLOduration=98.369276241 podStartE2EDuration="1m42.750785811s" totalImagesPullingTime="4.38150957s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:45:57.756236268 +0000 UTC m=+71.747538925" watchObservedRunningTime="2026-06-10 16:46:28.750785811 +0000 UTC m=+102.742088466" Jun 10 16:46:56.271949 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:46:56.271871 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:46:56.272436 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:46:56.272026 2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 16:46:56.272436 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:46:56.272100 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs podName:a7fbb3c9-f5fb-4528-bd65-f8675caced84 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:58.272085165 +0000 UTC m=+252.263387803 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs") pod "network-metrics-daemon-7q2mx" (UID: "a7fbb3c9-f5fb-4528-bd65-f8675caced84") : secret "metrics-daemon-secret" not found Jun 10 16:47:23.399812 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:23.399761 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rqszt" podUID="26987bde-f9c2-429f-aad6-87f7c4f6dd64" Jun 10 16:47:23.442344 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:23.442321 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7q2mx" podUID="a7fbb3c9-f5fb-4528-bd65-f8675caced84" Jun 10 16:47:23.921885 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:23.921859 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqszt" Jun 10 16:47:28.277708 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:28.277623 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:47:28.278083 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:28.277754 2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 16:47:28.278083 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:28.277819 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls podName:26987bde-f9c2-429f-aad6-87f7c4f6dd64 nodeName:}" failed. No retries permitted until 2026-06-10 16:49:30.277802133 +0000 UTC m=+284.269104787 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls") pod "dns-default-rqszt" (UID: "26987bde-f9c2-429f-aad6-87f7c4f6dd64") : secret "dns-default-metrics-tls" not found Jun 10 16:47:34.434105 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:34.434070 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:47:52.554154 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.554123 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v"] Jun 10 16:47:52.556889 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.556874 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.559565 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.559539 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5"] Jun 10 16:47:52.560363 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.560339 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 16:47:52.560512 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.560491 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 16:47:52.560694 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.560664 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.560694 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.560690 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.561376 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.561358 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-84hx2\"" Jun 10 16:47:52.563536 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.563520 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:52.565683 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.565661 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 16:47:52.565778 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.565698 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vffds\"" Jun 10 16:47:52.566015 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.566000 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.566257 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.566242 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.569956 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.569937 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v"] Jun 10 16:47:52.577767 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.577747 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5"] Jun 10 16:47:52.654358 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.654329 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7"] Jun 10 16:47:52.657297 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.657276 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv"] Jun 10 16:47:52.657408 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.657392 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" Jun 10 16:47:52.659919 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.659875 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.660177 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.660164 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64f755785-n58lj"] Jun 10 16:47:52.660284 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.660271 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.660327 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.660282 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.660715 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.660694 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dkq2v\"" Jun 10 16:47:52.662550 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.662529 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 16:47:52.662664 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.662553 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.662822 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.662807 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.663360 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.663344 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8qdw6\"" Jun 10 16:47:52.663497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.663479 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.663539 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.663528 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 16:47:52.665038 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.665020 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 16:47:52.665758 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.665742 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 16:47:52.665830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.665767 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 16:47:52.665830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.665742 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.666868 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.666855 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.666936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.666925 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 16:47:52.671460 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.671217 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7"] Jun 10 16:47:52.671460 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.671292 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xq9dq\"" Jun 10 16:47:52.672239 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.672216 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv"] Jun 10 16:47:52.673055 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.673000 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f755785-n58lj"] Jun 10 16:47:52.677390 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.677368 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc"] Jun 10 16:47:52.680099 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.680083 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:52.682460 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.682440 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 16:47:52.682762 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.682747 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 16:47:52.682868 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.682851 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 16:47:52.682985 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.682869 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9742f\"" Jun 10 16:47:52.683074 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.683059 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 16:47:52.690209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.690193 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc"] Jun 10 16:47:52.742227 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.742206 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57msm\" (UniqueName: \"kubernetes.io/projected/7a0dc229-9283-45c1-be3c-94fb6d82101c-kube-api-access-57msm\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:52.742333 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.742232 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26a8f4-0bb6-4c15-bf8c-da123805f479-config\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.742333 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.742278 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c26a8f4-0bb6-4c15-bf8c-da123805f479-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.742333 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.742301 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:52.742333 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.742319 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtcbx\" (UniqueName: \"kubernetes.io/projected/3c26a8f4-0bb6-4c15-bf8c-da123805f479-kube-api-access-qtcbx\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.789304 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.789276 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-94c57ccc6-8vfjh"] Jun 10 16:47:52.792130 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.792116 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.794861 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.794835 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 16:47:52.794967 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.794841 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 16:47:52.795139 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.795124 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 16:47:52.802303 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.802287 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 16:47:52.807592 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.807553 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4p9m8\"" Jun 10 16:47:52.842677 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842641 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c26a8f4-0bb6-4c15-bf8c-da123805f479-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.842842 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842681 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:52.842842 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842706 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtcbx\" (UniqueName: \"kubernetes.io/projected/3c26a8f4-0bb6-4c15-bf8c-da123805f479-kube-api-access-qtcbx\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.842842 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842753 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.842842 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842777 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.842842 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842805 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9slt\" (UniqueName: \"kubernetes.io/projected/5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d-kube-api-access-d9slt\") pod \"volume-data-source-validator-78dd696465-852k7\" (UID: \"5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" Jun 10 16:47:52.842842 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:52.842805 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 16:47:52.842842 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842832 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:52.842969 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls podName:7a0dc229-9283-45c1-be3c-94fb6d82101c nodeName:}" failed. No retries permitted until 2026-06-10 16:47:53.342954047 +0000 UTC m=+187.334256681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zx5t5" (UID: "7a0dc229-9283-45c1-be3c-94fb6d82101c") : secret "samples-operator-tls" not found Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.842992 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvqkk\" (UniqueName: \"kubernetes.io/projected/e0254392-1e3d-471e-8872-e0f0e1a99e5b-kube-api-access-zvqkk\") pod \"managed-serviceaccount-addon-agent-665895f4b-xfjgc\" (UID: \"e0254392-1e3d-471e-8872-e0f0e1a99e5b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843025 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57msm\" (UniqueName: \"kubernetes.io/projected/7a0dc229-9283-45c1-be3c-94fb6d82101c-kube-api-access-57msm\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26a8f4-0bb6-4c15-bf8c-da123805f479-config\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843067 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4jh\" (UniqueName: \"kubernetes.io/projected/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-kube-api-access-wm4jh\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843084 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0254392-1e3d-471e-8872-e0f0e1a99e5b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665895f4b-xfjgc\" (UID: \"e0254392-1e3d-471e-8872-e0f0e1a99e5b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843158 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-default-certificate\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.843192 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843187 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-stats-auth\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.843477 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843209 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-727vp\" (UniqueName: \"kubernetes.io/projected/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-kube-api-access-727vp\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.843477 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843249 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.843538 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.843495 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c26a8f4-0bb6-4c15-bf8c-da123805f479-config\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.844848 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.844830 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c26a8f4-0bb6-4c15-bf8c-da123805f479-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.862114 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.862092 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtcbx\" (UniqueName: \"kubernetes.io/projected/3c26a8f4-0bb6-4c15-bf8c-da123805f479-kube-api-access-qtcbx\") pod \"service-ca-operator-6bc5ff68f5-t5s2v\" (UID: \"3c26a8f4-0bb6-4c15-bf8c-da123805f479\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.864417 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.864387 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57msm\" (UniqueName: \"kubernetes.io/projected/7a0dc229-9283-45c1-be3c-94fb6d82101c-kube-api-access-57msm\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:52.870013 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.869977 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" Jun 10 16:47:52.884844 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.884821 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-94c57ccc6-8vfjh"] Jun 10 16:47:52.943819 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.943793 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d2be2c-05fa-4d14-8903-95bbdf695fef-ca-trust-extracted\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.943998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.943828 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-default-certificate\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.943998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.943847 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-stats-auth\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.943998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.943923 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9slt\" (UniqueName: \"kubernetes.io/projected/5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d-kube-api-access-d9slt\") pod \"volume-data-source-validator-78dd696465-852k7\" (UID: \"5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" Jun 10 16:47:52.943998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.943963 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-trusted-ca\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.943998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.943995 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-certificates\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944030 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4jh\" (UniqueName: \"kubernetes.io/projected/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-kube-api-access-wm4jh\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944063 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0254392-1e3d-471e-8872-e0f0e1a99e5b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665895f4b-xfjgc\" (UID: \"e0254392-1e3d-471e-8872-e0f0e1a99e5b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944079 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944102 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf74j\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-kube-api-access-jf74j\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944116 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-image-registry-private-configuration\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944138 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-727vp\" (UniqueName: \"kubernetes.io/projected/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-kube-api-access-727vp\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944157 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944193 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-bound-sa-token\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944211 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvqkk\" (UniqueName: \"kubernetes.io/projected/e0254392-1e3d-471e-8872-e0f0e1a99e5b-kube-api-access-zvqkk\") pod \"managed-serviceaccount-addon-agent-665895f4b-xfjgc\" (UID: \"e0254392-1e3d-471e-8872-e0f0e1a99e5b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:52.944263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.944249 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-installation-pull-secrets\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:52.944850 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:52.944581 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:52.944850 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:52.944647 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 16:47:52.944850 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:52.944665 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls podName:f4a4afe3-1bc4-494e-8e86-1a044ccf1b86 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:53.444645978 +0000 UTC m=+187.435948613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qbfwv" (UID: "f4a4afe3-1bc4-494e-8e86-1a044ccf1b86") : secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:52.944850 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:52.944723 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:53.44470554 +0000 UTC m=+187.436008175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : secret "router-metrics-certs-default" not found Jun 10 16:47:52.945070 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:52.944982 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:53.444965929 +0000 UTC m=+187.436268582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : configmap references non-existent config key: service-ca.crt Jun 10 16:47:52.945509 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.945466 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.947404 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.947379 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-stats-auth\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.948207 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.948174 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-default-certificate\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.949093 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.949071 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e0254392-1e3d-471e-8872-e0f0e1a99e5b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-665895f4b-xfjgc\" (UID: \"e0254392-1e3d-471e-8872-e0f0e1a99e5b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:52.953181 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.953157 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvqkk\" (UniqueName: \"kubernetes.io/projected/e0254392-1e3d-471e-8872-e0f0e1a99e5b-kube-api-access-zvqkk\") pod \"managed-serviceaccount-addon-agent-665895f4b-xfjgc\" (UID: \"e0254392-1e3d-471e-8872-e0f0e1a99e5b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:52.953332 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.953315 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9slt\" (UniqueName: \"kubernetes.io/projected/5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d-kube-api-access-d9slt\") pod \"volume-data-source-validator-78dd696465-852k7\" (UID: \"5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" Jun 10 16:47:52.953725 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.953707 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4jh\" (UniqueName: \"kubernetes.io/projected/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-kube-api-access-wm4jh\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:52.954100 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.954083 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-727vp\" (UniqueName: \"kubernetes.io/projected/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-kube-api-access-727vp\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:52.966721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.966702 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" Jun 10 16:47:52.991474 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.991439 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v"] Jun 10 16:47:52.994879 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:47:52.994856 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c26a8f4_0bb6_4c15_bf8c_da123805f479.slice/crio-407296d8f83680c263b13a550b52c2e126dcdd0b263308c9e2f822cabb227aba WatchSource:0}: Error finding container 407296d8f83680c263b13a550b52c2e126dcdd0b263308c9e2f822cabb227aba: Status 404 returned error can't find the container with id 407296d8f83680c263b13a550b52c2e126dcdd0b263308c9e2f822cabb227aba Jun 10 16:47:52.997988 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:52.997970 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" Jun 10 16:47:53.045199 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045164 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-trusted-ca\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.045310 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-certificates\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.045310 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045285 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf74j\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-kube-api-access-jf74j\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.045385 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045312 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-image-registry-private-configuration\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.045385 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045379 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-bound-sa-token\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.045447 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045405 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.045447 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-installation-pull-secrets\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.045505 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045458 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d2be2c-05fa-4d14-8903-95bbdf695fef-ca-trust-extracted\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.046008 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.045845 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d2be2c-05fa-4d14-8903-95bbdf695fef-ca-trust-extracted\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.047690 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.047010 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-trusted-ca\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.047690 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.047100 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-certificates\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.047690 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.047019 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:47:53.047690 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.047189 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94c57ccc6-8vfjh: secret "image-registry-tls" not found Jun 10 16:47:53.047690 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.047251 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls podName:e0d2be2c-05fa-4d14-8903-95bbdf695fef nodeName:}" failed. No retries permitted until 2026-06-10 16:47:53.54722109 +0000 UTC m=+187.538523733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls") pod "image-registry-94c57ccc6-8vfjh" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef") : secret "image-registry-tls" not found Jun 10 16:47:53.049579 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.049171 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-image-registry-private-configuration\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.050995 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.050951 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-installation-pull-secrets\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.055702 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.055667 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf74j\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-kube-api-access-jf74j\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.055988 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.055936 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-bound-sa-token\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.100800 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.100766 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7"] Jun 10 16:47:53.103624 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:47:53.103599 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfd4bb3_ac0f_4358_afb4_a91df0d4b42d.slice/crio-cacdd33fe7c094f0bae15b5336e6fa590a69a1fd242245b971e3683e9825c29b WatchSource:0}: Error finding container cacdd33fe7c094f0bae15b5336e6fa590a69a1fd242245b971e3683e9825c29b: Status 404 returned error can't find the container with id cacdd33fe7c094f0bae15b5336e6fa590a69a1fd242245b971e3683e9825c29b Jun 10 16:47:53.119112 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.119088 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc"] Jun 10 16:47:53.121570 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:47:53.121548 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0254392_1e3d_471e_8872_e0f0e1a99e5b.slice/crio-d54859b457ed60ca2362b5b6ecae419690472929f7f91e4dec74994404c576c1 WatchSource:0}: Error finding container d54859b457ed60ca2362b5b6ecae419690472929f7f91e4dec74994404c576c1: Status 404 returned error can't find the container with id d54859b457ed60ca2362b5b6ecae419690472929f7f91e4dec74994404c576c1 Jun 10 16:47:53.348506 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.348420 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:53.348645 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.348540 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 16:47:53.348645 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.348597 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls podName:7a0dc229-9283-45c1-be3c-94fb6d82101c nodeName:}" failed. No retries permitted until 2026-06-10 16:47:54.348583154 +0000 UTC m=+188.339885793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zx5t5" (UID: "7a0dc229-9283-45c1-be3c-94fb6d82101c") : secret "samples-operator-tls" not found Jun 10 16:47:53.449028 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.448996 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:53.449195 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.449105 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:53.449195 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.449138 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:53.449195 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.449166 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:54.449147203 +0000 UTC m=+188.440449841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : configmap references non-existent config key: service-ca.crt Jun 10 16:47:53.449347 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.449215 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 16:47:53.449347 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.449247 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:53.449347 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.449259 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:54.449245336 +0000 UTC m=+188.440547971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : secret "router-metrics-certs-default" not found Jun 10 16:47:53.449347 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.449314 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls podName:f4a4afe3-1bc4-494e-8e86-1a044ccf1b86 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:54.449297976 +0000 UTC m=+188.440600611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qbfwv" (UID: "f4a4afe3-1bc4-494e-8e86-1a044ccf1b86") : secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:53.549916 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.549863 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:53.550083 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.550045 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:47:53.550083 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.550063 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94c57ccc6-8vfjh: secret "image-registry-tls" not found Jun 10 16:47:53.550204 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:53.550117 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls podName:e0d2be2c-05fa-4d14-8903-95bbdf695fef nodeName:}" failed. No retries permitted until 2026-06-10 16:47:54.550099449 +0000 UTC m=+188.541402099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls") pod "image-registry-94c57ccc6-8vfjh" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef") : secret "image-registry-tls" not found Jun 10 16:47:53.988548 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.988480 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" event={"ID":"5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d","Type":"ContainerStarted","Data":"cacdd33fe7c094f0bae15b5336e6fa590a69a1fd242245b971e3683e9825c29b"} Jun 10 16:47:53.989698 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.989665 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" event={"ID":"3c26a8f4-0bb6-4c15-bf8c-da123805f479","Type":"ContainerStarted","Data":"407296d8f83680c263b13a550b52c2e126dcdd0b263308c9e2f822cabb227aba"} Jun 10 16:47:53.991358 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:53.991303 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" event={"ID":"e0254392-1e3d-471e-8872-e0f0e1a99e5b","Type":"ContainerStarted","Data":"d54859b457ed60ca2362b5b6ecae419690472929f7f91e4dec74994404c576c1"} Jun 10 16:47:54.355185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:54.355149 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:54.355347 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.355296 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 16:47:54.355395 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.355362 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls podName:7a0dc229-9283-45c1-be3c-94fb6d82101c nodeName:}" failed. No retries permitted until 2026-06-10 16:47:56.355343767 +0000 UTC m=+190.346646405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zx5t5" (UID: "7a0dc229-9283-45c1-be3c-94fb6d82101c") : secret "samples-operator-tls" not found Jun 10 16:47:54.456029 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:54.455997 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:54.456201 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:54.456136 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:54.456201 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.456164 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:56.456142438 +0000 UTC m=+190.447445072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : configmap references non-existent config key: service-ca.crt Jun 10 16:47:54.456318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:54.456209 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:54.456318 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.456234 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:54.456318 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.456288 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls podName:f4a4afe3-1bc4-494e-8e86-1a044ccf1b86 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:56.456271573 +0000 UTC m=+190.447574208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qbfwv" (UID: "f4a4afe3-1bc4-494e-8e86-1a044ccf1b86") : secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:54.456481 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.456338 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 16:47:54.456481 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.456378 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:47:56.456365694 +0000 UTC m=+190.447668343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : secret "router-metrics-certs-default" not found Jun 10 16:47:54.556830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:54.556739 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:54.556998 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.556854 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:47:54.556998 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.556875 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94c57ccc6-8vfjh: secret "image-registry-tls" not found Jun 10 16:47:54.556998 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:54.556951 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls podName:e0d2be2c-05fa-4d14-8903-95bbdf695fef nodeName:}" failed. No retries permitted until 2026-06-10 16:47:56.556933239 +0000 UTC m=+190.548235887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls") pod "image-registry-94c57ccc6-8vfjh" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef") : secret "image-registry-tls" not found Jun 10 16:47:54.997601 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:54.997550 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" event={"ID":"5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d","Type":"ContainerStarted","Data":"db3fab0e8b2aa16a74f195acb4acb52555d11014768ffaac4fdfaae5a55b3f30"} Jun 10 16:47:54.999273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:54.999248 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" event={"ID":"3c26a8f4-0bb6-4c15-bf8c-da123805f479","Type":"ContainerStarted","Data":"e90d510bb28eaee83bc487d19b57764fa04a9a972af0bb9dc012ccedbf19f894"} Jun 10 16:47:55.019701 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:55.019654 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-852k7" podStartSLOduration=1.9497415230000001 podStartE2EDuration="3.019641393s" totalImagesPullingTime="1.06989987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:47:55.018873251 +0000 UTC m=+189.010175907" watchObservedRunningTime="2026-06-10 16:47:55.019641393 +0000 UTC m=+189.010944048" Jun 10 16:47:55.040062 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:55.040029 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" podStartSLOduration=1.215409168 podStartE2EDuration="3.040016822s" totalImagesPullingTime="1.824607654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:47:55.039483819 +0000 UTC m=+189.030786472" watchObservedRunningTime="2026-06-10 16:47:55.040016822 +0000 UTC m=+189.031319477" Jun 10 16:47:56.371086 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:56.371049 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:47:56.371513 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.371183 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 16:47:56.371513 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.371244 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls podName:7a0dc229-9283-45c1-be3c-94fb6d82101c nodeName:}" failed. No retries permitted until 2026-06-10 16:48:00.371227655 +0000 UTC m=+194.362530293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zx5t5" (UID: "7a0dc229-9283-45c1-be3c-94fb6d82101c") : secret "samples-operator-tls" not found Jun 10 16:47:56.471733 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:56.471700 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:47:56.471733 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:56.471735 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:56.471965 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:56.471764 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:47:56.471965 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.471839 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:56.471965 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.471847 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 16:47:56.471965 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.471856 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:00.47184241 +0000 UTC m=+194.463145044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : configmap references non-existent config key: service-ca.crt Jun 10 16:47:56.472151 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.472001 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls podName:f4a4afe3-1bc4-494e-8e86-1a044ccf1b86 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:00.471974514 +0000 UTC m=+194.463277154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qbfwv" (UID: "f4a4afe3-1bc4-494e-8e86-1a044ccf1b86") : secret "cluster-monitoring-operator-tls" not found Jun 10 16:47:56.472151 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.472030 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:00.47202192 +0000 UTC m=+194.463324554 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : secret "router-metrics-certs-default" not found Jun 10 16:47:56.573150 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:56.573120 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:47:56.573323 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.573288 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:47:56.573323 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.573309 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94c57ccc6-8vfjh: secret "image-registry-tls" not found Jun 10 16:47:56.573424 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:47:56.573374 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls podName:e0d2be2c-05fa-4d14-8903-95bbdf695fef nodeName:}" failed. No retries permitted until 2026-06-10 16:48:00.57335418 +0000 UTC m=+194.564656827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls") pod "image-registry-94c57ccc6-8vfjh" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef") : secret "image-registry-tls" not found Jun 10 16:47:57.006555 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:57.006519 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" event={"ID":"e0254392-1e3d-471e-8872-e0f0e1a99e5b","Type":"ContainerStarted","Data":"136588738a25090950ffb6dc841b88b0953ffddc87dbd40f21fc1d95423d9156"} Jun 10 16:47:57.022876 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:47:57.022831 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-665895f4b-xfjgc" podStartSLOduration=1.643053894 podStartE2EDuration="5.022818318s" totalImagesPullingTime="3.379764424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:47:57.021631958 +0000 UTC m=+191.012934614" watchObservedRunningTime="2026-06-10 16:47:57.022818318 +0000 UTC m=+191.014120973" Jun 10 16:48:00.406817 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:00.406777 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:48:00.407244 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.406891 2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 16:48:00.407244 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.406968 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls podName:7a0dc229-9283-45c1-be3c-94fb6d82101c nodeName:}" failed. No retries permitted until 2026-06-10 16:48:08.406955311 +0000 UTC m=+202.398257945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-zx5t5" (UID: "7a0dc229-9283-45c1-be3c-94fb6d82101c") : secret "samples-operator-tls" not found Jun 10 16:48:00.432711 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:00.432686 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sfl8c_dc2ea954-31aa-47f4-bb61-480edd611228/dns-node-resolver/0.log" Jun 10 16:48:00.507299 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:00.507267 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:48:00.507299 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:00.507304 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:00.507488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:00.507339 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:00.507488 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.507400 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 16:48:00.507488 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.507463 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls podName:f4a4afe3-1bc4-494e-8e86-1a044ccf1b86 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:08.507443437 +0000 UTC m=+202.498746071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qbfwv" (UID: "f4a4afe3-1bc4-494e-8e86-1a044ccf1b86") : secret "cluster-monitoring-operator-tls" not found Jun 10 16:48:00.507676 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.507495 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:08.507478018 +0000 UTC m=+202.498780666 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : configmap references non-existent config key: service-ca.crt Jun 10 16:48:00.507676 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.507557 2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 16:48:00.507676 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.507612 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:08.507597029 +0000 UTC m=+202.498899684 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : secret "router-metrics-certs-default" not found Jun 10 16:48:00.607894 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:00.607859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:48:00.608111 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.608022 2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 16:48:00.608111 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.608042 2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-94c57ccc6-8vfjh: secret "image-registry-tls" not found Jun 10 16:48:00.608218 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:00.608120 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls podName:e0d2be2c-05fa-4d14-8903-95bbdf695fef nodeName:}" failed. No retries permitted until 2026-06-10 16:48:08.608100012 +0000 UTC m=+202.599402663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls") pod "image-registry-94c57ccc6-8vfjh" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef") : secret "image-registry-tls" not found Jun 10 16:48:01.432398 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:01.432371 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xh6hq_32430c61-cd32-4363-a0e0-12385778222c/node-ca/0.log" Jun 10 16:48:01.832577 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:01.832547 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfpx7_a22a3418-26ff-47a4-a414-df0c496772a4/serve-healthcheck-canary/0.log" Jun 10 16:48:08.467236 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.467200 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:48:08.469510 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.469492 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7a0dc229-9283-45c1-be3c-94fb6d82101c-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-zx5t5\" (UID: \"7a0dc229-9283-45c1-be3c-94fb6d82101c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:48:08.475376 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.475358 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" Jun 10 16:48:08.568362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.568330 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:48:08.568509 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.568375 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:08.568509 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.568422 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:08.568509 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:08.568492 2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 16:48:08.568645 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:08.568573 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls podName:f4a4afe3-1bc4-494e-8e86-1a044ccf1b86 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:24.56855118 +0000 UTC m=+218.559853831 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-qbfwv" (UID: "f4a4afe3-1bc4-494e-8e86-1a044ccf1b86") : secret "cluster-monitoring-operator-tls" not found Jun 10 16:48:08.568645 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:08.568592 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle podName:8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:24.568583508 +0000 UTC m=+218.559886144 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle") pod "router-default-64f755785-n58lj" (UID: "8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9") : configmap references non-existent config key: service-ca.crt Jun 10 16:48:08.570562 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.570537 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-metrics-certs\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:08.593532 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.593507 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5"] Jun 10 16:48:08.669600 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.669578 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:48:08.671581 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.671565 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"image-registry-94c57ccc6-8vfjh\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:48:08.700513 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.700497 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:48:08.819653 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:08.819621 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-94c57ccc6-8vfjh"] Jun 10 16:48:08.822142 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:08.822119 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d2be2c_05fa_4d14_8903_95bbdf695fef.slice/crio-a927f8233bad902b936630f28796ed7b406c9d59803bd26e7c8f5446ce98941e WatchSource:0}: Error finding container a927f8233bad902b936630f28796ed7b406c9d59803bd26e7c8f5446ce98941e: Status 404 returned error can't find the container with id a927f8233bad902b936630f28796ed7b406c9d59803bd26e7c8f5446ce98941e Jun 10 16:48:09.042776 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:09.042685 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" event={"ID":"e0d2be2c-05fa-4d14-8903-95bbdf695fef","Type":"ContainerStarted","Data":"1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8"} Jun 10 16:48:09.042776 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:09.042740 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" event={"ID":"e0d2be2c-05fa-4d14-8903-95bbdf695fef","Type":"ContainerStarted","Data":"a927f8233bad902b936630f28796ed7b406c9d59803bd26e7c8f5446ce98941e"} Jun 10 16:48:09.042990 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:09.042787 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:48:09.043801 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:09.043781 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" event={"ID":"7a0dc229-9283-45c1-be3c-94fb6d82101c","Type":"ContainerStarted","Data":"66f633e183c87a22442d0ba6ef59fbeec18d5c4c40b935c8afdb8aeac683a912"} Jun 10 16:48:09.061229 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:09.061191 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" podStartSLOduration=17.061178317 podStartE2EDuration="17.061178317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:09.060222591 +0000 UTC m=+203.051525271" watchObservedRunningTime="2026-06-10 16:48:09.061178317 +0000 UTC m=+203.052480973" Jun 10 16:48:11.052125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:11.052089 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" event={"ID":"7a0dc229-9283-45c1-be3c-94fb6d82101c","Type":"ContainerStarted","Data":"2f9f6771f22a5464bbc180086cd12e1793f260d0709ee9628766b322e269f0fd"} Jun 10 16:48:11.052500 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:11.052139 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" event={"ID":"7a0dc229-9283-45c1-be3c-94fb6d82101c","Type":"ContainerStarted","Data":"62d6579654d50f1296c773d5a46e993d39b015be95f91094c524a0a827c459fa"} Jun 10 16:48:11.070055 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:11.070015 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-zx5t5" podStartSLOduration=17.561569193 podStartE2EDuration="19.070002204s" totalImagesPullingTime="1.508433011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:11.069045691 +0000 UTC m=+205.060348359" watchObservedRunningTime="2026-06-10 16:48:11.070002204 +0000 UTC m=+205.061304859" Jun 10 16:48:20.221669 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.221636 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q4rb9"] Jun 10 16:48:20.226761 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.226741 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.231718 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.231696 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 16:48:20.232116 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.232097 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 16:48:20.233174 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.233156 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 16:48:20.233272 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.233176 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 16:48:20.233272 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.233205 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q9s5x\"" Jun 10 16:48:20.234722 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.234703 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-94c57ccc6-8vfjh"] Jun 10 16:48:20.246328 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.246303 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q4rb9"] Jun 10 16:48:20.365801 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.365759 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-crio-socket\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.365984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.365830 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.365984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.365855 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.365984 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.365941 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qjfs\" (UniqueName: \"kubernetes.io/projected/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-kube-api-access-4qjfs\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.366112 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.366028 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-data-volume\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467112 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467077 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-data-volume\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467112 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467116 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-crio-socket\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467355 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467154 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467355 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467170 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467355 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467192 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qjfs\" (UniqueName: \"kubernetes.io/projected/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-kube-api-access-4qjfs\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467355 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467310 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-crio-socket\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467551 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467497 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-data-volume\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.467785 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.467762 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.469491 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.469476 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.474798 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.474750 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qjfs\" (UniqueName: \"kubernetes.io/projected/bd5be301-c516-4a29-95bf-bbdcee3ee3ac-kube-api-access-4qjfs\") pod \"insights-runtime-extractor-q4rb9\" (UID: \"bd5be301-c516-4a29-95bf-bbdcee3ee3ac\") " pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.536379 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.536347 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q4rb9" Jun 10 16:48:20.653875 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:20.653841 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q4rb9"] Jun 10 16:48:20.656872 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:20.656841 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd5be301_c516_4a29_95bf_bbdcee3ee3ac.slice/crio-18a10d0c9932d2117108c83eeb1f4029262ee9726e1e2b7ca4d36c7145075ec0 WatchSource:0}: Error finding container 18a10d0c9932d2117108c83eeb1f4029262ee9726e1e2b7ca4d36c7145075ec0: Status 404 returned error can't find the container with id 18a10d0c9932d2117108c83eeb1f4029262ee9726e1e2b7ca4d36c7145075ec0 Jun 10 16:48:21.080919 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:21.080865 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4rb9" event={"ID":"bd5be301-c516-4a29-95bf-bbdcee3ee3ac","Type":"ContainerStarted","Data":"711d1682fdc1d2ba31f56122cc5bb517b0c1e8e3b14f189f18e97d1178ccc7ce"} Jun 10 16:48:21.081078 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:21.080938 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4rb9" event={"ID":"bd5be301-c516-4a29-95bf-bbdcee3ee3ac","Type":"ContainerStarted","Data":"18a10d0c9932d2117108c83eeb1f4029262ee9726e1e2b7ca4d36c7145075ec0"} Jun 10 16:48:22.086416 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:22.086376 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4rb9" event={"ID":"bd5be301-c516-4a29-95bf-bbdcee3ee3ac","Type":"ContainerStarted","Data":"3bb114aa84c2dd765bb82f38b1424c54bdd4259359d3a1c9227686cdc7a15bf7"} Jun 10 16:48:23.091060 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:23.091023 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q4rb9" event={"ID":"bd5be301-c516-4a29-95bf-bbdcee3ee3ac","Type":"ContainerStarted","Data":"4e2ca7c1dd6a646b611ec8f3506da5861f42fcde7d7eca658bc4d79201390975"} Jun 10 16:48:23.109947 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:23.109884 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q4rb9" podStartSLOduration=0.958934073 podStartE2EDuration="3.109871588s" totalImagesPullingTime="2.150937515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 16:48:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:23.108600214 +0000 UTC m=+217.099902870" watchObservedRunningTime="2026-06-10 16:48:23.109871588 +0000 UTC m=+217.101174241" Jun 10 16:48:24.605140 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.605102 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:24.605504 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.605175 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:48:24.605697 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.605675 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9-service-ca-bundle\") pod \"router-default-64f755785-n58lj\" (UID: \"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9\") " pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:24.607342 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.607322 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f4a4afe3-1bc4-494e-8e86-1a044ccf1b86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-qbfwv\" (UID: \"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:48:24.774092 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.774053 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" Jun 10 16:48:24.779976 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.779953 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:24.902432 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.902401 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv"] Jun 10 16:48:24.904798 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:24.904775 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a4afe3_1bc4_494e_8e86_1a044ccf1b86.slice/crio-fa6625915798771738d5ecf2dccf797527e10fa44c637cd004c687fbb9fe3455 WatchSource:0}: Error finding container fa6625915798771738d5ecf2dccf797527e10fa44c637cd004c687fbb9fe3455: Status 404 returned error can't find the container with id fa6625915798771738d5ecf2dccf797527e10fa44c637cd004c687fbb9fe3455 Jun 10 16:48:24.922071 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:24.922044 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64f755785-n58lj"] Jun 10 16:48:24.924759 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:24.924735 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f5a1fec_1fb6_4dde_8c1e_84cbfb805ff9.slice/crio-dd1e8df6b73a479151cd81f4954319d6cb61e4044f6fbbc850f7b00a7398e7b9 WatchSource:0}: Error finding container dd1e8df6b73a479151cd81f4954319d6cb61e4044f6fbbc850f7b00a7398e7b9: Status 404 returned error can't find the container with id dd1e8df6b73a479151cd81f4954319d6cb61e4044f6fbbc850f7b00a7398e7b9 Jun 10 16:48:25.099435 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:25.099406 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f755785-n58lj" event={"ID":"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9","Type":"ContainerStarted","Data":"f9d813365b136ee06aa3785571aea8c2b2ccce68a71aceb06c98501a6b883ccb"} Jun 10 16:48:25.099621 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:25.099457 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64f755785-n58lj" event={"ID":"8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9","Type":"ContainerStarted","Data":"dd1e8df6b73a479151cd81f4954319d6cb61e4044f6fbbc850f7b00a7398e7b9"} Jun 10 16:48:25.100502 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:25.100469 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" event={"ID":"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86","Type":"ContainerStarted","Data":"fa6625915798771738d5ecf2dccf797527e10fa44c637cd004c687fbb9fe3455"} Jun 10 16:48:25.118377 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:25.118287 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64f755785-n58lj" podStartSLOduration=33.118269542 podStartE2EDuration="33.118269542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:25.116865345 +0000 UTC m=+219.108168015" watchObservedRunningTime="2026-06-10 16:48:25.118269542 +0000 UTC m=+219.109572199" Jun 10 16:48:25.781155 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:25.781120 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:25.783944 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:25.783901 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:26.103498 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:26.103429 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:26.104558 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:26.104536 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64f755785-n58lj" Jun 10 16:48:27.076747 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.076722 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt"] Jun 10 16:48:27.079703 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.079688 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:27.082093 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.082073 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 16:48:27.082195 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.082179 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-77czv\"" Jun 10 16:48:27.087485 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.087461 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt"] Jun 10 16:48:27.107963 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.107929 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" event={"ID":"f4a4afe3-1bc4-494e-8e86-1a044ccf1b86","Type":"ContainerStarted","Data":"5cb568225dd097f459f4bda1b9156604bf2e9eb6f162b17088392ecd55e2bf2c"} Jun 10 16:48:27.126066 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.126025 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-qbfwv" podStartSLOduration=33.416448906 podStartE2EDuration="35.126011987s" totalImagesPullingTime="1.709563081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:27.125782215 +0000 UTC m=+221.117084870" watchObservedRunningTime="2026-06-10 16:48:27.126011987 +0000 UTC m=+221.117314643" Jun 10 16:48:27.224772 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.224737 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2139d90-eb61-40a0-b29c-51c629ee2f19-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fm8zt\" (UID: \"d2139d90-eb61-40a0-b29c-51c629ee2f19\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:27.325894 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.325859 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2139d90-eb61-40a0-b29c-51c629ee2f19-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fm8zt\" (UID: \"d2139d90-eb61-40a0-b29c-51c629ee2f19\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:27.326080 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:27.326028 2553 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 10 16:48:27.326158 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:27.326106 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2139d90-eb61-40a0-b29c-51c629ee2f19-tls-certificates podName:d2139d90-eb61-40a0-b29c-51c629ee2f19 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:27.826085832 +0000 UTC m=+221.817388481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/d2139d90-eb61-40a0-b29c-51c629ee2f19-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-fm8zt" (UID: "d2139d90-eb61-40a0-b29c-51c629ee2f19") : secret "prometheus-operator-admission-webhook-tls" not found Jun 10 16:48:27.829266 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.829227 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2139d90-eb61-40a0-b29c-51c629ee2f19-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fm8zt\" (UID: \"d2139d90-eb61-40a0-b29c-51c629ee2f19\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:27.831499 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.831474 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d2139d90-eb61-40a0-b29c-51c629ee2f19-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fm8zt\" (UID: \"d2139d90-eb61-40a0-b29c-51c629ee2f19\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:27.989570 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:27.989526 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:28.124369 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:28.124339 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt"] Jun 10 16:48:28.126982 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:28.126956 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2139d90_eb61_40a0_b29c_51c629ee2f19.slice/crio-8406ddedcad124d60ab6322de57a300906aadf039e11b9f3c06c792f1fea9e36 WatchSource:0}: Error finding container 8406ddedcad124d60ab6322de57a300906aadf039e11b9f3c06c792f1fea9e36: Status 404 returned error can't find the container with id 8406ddedcad124d60ab6322de57a300906aadf039e11b9f3c06c792f1fea9e36 Jun 10 16:48:29.115467 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:29.115437 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" event={"ID":"d2139d90-eb61-40a0-b29c-51c629ee2f19","Type":"ContainerStarted","Data":"8406ddedcad124d60ab6322de57a300906aadf039e11b9f3c06c792f1fea9e36"} Jun 10 16:48:30.119327 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:30.119289 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" event={"ID":"d2139d90-eb61-40a0-b29c-51c629ee2f19","Type":"ContainerStarted","Data":"688ae0d229c93af5849ed73dd4a00017c479ef80123f9a9e9c91bd83ece79860"} Jun 10 16:48:30.119736 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:30.119368 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:30.123753 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:30.123734 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" Jun 10 16:48:30.133812 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:30.133771 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fm8zt" podStartSLOduration=2.09718011 podStartE2EDuration="3.13375863s" totalImagesPullingTime="1.03657852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:30.133229039 +0000 UTC m=+224.124531711" watchObservedRunningTime="2026-06-10 16:48:30.13375863 +0000 UTC m=+224.125061285" Jun 10 16:48:30.241117 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:30.241088 2553 patch_prober.go:28] interesting pod/image-registry-94c57ccc6-8vfjh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:48:30.241257 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:30.241134 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" podUID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:48:35.473614 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.473582 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn"] Jun 10 16:48:35.477208 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.477186 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.479809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.479786 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 16:48:35.480106 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.480088 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sw4gz\"" Jun 10 16:48:35.480706 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.480689 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 16:48:35.480792 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.480728 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 16:48:35.488599 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.488581 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wrm9j"] Jun 10 16:48:35.491398 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.491382 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.493635 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.493610 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn"] Jun 10 16:48:35.493716 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.493699 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 16:48:35.494944 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.494921 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pzk5s\"" Jun 10 16:48:35.495085 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.495066 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 16:48:35.495300 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.495286 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 16:48:35.592283 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592244 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592283 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592287 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-textfile\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592310 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-wtmp\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592370 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592522 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592475 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aae06e-c36d-40c2-8ede-f525ff228c56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.592522 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592494 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-root\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592522 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592512 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39aae06e-c36d-40c2-8ede-f525ff228c56-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.592614 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592543 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39aae06e-c36d-40c2-8ede-f525ff228c56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.592614 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-tls\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592671 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592632 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-metrics-client-ca\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592702 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592667 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8clgp\" (UniqueName: \"kubernetes.io/projected/39aae06e-c36d-40c2-8ede-f525ff228c56-kube-api-access-8clgp\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.592746 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592731 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjwhw\" (UniqueName: \"kubernetes.io/projected/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-kube-api-access-hjwhw\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.592784 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.592770 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-sys\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.693690 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693665 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.693690 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693693 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-textfile\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.693830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693708 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-wtmp\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.693830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693725 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.693830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693778 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aae06e-c36d-40c2-8ede-f525ff228c56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.693830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693801 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-root\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.693830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693827 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39aae06e-c36d-40c2-8ede-f525ff228c56-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693856 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-wtmp\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693873 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-root\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693861 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39aae06e-c36d-40c2-8ede-f525ff228c56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693938 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-tls\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693967 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-metrics-client-ca\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.693992 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8clgp\" (UniqueName: \"kubernetes.io/projected/39aae06e-c36d-40c2-8ede-f525ff228c56-kube-api-access-8clgp\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.694027 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjwhw\" (UniqueName: \"kubernetes.io/projected/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-kube-api-access-hjwhw\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.694088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.694053 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-textfile\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.694512 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.694484 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-sys\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.696940 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.695068 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39aae06e-c36d-40c2-8ede-f525ff228c56-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.696940 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.695538 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-metrics-client-ca\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.696940 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.695795 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-accelerators-collector-config\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.696940 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.695835 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-sys\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.697346 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.697320 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-tls\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.697399 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.697337 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/39aae06e-c36d-40c2-8ede-f525ff228c56-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.697447 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.697430 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aae06e-c36d-40c2-8ede-f525ff228c56-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.700208 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.700185 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.701803 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.701780 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8clgp\" (UniqueName: \"kubernetes.io/projected/39aae06e-c36d-40c2-8ede-f525ff228c56-kube-api-access-8clgp\") pod \"openshift-state-metrics-65f78d5c66-n6ztn\" (UID: \"39aae06e-c36d-40c2-8ede-f525ff228c56\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.702601 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.702578 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjwhw\" (UniqueName: \"kubernetes.io/projected/ca570bbc-7d70-4e8d-9616-f53fca08e9cf-kube-api-access-hjwhw\") pod \"node-exporter-wrm9j\" (UID: \"ca570bbc-7d70-4e8d-9616-f53fca08e9cf\") " pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.785924 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.785846 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" Jun 10 16:48:35.799938 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.799919 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wrm9j" Jun 10 16:48:35.810890 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:35.810857 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca570bbc_7d70_4e8d_9616_f53fca08e9cf.slice/crio-5e272fb01a01e2c0ced69fd2941f11ee884e7e30e399eabeae33715e9783167e WatchSource:0}: Error finding container 5e272fb01a01e2c0ced69fd2941f11ee884e7e30e399eabeae33715e9783167e: Status 404 returned error can't find the container with id 5e272fb01a01e2c0ced69fd2941f11ee884e7e30e399eabeae33715e9783167e Jun 10 16:48:35.915112 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:35.915089 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn"] Jun 10 16:48:35.917337 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:35.917312 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39aae06e_c36d_40c2_8ede_f525ff228c56.slice/crio-897e307e6d4a7b5d3ec781ef165170e80c419a7faf651e766ae73361e0281cc5 WatchSource:0}: Error finding container 897e307e6d4a7b5d3ec781ef165170e80c419a7faf651e766ae73361e0281cc5: Status 404 returned error can't find the container with id 897e307e6d4a7b5d3ec781ef165170e80c419a7faf651e766ae73361e0281cc5 Jun 10 16:48:36.139115 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.139076 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wrm9j" event={"ID":"ca570bbc-7d70-4e8d-9616-f53fca08e9cf","Type":"ContainerStarted","Data":"5e272fb01a01e2c0ced69fd2941f11ee884e7e30e399eabeae33715e9783167e"} Jun 10 16:48:36.141000 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.140975 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" event={"ID":"39aae06e-c36d-40c2-8ede-f525ff228c56","Type":"ContainerStarted","Data":"8c55354dbcecbd84fd6bc45a94a400d6be8df64df8322e8dc91f94b83af8b8db"} Jun 10 16:48:36.141154 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.141032 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" event={"ID":"39aae06e-c36d-40c2-8ede-f525ff228c56","Type":"ContainerStarted","Data":"d477e881d62744ef4d76f1f774c77ec5fe08de4a106891f42c74ba0945ff6ec6"} Jun 10 16:48:36.141154 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.141060 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" event={"ID":"39aae06e-c36d-40c2-8ede-f525ff228c56","Type":"ContainerStarted","Data":"897e307e6d4a7b5d3ec781ef165170e80c419a7faf651e766ae73361e0281cc5"} Jun 10 16:48:36.542194 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.542166 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:48:36.545963 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.545944 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.548243 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548216 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 16:48:36.548352 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548216 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 16:48:36.548352 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548218 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 16:48:36.548352 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548246 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 16:48:36.548518 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548479 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 16:48:36.548518 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548492 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qbprk\"" Jun 10 16:48:36.548617 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548518 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 16:48:36.548617 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548479 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 16:48:36.548617 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548522 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 16:48:36.548617 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.548593 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 16:48:36.560965 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.560946 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:48:36.703393 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703369 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703519 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703406 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703519 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703440 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703519 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703460 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-volume\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703519 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703526 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703571 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703595 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv82w\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-kube-api-access-nv82w\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703621 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-web-config\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703656 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703676 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.703721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703706 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.704173 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.703727 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-out\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805087 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805014 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805087 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805056 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805087 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805078 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-volume\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805205 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805278 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805322 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805345 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv82w\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-kube-api-access-nv82w\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805375 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-web-config\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805413 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805497 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805469 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805731 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805497 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-out\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805731 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805553 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.805731 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.805654 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.806706 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:36.805346 2553 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 16:48:36.806706 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:36.805687 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle podName:48ecad84-4ce0-424a-bf20-f9e7b699bee1 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:37.305667478 +0000 UTC m=+231.296970112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1") : configmap references non-existent config key: ca-bundle.crt Jun 10 16:48:36.806706 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:36.806020 2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls podName:48ecad84-4ce0-424a-bf20-f9e7b699bee1 nodeName:}" failed. No retries permitted until 2026-06-10 16:48:37.30599929 +0000 UTC m=+231.297301937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1") : secret "alertmanager-main-tls" not found Jun 10 16:48:36.806706 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.806658 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.808162 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.808130 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-volume\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.808273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.808188 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.808876 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.808857 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-web-config\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.809259 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.809239 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.809567 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.809540 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.810093 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.810040 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.810328 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.810307 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-out\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.810675 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.810653 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:36.813546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:36.813522 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv82w\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-kube-api-access-nv82w\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:37.146659 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.146629 2553 generic.go:356] "Generic (PLEG): container finished" podID="ca570bbc-7d70-4e8d-9616-f53fca08e9cf" containerID="234af3d725249d31441ca99410efa162883572e58a21db623452966141f27cf1" exitCode=0 Jun 10 16:48:37.146802 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.146713 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wrm9j" event={"ID":"ca570bbc-7d70-4e8d-9616-f53fca08e9cf","Type":"ContainerDied","Data":"234af3d725249d31441ca99410efa162883572e58a21db623452966141f27cf1"} Jun 10 16:48:37.310707 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.310667 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:37.310865 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.310757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:37.311585 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.311561 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:37.313125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.313105 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:37.455050 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.454978 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:48:37.581616 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:37.581592 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:48:37.583492 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:37.583473 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ecad84_4ce0_424a_bf20_f9e7b699bee1.slice/crio-051717fadfe6f98b9ba50e910628082cda8450d3e107f11d38c83f91cef853b0 WatchSource:0}: Error finding container 051717fadfe6f98b9ba50e910628082cda8450d3e107f11d38c83f91cef853b0: Status 404 returned error can't find the container with id 051717fadfe6f98b9ba50e910628082cda8450d3e107f11d38c83f91cef853b0 Jun 10 16:48:38.153209 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.153170 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wrm9j" event={"ID":"ca570bbc-7d70-4e8d-9616-f53fca08e9cf","Type":"ContainerStarted","Data":"25e366ff3d6087be63351d5dd25d7ee38f586bdbc6f86e9dd192817eb92af5dc"} Jun 10 16:48:38.153397 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.153236 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wrm9j" event={"ID":"ca570bbc-7d70-4e8d-9616-f53fca08e9cf","Type":"ContainerStarted","Data":"0392947095d1d71c5d7fd52646980dd3405bbd76454a2665c320dcbd83fa7d62"} Jun 10 16:48:38.155397 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.155362 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" event={"ID":"39aae06e-c36d-40c2-8ede-f525ff228c56","Type":"ContainerStarted","Data":"46ba798b4f292f504b82e1355ae5b19c2fe784170451796bf022f488bfca27cf"} Jun 10 16:48:38.156702 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.156657 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerStarted","Data":"051717fadfe6f98b9ba50e910628082cda8450d3e107f11d38c83f91cef853b0"} Jun 10 16:48:38.173216 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.173171 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wrm9j" podStartSLOduration=2.352590823 podStartE2EDuration="3.173158088s" totalImagesPullingTime="756.776475ms" totalInitContainerRuntime="63.79079ms" isStatefulPod=true podCreationTimestamp="2026-06-10 16:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:38.171606693 +0000 UTC m=+232.162909351" watchObservedRunningTime="2026-06-10 16:48:38.173158088 +0000 UTC m=+232.164460722" Jun 10 16:48:38.189028 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.188986 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-n6ztn" podStartSLOduration=2.098259123 podStartE2EDuration="3.188971543s" totalImagesPullingTime="1.09071242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:38.188140804 +0000 UTC m=+232.179443460" watchObservedRunningTime="2026-06-10 16:48:38.188971543 +0000 UTC m=+232.180274198" Jun 10 16:48:38.476504 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.476473 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-776f445994-t2pnv"] Jun 10 16:48:38.480277 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.480255 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.482923 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.482862 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 16:48:38.483033 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.483013 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bv1rborvq3b8t\"" Jun 10 16:48:38.483108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.483051 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 16:48:38.483320 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.483307 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 16:48:38.483423 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.483403 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rcc74\"" Jun 10 16:48:38.483552 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.483431 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 16:48:38.483552 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.483445 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 16:48:38.493452 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.493433 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-776f445994-t2pnv"] Jun 10 16:48:38.621290 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621262 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.621607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621314 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.621607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621331 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-grpc-tls\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.621607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621460 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-tls\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.621607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.621607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621498 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-metrics-client-ca\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.621607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621523 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.621607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.621545 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tslv\" (UniqueName: \"kubernetes.io/projected/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-kube-api-access-8tslv\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.722730 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.722701 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-tls\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.722874 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.722733 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.722874 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.722757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-metrics-client-ca\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.722874 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.722833 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.722874 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.722869 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tslv\" (UniqueName: \"kubernetes.io/projected/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-kube-api-access-8tslv\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.723357 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.722955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.723357 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.723016 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.723357 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.723170 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-grpc-tls\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.723556 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.723471 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-metrics-client-ca\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.725420 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.725385 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-tls\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.725529 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.725440 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.725727 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.725706 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.725793 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.725737 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.725844 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.725825 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.725882 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.725872 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-secret-grpc-tls\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.730076 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.730026 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tslv\" (UniqueName: \"kubernetes.io/projected/fa9a7dfe-6ffc-4951-a455-9a1803f4b465-kube-api-access-8tslv\") pod \"thanos-querier-776f445994-t2pnv\" (UID: \"fa9a7dfe-6ffc-4951-a455-9a1803f4b465\") " pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.790051 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.790027 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:38.913731 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:38.913706 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-776f445994-t2pnv"] Jun 10 16:48:38.915982 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:38.915957 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9a7dfe_6ffc_4951_a455_9a1803f4b465.slice/crio-878ff865b1af43e4546e157fb3352a60125caa547e2a4a3e6d5093b74caaf9c2 WatchSource:0}: Error finding container 878ff865b1af43e4546e157fb3352a60125caa547e2a4a3e6d5093b74caaf9c2: Status 404 returned error can't find the container with id 878ff865b1af43e4546e157fb3352a60125caa547e2a4a3e6d5093b74caaf9c2 Jun 10 16:48:39.160876 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:39.160793 2553 generic.go:356] "Generic (PLEG): container finished" podID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerID="9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71" exitCode=0 Jun 10 16:48:39.160876 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:39.160863 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71"} Jun 10 16:48:39.162066 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:39.162043 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" event={"ID":"fa9a7dfe-6ffc-4951-a455-9a1803f4b465","Type":"ContainerStarted","Data":"878ff865b1af43e4546e157fb3352a60125caa547e2a4a3e6d5093b74caaf9c2"} Jun 10 16:48:40.241424 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.241386 2553 patch_prober.go:28] interesting pod/image-registry-94c57ccc6-8vfjh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 16:48:40.242151 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.241451 2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" podUID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 16:48:40.268145 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.268115 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx"] Jun 10 16:48:40.272767 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.272746 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.275350 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.275312 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 16:48:40.275350 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.275333 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9jr99\"" Jun 10 16:48:40.278595 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.278573 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx"] Jun 10 16:48:40.437898 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.437866 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2nm\" (UniqueName: \"kubernetes.io/projected/ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc-kube-api-access-8b2nm\") pod \"monitoring-plugin-76b68cc874-qrcqx\" (UID: \"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.438083 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.438021 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qrcqx\" (UID: \"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.538832 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.538733 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qrcqx\" (UID: \"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.538832 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.538801 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2nm\" (UniqueName: \"kubernetes.io/projected/ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc-kube-api-access-8b2nm\") pod \"monitoring-plugin-76b68cc874-qrcqx\" (UID: \"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.541630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.541604 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qrcqx\" (UID: \"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.547256 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.547222 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2nm\" (UniqueName: \"kubernetes.io/projected/ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc-kube-api-access-8b2nm\") pod \"monitoring-plugin-76b68cc874-qrcqx\" (UID: \"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.584409 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.584364 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:40.685021 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.684992 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-695777d855-zmdzv"] Jun 10 16:48:40.688600 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.688578 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.691001 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.690900 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 16:48:40.691128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.691007 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 16:48:40.691128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.691016 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 16:48:40.691128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.691101 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 16:48:40.691346 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.691327 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-bcpcz\"" Jun 10 16:48:40.691434 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.691381 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 16:48:40.696304 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.696273 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 16:48:40.704456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.704432 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-695777d855-zmdzv"] Jun 10 16:48:40.841568 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-serving-certs-ca-bundle\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.841737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841577 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.841737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841641 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-metrics-client-ca\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.841737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841694 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc755\" (UniqueName: \"kubernetes.io/projected/911e6446-713d-4e77-8cf9-b71a99b7de71-kube-api-access-gc755\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.841869 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841749 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-telemeter-client-tls\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.841869 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841810 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-secret-telemeter-client\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.841869 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841851 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-federate-client-tls\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.842047 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.841888 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-telemeter-trusted-ca-bundle\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.942967 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.942925 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-telemeter-client-tls\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.943143 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.942984 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-secret-telemeter-client\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.943143 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.943009 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-federate-client-tls\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.943143 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.943033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-telemeter-trusted-ca-bundle\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.943143 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.943064 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-serving-certs-ca-bundle\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.943143 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.943105 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.943392 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.943166 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-metrics-client-ca\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.943392 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.943207 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc755\" (UniqueName: \"kubernetes.io/projected/911e6446-713d-4e77-8cf9-b71a99b7de71-kube-api-access-gc755\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.944335 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.944000 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-telemeter-trusted-ca-bundle\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.944335 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.944246 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-metrics-client-ca\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.944562 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.944546 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/911e6446-713d-4e77-8cf9-b71a99b7de71-serving-certs-ca-bundle\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.945874 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.945852 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.946008 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.945856 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-secret-telemeter-client\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.946092 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.946071 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-telemeter-client-tls\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.946155 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.946076 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/911e6446-713d-4e77-8cf9-b71a99b7de71-federate-client-tls\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.951399 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.951382 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc755\" (UniqueName: \"kubernetes.io/projected/911e6446-713d-4e77-8cf9-b71a99b7de71-kube-api-access-gc755\") pod \"telemeter-client-695777d855-zmdzv\" (UID: \"911e6446-713d-4e77-8cf9-b71a99b7de71\") " pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:40.999780 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:40.999751 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" Jun 10 16:48:41.264311 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:41.264249 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx"] Jun 10 16:48:41.268695 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:41.268658 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1c753e_e8a4_4c82_8210_0c1c0c11f0dc.slice/crio-9b8af89a95b8569144d7a83d750490036341c80616c423f0aa116a382883ce79 WatchSource:0}: Error finding container 9b8af89a95b8569144d7a83d750490036341c80616c423f0aa116a382883ce79: Status 404 returned error can't find the container with id 9b8af89a95b8569144d7a83d750490036341c80616c423f0aa116a382883ce79 Jun 10 16:48:41.306800 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:41.306689 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-695777d855-zmdzv"] Jun 10 16:48:41.307615 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:41.307572 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911e6446_713d_4e77_8cf9_b71a99b7de71.slice/crio-11901e3bd3c56d3bc0a9ac101658de432bbb52e5015242e2188c73f097c452a8 WatchSource:0}: Error finding container 11901e3bd3c56d3bc0a9ac101658de432bbb52e5015242e2188c73f097c452a8: Status 404 returned error can't find the container with id 11901e3bd3c56d3bc0a9ac101658de432bbb52e5015242e2188c73f097c452a8 Jun 10 16:48:42.177898 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.177869 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" event={"ID":"911e6446-713d-4e77-8cf9-b71a99b7de71","Type":"ContainerStarted","Data":"11901e3bd3c56d3bc0a9ac101658de432bbb52e5015242e2188c73f097c452a8"} Jun 10 16:48:42.182517 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.182491 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerStarted","Data":"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec"} Jun 10 16:48:42.182590 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.182566 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerStarted","Data":"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba"} Jun 10 16:48:42.182654 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.182607 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerStarted","Data":"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29"} Jun 10 16:48:42.182654 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.182647 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerStarted","Data":"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e"} Jun 10 16:48:42.182753 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.182684 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerStarted","Data":"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6"} Jun 10 16:48:42.186488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.186321 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" event={"ID":"fa9a7dfe-6ffc-4951-a455-9a1803f4b465","Type":"ContainerStarted","Data":"6104d30615a4384c0ccf78656ba24de2069ce20f116d32c48b4abce4f0292f87"} Jun 10 16:48:42.186488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.186389 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" event={"ID":"fa9a7dfe-6ffc-4951-a455-9a1803f4b465","Type":"ContainerStarted","Data":"5990ad24e79873c8bc19967533d0a7fbf79b9e5f201607773f9056b25e6290ab"} Jun 10 16:48:42.186488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.186428 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" event={"ID":"fa9a7dfe-6ffc-4951-a455-9a1803f4b465","Type":"ContainerStarted","Data":"be5187cb9cffc48a4c8890a577512e2da49e7ff89da91aa60f04343711a4beeb"} Jun 10 16:48:42.189228 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:42.189168 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" event={"ID":"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc","Type":"ContainerStarted","Data":"9b8af89a95b8569144d7a83d750490036341c80616c423f0aa116a382883ce79"} Jun 10 16:48:43.200342 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.200299 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerStarted","Data":"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907"} Jun 10 16:48:43.203427 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.203404 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" event={"ID":"fa9a7dfe-6ffc-4951-a455-9a1803f4b465","Type":"ContainerStarted","Data":"ceaf093b3b2c5a576e74772d9004fe84e930973b220b0dbe0a7d3d02035da6ab"} Jun 10 16:48:43.203538 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.203460 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" event={"ID":"fa9a7dfe-6ffc-4951-a455-9a1803f4b465","Type":"ContainerStarted","Data":"cd219f3c478397f04b9817cdeac4ec37fd8e8a3a04add89df65cbb62ed6f7ca2"} Jun 10 16:48:43.203538 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.203487 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" event={"ID":"fa9a7dfe-6ffc-4951-a455-9a1803f4b465","Type":"ContainerStarted","Data":"c97636519ade2db091accbaed28b3cd467a466778fec18faa8cef5c7fb9f906b"} Jun 10 16:48:43.203538 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.203526 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:43.226975 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.226934 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.607103806 podStartE2EDuration="7.226921188s" totalImagesPullingTime="3.605991219s" totalInitContainerRuntime="13.826163ms" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:43.22583111 +0000 UTC m=+237.217133765" watchObservedRunningTime="2026-06-10 16:48:43.226921188 +0000 UTC m=+237.218223838" Jun 10 16:48:43.246592 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.246536 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" podStartSLOduration=2.220545625 podStartE2EDuration="5.246521717s" totalImagesPullingTime="3.025976092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:43.246376207 +0000 UTC m=+237.237678863" watchObservedRunningTime="2026-06-10 16:48:43.246521717 +0000 UTC m=+237.237824375" Jun 10 16:48:43.715478 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.715450 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9697fb458-k8fl4"] Jun 10 16:48:43.718510 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.718496 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.720935 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.720898 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 16:48:43.721138 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.721114 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 16:48:43.721245 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.721149 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 16:48:43.721372 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.721358 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 16:48:43.721441 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.721402 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 16:48:43.722008 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.721988 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 16:48:43.722008 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.721994 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lcnrc\"" Jun 10 16:48:43.722139 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.722118 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 16:48:43.727662 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.727643 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9697fb458-k8fl4"] Jun 10 16:48:43.770012 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.769978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-oauth-serving-cert\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.770012 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.770010 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-console-config\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.770212 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.770027 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwvkx\" (UniqueName: \"kubernetes.io/projected/57264d09-7562-4eab-b9ed-fb296a352245-kube-api-access-rwvkx\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.770212 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.770107 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-serving-cert\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.770212 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.770152 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-oauth-config\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.770212 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.770167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-service-ca\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.870749 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.870713 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-oauth-config\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.870749 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.870746 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-service-ca\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.870960 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.870801 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-oauth-serving-cert\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.870960 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.870816 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-console-config\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.870960 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.870831 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvkx\" (UniqueName: \"kubernetes.io/projected/57264d09-7562-4eab-b9ed-fb296a352245-kube-api-access-rwvkx\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.870960 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.870856 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-serving-cert\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.871632 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.871610 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-console-config\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.871737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.871631 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-service-ca\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.871737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.871631 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-oauth-serving-cert\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.873163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.873146 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-serving-cert\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.873259 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.873241 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-oauth-config\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:43.879014 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:43.878986 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwvkx\" (UniqueName: \"kubernetes.io/projected/57264d09-7562-4eab-b9ed-fb296a352245-kube-api-access-rwvkx\") pod \"console-9697fb458-k8fl4\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:44.027812 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.027772 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:44.148614 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.148521 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9697fb458-k8fl4"] Jun 10 16:48:44.208585 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.208548 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9697fb458-k8fl4" event={"ID":"57264d09-7562-4eab-b9ed-fb296a352245","Type":"ContainerStarted","Data":"89f49e395757a8a43b12bba8e1995dc5c9461a155a485cca262bd47d0c79da30"} Jun 10 16:48:44.210648 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.210620 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" event={"ID":"911e6446-713d-4e77-8cf9-b71a99b7de71","Type":"ContainerStarted","Data":"2a10b7cbdb7ea0315fd9f669d37eb94d2f30a58c352342ace0bdd7b72adb9f2f"} Jun 10 16:48:44.210774 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.210666 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" event={"ID":"911e6446-713d-4e77-8cf9-b71a99b7de71","Type":"ContainerStarted","Data":"9ca3b5d438a4b3a7f3792ffa662bc1a479fa259422df4704b363ee306b5c3488"} Jun 10 16:48:44.210774 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.210692 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" event={"ID":"911e6446-713d-4e77-8cf9-b71a99b7de71","Type":"ContainerStarted","Data":"5dc3b890d7f8b3a4d6b3ffeb47c304da72a76991a39d335ac12466fedc186746"} Jun 10 16:48:44.212005 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.211973 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" event={"ID":"ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc","Type":"ContainerStarted","Data":"87892588d43760a2fc4f72d0a4baeaf78282d119dc28c464b2789b10e42c7757"} Jun 10 16:48:44.212587 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.212567 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:44.216702 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.216683 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" Jun 10 16:48:44.232816 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.232782 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-695777d855-zmdzv" podStartSLOduration=2.271254036 podStartE2EDuration="4.232771178s" totalImagesPullingTime="1.961517142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:44.231544442 +0000 UTC m=+238.222847122" watchObservedRunningTime="2026-06-10 16:48:44.232771178 +0000 UTC m=+238.224073833" Jun 10 16:48:44.247403 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:44.247362 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qrcqx" podStartSLOduration=2.252544932 podStartE2EDuration="4.247349073s" totalImagesPullingTime="1.994804141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:44.246886957 +0000 UTC m=+238.238189614" watchObservedRunningTime="2026-06-10 16:48:44.247349073 +0000 UTC m=+238.238651729" Jun 10 16:48:45.253945 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.253887 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" podUID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" containerName="registry" containerID="cri-o://1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8" gracePeriod=30 Jun 10 16:48:45.512115 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.512059 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:48:45.588185 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588153 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-installation-pull-secrets\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.588361 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588197 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-certificates\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.588361 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588238 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-trusted-ca\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.588361 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588259 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf74j\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-kube-api-access-jf74j\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.588361 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588275 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.588361 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588310 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d2be2c-05fa-4d14-8903-95bbdf695fef-ca-trust-extracted\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.588621 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588371 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-bound-sa-token\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.588621 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.588420 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-image-registry-private-configuration\") pod \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\" (UID: \"e0d2be2c-05fa-4d14-8903-95bbdf695fef\") " Jun 10 16:48:45.589063 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.589000 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:48:45.589347 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.589307 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:48:45.590966 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.590881 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:48:45.591390 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.591330 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:48:45.591390 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.591431 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:48:45.591390 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.591456 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:48:45.592074 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.592041 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-kube-api-access-jf74j" (OuterVolumeSpecName: "kube-api-access-jf74j") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "kube-api-access-jf74j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:48:45.598484 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.598459 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d2be2c-05fa-4d14-8903-95bbdf695fef-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e0d2be2c-05fa-4d14-8903-95bbdf695fef" (UID: "e0d2be2c-05fa-4d14-8903-95bbdf695fef"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:48:45.690118 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690088 2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0d2be2c-05fa-4d14-8903-95bbdf695fef-ca-trust-extracted\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:45.690118 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690114 2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-bound-sa-token\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:45.690118 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690127 2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-image-registry-private-configuration\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:45.690359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690142 2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0d2be2c-05fa-4d14-8903-95bbdf695fef-installation-pull-secrets\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:45.690359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690156 2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-certificates\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:45.690359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690167 2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0d2be2c-05fa-4d14-8903-95bbdf695fef-trusted-ca\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:45.690359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690177 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf74j\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-kube-api-access-jf74j\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:45.690359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:45.690185 2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0d2be2c-05fa-4d14-8903-95bbdf695fef-registry-tls\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:48:46.223413 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.223379 2553 generic.go:356] "Generic (PLEG): container finished" podID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" containerID="1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8" exitCode=0 Jun 10 16:48:46.223596 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.223442 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" Jun 10 16:48:46.223596 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.223464 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" event={"ID":"e0d2be2c-05fa-4d14-8903-95bbdf695fef","Type":"ContainerDied","Data":"1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8"} Jun 10 16:48:46.223596 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.223513 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-94c57ccc6-8vfjh" event={"ID":"e0d2be2c-05fa-4d14-8903-95bbdf695fef","Type":"ContainerDied","Data":"a927f8233bad902b936630f28796ed7b406c9d59803bd26e7c8f5446ce98941e"} Jun 10 16:48:46.223596 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.223539 2553 scope.go:117] "RemoveContainer" containerID="1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8" Jun 10 16:48:46.245759 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.245739 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-94c57ccc6-8vfjh"] Jun 10 16:48:46.250365 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.250345 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-94c57ccc6-8vfjh"] Jun 10 16:48:46.443382 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.443347 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" path="/var/lib/kubelet/pods/e0d2be2c-05fa-4d14-8903-95bbdf695fef/volumes" Jun 10 16:48:46.794961 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.794877 2553 scope.go:117] "RemoveContainer" containerID="1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8" Jun 10 16:48:46.795321 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:48:46.795289 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8\": container with ID starting with 1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8 not found: ID does not exist" containerID="1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8" Jun 10 16:48:46.795433 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:46.795327 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8"} err="failed to get container status \"1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8\": rpc error: code = NotFound desc = could not find container \"1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8\": container with ID starting with 1dbc9c5eae6ba84400fdc8e793fbd300f2a40f83b1ad3662b79cb52e54a1cfb8 not found: ID does not exist" Jun 10 16:48:47.229084 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:47.229056 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9697fb458-k8fl4" event={"ID":"57264d09-7562-4eab-b9ed-fb296a352245","Type":"ContainerStarted","Data":"17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079"} Jun 10 16:48:47.246836 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:47.246791 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9697fb458-k8fl4" podStartSLOduration=1.5581509420000001 podStartE2EDuration="4.246775359s" totalImagesPullingTime="2.688624417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:48:47.246092096 +0000 UTC m=+241.237394754" watchObservedRunningTime="2026-06-10 16:48:47.246775359 +0000 UTC m=+241.238078015" Jun 10 16:48:49.218856 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:49.218825 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-776f445994-t2pnv" Jun 10 16:48:54.028704 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:54.028666 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:54.029078 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:54.028735 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:48:54.030063 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:54.030042 2553 patch_prober.go:28] interesting pod/console-9697fb458-k8fl4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 16:48:54.030144 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:54.030100 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9697fb458-k8fl4" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 16:48:58.297670 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:58.297589 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:48:58.299794 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:58.299772 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7fbb3c9-f5fb-4528-bd65-f8675caced84-metrics-certs\") pod \"network-metrics-daemon-7q2mx\" (UID: \"a7fbb3c9-f5fb-4528-bd65-f8675caced84\") " pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:48:58.437659 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:58.437629 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxq5w\"" Jun 10 16:48:58.446008 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:58.445986 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7q2mx" Jun 10 16:48:58.590280 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:58.590258 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7q2mx"] Jun 10 16:48:58.592556 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:48:58.592533 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fbb3c9_f5fb_4528_bd65_f8675caced84.slice/crio-9298696456c071588d2f0279c19786d06beeb30126212bee936f25df8f99867c WatchSource:0}: Error finding container 9298696456c071588d2f0279c19786d06beeb30126212bee936f25df8f99867c: Status 404 returned error can't find the container with id 9298696456c071588d2f0279c19786d06beeb30126212bee936f25df8f99867c Jun 10 16:48:59.274799 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:48:59.274756 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7q2mx" event={"ID":"a7fbb3c9-f5fb-4528-bd65-f8675caced84","Type":"ContainerStarted","Data":"9298696456c071588d2f0279c19786d06beeb30126212bee936f25df8f99867c"} Jun 10 16:49:00.281309 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:00.281275 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7q2mx" event={"ID":"a7fbb3c9-f5fb-4528-bd65-f8675caced84","Type":"ContainerStarted","Data":"4c9e3cb3598fb0204c46e40615f80b77aeaba8c9060e75c374b37c7c14454375"} Jun 10 16:49:00.281684 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:00.281326 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7q2mx" event={"ID":"a7fbb3c9-f5fb-4528-bd65-f8675caced84","Type":"ContainerStarted","Data":"f2b8ab67facf93de9f63ebeb0e5dee5a157cb856f65870868ecd28eea0160498"} Jun 10 16:49:00.297383 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:00.297334 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7q2mx" podStartSLOduration=253.466535281 podStartE2EDuration="4m14.297320567s" totalImagesPullingTime="830.785286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:00.2957411 +0000 UTC m=+254.287043768" watchObservedRunningTime="2026-06-10 16:49:00.297320567 +0000 UTC m=+254.288623223" Jun 10 16:49:04.029027 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:04.028993 2553 patch_prober.go:28] interesting pod/console-9697fb458-k8fl4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 16:49:04.029546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:04.029053 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9697fb458-k8fl4" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 16:49:10.785453 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:10.785422 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48ecad84-4ce0-424a-bf20-f9e7b699bee1/init-config-reloader/0.log" Jun 10 16:49:10.986472 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:10.986446 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48ecad84-4ce0-424a-bf20-f9e7b699bee1/alertmanager/0.log" Jun 10 16:49:11.185583 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:11.185500 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48ecad84-4ce0-424a-bf20-f9e7b699bee1/config-reloader/0.log" Jun 10 16:49:11.385387 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:11.385356 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48ecad84-4ce0-424a-bf20-f9e7b699bee1/kube-rbac-proxy-web/0.log" Jun 10 16:49:11.585533 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:11.585505 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48ecad84-4ce0-424a-bf20-f9e7b699bee1/kube-rbac-proxy/0.log" Jun 10 16:49:11.784443 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:11.784418 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48ecad84-4ce0-424a-bf20-f9e7b699bee1/kube-rbac-proxy-metric/0.log" Jun 10 16:49:11.984234 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:11.984210 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_48ecad84-4ce0-424a-bf20-f9e7b699bee1/prom-label-proxy/0.log" Jun 10 16:49:12.187525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:12.187492 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-qbfwv_f4a4afe3-1bc4-494e-8e86-1a044ccf1b86/cluster-monitoring-operator/0.log" Jun 10 16:49:13.184622 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:13.184590 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-qrcqx_ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc/monitoring-plugin/0.log" Jun 10 16:49:13.984561 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:13.984534 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wrm9j_ca570bbc-7d70-4e8d-9616-f53fca08e9cf/init-textfile/0.log" Jun 10 16:49:14.029065 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:14.029034 2553 patch_prober.go:28] interesting pod/console-9697fb458-k8fl4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 16:49:14.029199 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:14.029121 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9697fb458-k8fl4" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 16:49:14.185607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:14.185573 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wrm9j_ca570bbc-7d70-4e8d-9616-f53fca08e9cf/node-exporter/0.log" Jun 10 16:49:14.385078 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:14.384996 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wrm9j_ca570bbc-7d70-4e8d-9616-f53fca08e9cf/kube-rbac-proxy/0.log" Jun 10 16:49:15.184627 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:15.184599 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ztn_39aae06e-c36d-40c2-8ede-f525ff228c56/kube-rbac-proxy-main/0.log" Jun 10 16:49:15.383941 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:15.383874 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ztn_39aae06e-c36d-40c2-8ede-f525ff228c56/kube-rbac-proxy-self/0.log" Jun 10 16:49:15.584246 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:15.584213 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ztn_39aae06e-c36d-40c2-8ede-f525ff228c56/openshift-state-metrics/0.log" Jun 10 16:49:17.583835 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:17.583805 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-fm8zt_d2139d90-eb61-40a0-b29c-51c629ee2f19/prometheus-operator-admission-webhook/0.log" Jun 10 16:49:17.784916 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:17.784874 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695777d855-zmdzv_911e6446-713d-4e77-8cf9-b71a99b7de71/telemeter-client/0.log" Jun 10 16:49:17.984963 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:17.984942 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695777d855-zmdzv_911e6446-713d-4e77-8cf9-b71a99b7de71/reload/0.log" Jun 10 16:49:18.183742 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:18.183718 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695777d855-zmdzv_911e6446-713d-4e77-8cf9-b71a99b7de71/kube-rbac-proxy/0.log" Jun 10 16:49:18.385253 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:18.385176 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/thanos-query/0.log" Jun 10 16:49:18.584032 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:18.584007 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy-web/0.log" Jun 10 16:49:18.783954 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:18.783928 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy/0.log" Jun 10 16:49:18.983772 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:18.983740 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/prom-label-proxy/0.log" Jun 10 16:49:19.184684 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:19.184611 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy-rules/0.log" Jun 10 16:49:19.383941 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:19.383875 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy-metrics/0.log" Jun 10 16:49:20.356230 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:20.356200 2553 generic.go:356] "Generic (PLEG): container finished" podID="3c26a8f4-0bb6-4c15-bf8c-da123805f479" containerID="e90d510bb28eaee83bc487d19b57764fa04a9a972af0bb9dc012ccedbf19f894" exitCode=0 Jun 10 16:49:20.356599 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:20.356278 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" event={"ID":"3c26a8f4-0bb6-4c15-bf8c-da123805f479","Type":"ContainerDied","Data":"e90d510bb28eaee83bc487d19b57764fa04a9a972af0bb9dc012ccedbf19f894"} Jun 10 16:49:20.356646 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:20.356633 2553 scope.go:117] "RemoveContainer" containerID="e90d510bb28eaee83bc487d19b57764fa04a9a972af0bb9dc012ccedbf19f894" Jun 10 16:49:20.384739 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:20.384705 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-9697fb458-k8fl4_57264d09-7562-4eab-b9ed-fb296a352245/console/0.log" Jun 10 16:49:21.362053 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:21.362021 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-t5s2v" event={"ID":"3c26a8f4-0bb6-4c15-bf8c-da123805f479","Type":"ContainerStarted","Data":"04f948a5fb8f3be28c31efd0fb08f3838546c7ca7692a64b3126a6fe39398472"} Jun 10 16:49:22.383926 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:22.383891 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sfl8c_dc2ea954-31aa-47f4-bb61-480edd611228/dns-node-resolver/0.log" Jun 10 16:49:23.384206 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:23.384162 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xh6hq_32430c61-cd32-4363-a0e0-12385778222c/node-ca/0.log" Jun 10 16:49:23.585344 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:23.585314 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f755785-n58lj_8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9/router/0.log" Jun 10 16:49:23.784600 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:23.784576 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfpx7_a22a3418-26ff-47a4-a414-df0c496772a4/serve-healthcheck-canary/0.log" Jun 10 16:49:24.029193 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:24.029158 2553 patch_prober.go:28] interesting pod/console-9697fb458-k8fl4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 16:49:24.029345 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:24.029203 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9697fb458-k8fl4" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 16:49:26.922686 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:26.922645 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rqszt" podUID="26987bde-f9c2-429f-aad6-87f7c4f6dd64" Jun 10 16:49:27.389713 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:27.389675 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqszt" Jun 10 16:49:30.284158 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:30.284108 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:49:30.286409 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:30.286386 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/26987bde-f9c2-429f-aad6-87f7c4f6dd64-metrics-tls\") pod \"dns-default-rqszt\" (UID: \"26987bde-f9c2-429f-aad6-87f7c4f6dd64\") " pod="openshift-dns/dns-default-rqszt" Jun 10 16:49:30.393394 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:30.393358 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xq2hm\"" Jun 10 16:49:30.401608 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:30.401587 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rqszt" Jun 10 16:49:30.525184 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:30.525162 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rqszt"] Jun 10 16:49:30.527288 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:49:30.527253 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26987bde_f9c2_429f_aad6_87f7c4f6dd64.slice/crio-7ac712214d075ec6295725968868b748797cb18f006af0ba4f02e6d40fb4e532 WatchSource:0}: Error finding container 7ac712214d075ec6295725968868b748797cb18f006af0ba4f02e6d40fb4e532: Status 404 returned error can't find the container with id 7ac712214d075ec6295725968868b748797cb18f006af0ba4f02e6d40fb4e532 Jun 10 16:49:31.407191 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:31.407154 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqszt" event={"ID":"26987bde-f9c2-429f-aad6-87f7c4f6dd64","Type":"ContainerStarted","Data":"7ac712214d075ec6295725968868b748797cb18f006af0ba4f02e6d40fb4e532"} Jun 10 16:49:32.412594 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:32.412554 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqszt" event={"ID":"26987bde-f9c2-429f-aad6-87f7c4f6dd64","Type":"ContainerStarted","Data":"9c1222e60e7a65395f22646728c89213878aee4b7d47cd3050b7e9003992a0cc"} Jun 10 16:49:32.412986 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:32.412613 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rqszt" event={"ID":"26987bde-f9c2-429f-aad6-87f7c4f6dd64","Type":"ContainerStarted","Data":"2fd2e84bfa736ed3c12caec8efd7b2efd4a1b339163fa5ce877290568b19681d"} Jun 10 16:49:32.412986 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:32.412639 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rqszt" Jun 10 16:49:32.431501 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:32.431461 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rqszt" podStartSLOduration=251.043345384 podStartE2EDuration="4m12.431449492s" totalImagesPullingTime="1.388104108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:45:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:32.43119551 +0000 UTC m=+286.422498166" watchObservedRunningTime="2026-06-10 16:49:32.431449492 +0000 UTC m=+286.422752147" Jun 10 16:49:34.028576 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:34.028543 2553 patch_prober.go:28] interesting pod/console-9697fb458-k8fl4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 16:49:34.028954 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:34.028593 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-9697fb458-k8fl4" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 16:49:42.418517 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:42.418484 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rqszt" Jun 10 16:49:42.490992 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:42.490963 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9697fb458-k8fl4"] Jun 10 16:49:46.399498 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:46.399466 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:49:46.400702 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:46.400681 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:49:46.404454 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:46.404437 2553 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 16:49:55.870841 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:55.870808 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:49:55.873546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:55.871091 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="alertmanager" containerID="cri-o://9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6" gracePeriod=120 Jun 10 16:49:55.873546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:55.871156 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-metric" containerID="cri-o://a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec" gracePeriod=120 Jun 10 16:49:55.873546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:55.871206 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="config-reloader" containerID="cri-o://93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e" gracePeriod=120 Jun 10 16:49:55.873546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:55.871232 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="prom-label-proxy" containerID="cri-o://15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907" gracePeriod=120 Jun 10 16:49:55.873546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:55.871202 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-web" containerID="cri-o://b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29" gracePeriod=120 Jun 10 16:49:55.873546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:55.871271 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy" containerID="cri-o://e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba" gracePeriod=120 Jun 10 16:49:56.508704 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508668 2553 generic.go:356] "Generic (PLEG): container finished" podID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerID="15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907" exitCode=0 Jun 10 16:49:56.508704 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508692 2553 generic.go:356] "Generic (PLEG): container finished" podID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerID="e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba" exitCode=0 Jun 10 16:49:56.508704 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508698 2553 generic.go:356] "Generic (PLEG): container finished" podID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerID="93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e" exitCode=0 Jun 10 16:49:56.508704 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508704 2553 generic.go:356] "Generic (PLEG): container finished" podID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerID="9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6" exitCode=0 Jun 10 16:49:56.509007 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508733 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907"} Jun 10 16:49:56.509007 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508799 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba"} Jun 10 16:49:56.509007 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508825 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e"} Jun 10 16:49:56.509007 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:56.508849 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6"} Jun 10 16:49:57.121000 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.120975 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.214658 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214580 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-out\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214658 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214619 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-main-db\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214658 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214644 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-volume\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214693 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214720 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv82w\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-kube-api-access-nv82w\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214765 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214794 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214826 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-tls-assets\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214852 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-cluster-tls-config\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214885 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-web-config\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.214936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214927 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-web\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.215385 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214963 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-metrics-client-ca\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.215385 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.214996 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:49:57.215385 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.215011 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls\") pod \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\" (UID: \"48ecad84-4ce0-424a-bf20-f9e7b699bee1\") " Jun 10 16:49:57.215385 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.215300 2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-main-db\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.215607 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.215400 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:49:57.215981 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.215943 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:49:57.218150 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.218019 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-out" (OuterVolumeSpecName: "config-out") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:49:57.218546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.218517 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-kube-api-access-nv82w" (OuterVolumeSpecName: "kube-api-access-nv82w") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "kube-api-access-nv82w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:49:57.218832 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.218811 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-volume" (OuterVolumeSpecName: "config-volume") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:49:57.218940 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.218921 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:49:57.219306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.219189 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:49:57.219306 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.219270 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:49:57.219440 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.219304 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:49:57.219440 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.219370 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:49:57.222793 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.222705 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:49:57.229437 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.229417 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-web-config" (OuterVolumeSpecName: "web-config") pod "48ecad84-4ce0-424a-bf20-f9e7b699bee1" (UID: "48ecad84-4ce0-424a-bf20-f9e7b699bee1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:49:57.316577 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316550 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-main-tls\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316577 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316574 2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-out\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316577 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316583 2553 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-config-volume\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316592 2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316602 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv82w\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-kube-api-access-nv82w\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316612 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316621 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316629 2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48ecad84-4ce0-424a-bf20-f9e7b699bee1-tls-assets\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316636 2553 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-cluster-tls-config\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316644 2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-web-config\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316653 2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48ecad84-4ce0-424a-bf20-f9e7b699bee1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.316756 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.316660 2553 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48ecad84-4ce0-424a-bf20-f9e7b699bee1-metrics-client-ca\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:49:57.516074 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.516045 2553 generic.go:356] "Generic (PLEG): container finished" podID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerID="a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec" exitCode=0 Jun 10 16:49:57.516074 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.516072 2553 generic.go:356] "Generic (PLEG): container finished" podID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerID="b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29" exitCode=0 Jun 10 16:49:57.516287 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.516102 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec"} Jun 10 16:49:57.516287 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.516132 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.516287 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.516172 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29"} Jun 10 16:49:57.516287 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.516212 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"48ecad84-4ce0-424a-bf20-f9e7b699bee1","Type":"ContainerDied","Data":"051717fadfe6f98b9ba50e910628082cda8450d3e107f11d38c83f91cef853b0"} Jun 10 16:49:57.516287 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.516249 2553 scope.go:117] "RemoveContainer" containerID="15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907" Jun 10 16:49:57.524752 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.524687 2553 scope.go:117] "RemoveContainer" containerID="a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec" Jun 10 16:49:57.531636 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.531617 2553 scope.go:117] "RemoveContainer" containerID="e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba" Jun 10 16:49:57.538177 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.538157 2553 scope.go:117] "RemoveContainer" containerID="b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29" Jun 10 16:49:57.544702 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.544683 2553 scope.go:117] "RemoveContainer" containerID="93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e" Jun 10 16:49:57.546341 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.546324 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:49:57.551642 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.551597 2553 scope.go:117] "RemoveContainer" containerID="9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6" Jun 10 16:49:57.553997 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.553969 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:49:57.558581 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.558567 2553 scope.go:117] "RemoveContainer" containerID="9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71" Jun 10 16:49:57.565261 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.565242 2553 scope.go:117] "RemoveContainer" containerID="15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907" Jun 10 16:49:57.565521 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:57.565501 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907\": container with ID starting with 15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907 not found: ID does not exist" containerID="15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907" Jun 10 16:49:57.565590 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.565528 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907"} err="failed to get container status \"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907\": rpc error: code = NotFound desc = could not find container \"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907\": container with ID starting with 15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907 not found: ID does not exist" Jun 10 16:49:57.565590 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.565545 2553 scope.go:117] "RemoveContainer" containerID="a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec" Jun 10 16:49:57.565773 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:57.565756 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec\": container with ID starting with a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec not found: ID does not exist" containerID="a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec" Jun 10 16:49:57.565813 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.565783 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec"} err="failed to get container status \"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec\": rpc error: code = NotFound desc = could not find container \"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec\": container with ID starting with a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec not found: ID does not exist" Jun 10 16:49:57.565813 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.565800 2553 scope.go:117] "RemoveContainer" containerID="e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba" Jun 10 16:49:57.566071 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:57.566052 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba\": container with ID starting with e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba not found: ID does not exist" containerID="e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba" Jun 10 16:49:57.566156 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566074 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba"} err="failed to get container status \"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba\": rpc error: code = NotFound desc = could not find container \"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba\": container with ID starting with e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba not found: ID does not exist" Jun 10 16:49:57.566156 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566089 2553 scope.go:117] "RemoveContainer" containerID="b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29" Jun 10 16:49:57.566338 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:57.566323 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29\": container with ID starting with b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29 not found: ID does not exist" containerID="b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29" Jun 10 16:49:57.566379 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566341 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29"} err="failed to get container status \"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29\": rpc error: code = NotFound desc = could not find container \"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29\": container with ID starting with b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29 not found: ID does not exist" Jun 10 16:49:57.566379 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566356 2553 scope.go:117] "RemoveContainer" containerID="93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e" Jun 10 16:49:57.566554 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:57.566530 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e\": container with ID starting with 93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e not found: ID does not exist" containerID="93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e" Jun 10 16:49:57.566599 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566551 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e"} err="failed to get container status \"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e\": rpc error: code = NotFound desc = could not find container \"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e\": container with ID starting with 93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e not found: ID does not exist" Jun 10 16:49:57.566599 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566570 2553 scope.go:117] "RemoveContainer" containerID="9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6" Jun 10 16:49:57.566813 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:57.566798 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6\": container with ID starting with 9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6 not found: ID does not exist" containerID="9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6" Jun 10 16:49:57.566848 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566817 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6"} err="failed to get container status \"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6\": rpc error: code = NotFound desc = could not find container \"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6\": container with ID starting with 9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6 not found: ID does not exist" Jun 10 16:49:57.566848 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.566829 2553 scope.go:117] "RemoveContainer" containerID="9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71" Jun 10 16:49:57.567099 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:49:57.567081 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71\": container with ID starting with 9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71 not found: ID does not exist" containerID="9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71" Jun 10 16:49:57.567163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567102 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71"} err="failed to get container status \"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71\": rpc error: code = NotFound desc = could not find container \"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71\": container with ID starting with 9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71 not found: ID does not exist" Jun 10 16:49:57.567163 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567117 2553 scope.go:117] "RemoveContainer" containerID="15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907" Jun 10 16:49:57.567313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567298 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907"} err="failed to get container status \"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907\": rpc error: code = NotFound desc = could not find container \"15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907\": container with ID starting with 15ceda56ab3a7a49b8d90f95488ab24ee9313c7eaf6e072b2801aa0f8b53c907 not found: ID does not exist" Jun 10 16:49:57.567360 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567313 2553 scope.go:117] "RemoveContainer" containerID="a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec" Jun 10 16:49:57.567524 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567508 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec"} err="failed to get container status \"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec\": rpc error: code = NotFound desc = could not find container \"a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec\": container with ID starting with a8957d7389888aa031c04658918eca589f1d70e55bb90d8a4f1edfc6cb1d43ec not found: ID does not exist" Jun 10 16:49:57.567567 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567526 2553 scope.go:117] "RemoveContainer" containerID="e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba" Jun 10 16:49:57.567721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567706 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba"} err="failed to get container status \"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba\": rpc error: code = NotFound desc = could not find container \"e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba\": container with ID starting with e7988a509fac30aa1f184a0f3a10b20d3a0f12455a84c6995601c263c69321ba not found: ID does not exist" Jun 10 16:49:57.567763 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567721 2553 scope.go:117] "RemoveContainer" containerID="b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29" Jun 10 16:49:57.567891 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567874 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29"} err="failed to get container status \"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29\": rpc error: code = NotFound desc = could not find container \"b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29\": container with ID starting with b1669449034283390ecf8c986cfa1e7ccefe0ffbaae44868439bcc56e870fd29 not found: ID does not exist" Jun 10 16:49:57.567956 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.567893 2553 scope.go:117] "RemoveContainer" containerID="93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e" Jun 10 16:49:57.568087 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.568072 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e"} err="failed to get container status \"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e\": rpc error: code = NotFound desc = could not find container \"93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e\": container with ID starting with 93eae17accb6a815bdb76a419aa42ef643d33117d59c1f19633d33049eb9d81e not found: ID does not exist" Jun 10 16:49:57.568125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.568087 2553 scope.go:117] "RemoveContainer" containerID="9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6" Jun 10 16:49:57.568252 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.568236 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6"} err="failed to get container status \"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6\": rpc error: code = NotFound desc = could not find container \"9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6\": container with ID starting with 9e4a49001cd95c60ba5b2d21280beb5ab9b3757d455535e834570db202e944c6 not found: ID does not exist" Jun 10 16:49:57.568296 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.568253 2553 scope.go:117] "RemoveContainer" containerID="9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71" Jun 10 16:49:57.568439 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.568425 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71"} err="failed to get container status \"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71\": rpc error: code = NotFound desc = could not find container \"9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71\": container with ID starting with 9f58310a92bef0a45cee951c71df09013d22b3eb17b6e03dcb1aea9759eacb71 not found: ID does not exist" Jun 10 16:49:57.584987 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.584968 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:49:57.585239 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585228 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-metric" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585240 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-metric" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585251 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="init-config-reloader" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585256 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="init-config-reloader" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585263 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="prom-label-proxy" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585268 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="prom-label-proxy" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585280 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="config-reloader" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585285 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="config-reloader" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585292 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" containerName="registry" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585296 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" containerName="registry" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585304 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-web" Jun 10 16:49:57.585289 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585312 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-web" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585322 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585327 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585333 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="alertmanager" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585338 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="alertmanager" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585379 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-web" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585385 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585393 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="kube-rbac-proxy-metric" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585398 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="prom-label-proxy" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585403 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="config-reloader" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585409 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" containerName="alertmanager" Jun 10 16:49:57.585734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.585415 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d2be2c-05fa-4d14-8903-95bbdf695fef" containerName="registry" Jun 10 16:49:57.590242 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.590225 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.593419 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593401 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 16:49:57.593627 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593609 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 16:49:57.593705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593650 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 16:49:57.593705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593668 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qbprk\"" Jun 10 16:49:57.593809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593650 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 16:49:57.593809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593742 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 16:49:57.593809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593650 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 16:49:57.593809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593695 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 16:49:57.593972 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.593827 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 16:49:57.600393 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.600371 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 16:49:57.614578 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.614559 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:49:57.719895 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.719865 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clghm\" (UniqueName: \"kubernetes.io/projected/633eeef0-8e51-4038-a878-9cac839068d6-kube-api-access-clghm\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.719895 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.719896 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/633eeef0-8e51-4038-a878-9cac839068d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.719935 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720036 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/633eeef0-8e51-4038-a878-9cac839068d6-config-out\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720058 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720081 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720104 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/633eeef0-8e51-4038-a878-9cac839068d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720128 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/633eeef0-8e51-4038-a878-9cac839068d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720165 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720188 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720215 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-web-config\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720242 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/633eeef0-8e51-4038-a878-9cac839068d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.720318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.720292 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821337 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821259 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821337 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821319 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/633eeef0-8e51-4038-a878-9cac839068d6-config-out\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821337 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821336 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821619 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821352 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821619 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821374 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/633eeef0-8e51-4038-a878-9cac839068d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821619 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821396 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/633eeef0-8e51-4038-a878-9cac839068d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821619 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821485 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821619 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821548 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821619 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821588 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-web-config\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821897 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821625 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/633eeef0-8e51-4038-a878-9cac839068d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821897 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821651 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821897 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821686 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clghm\" (UniqueName: \"kubernetes.io/projected/633eeef0-8e51-4038-a878-9cac839068d6-kube-api-access-clghm\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.821897 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821711 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/633eeef0-8e51-4038-a878-9cac839068d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.822160 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.821900 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/633eeef0-8e51-4038-a878-9cac839068d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.822970 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.822699 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/633eeef0-8e51-4038-a878-9cac839068d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.822970 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.822893 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/633eeef0-8e51-4038-a878-9cac839068d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.824301 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.824256 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/633eeef0-8e51-4038-a878-9cac839068d6-config-out\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.825151 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.825125 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.825241 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.825220 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-web-config\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.825363 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.825342 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.825548 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.825528 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/633eeef0-8e51-4038-a878-9cac839068d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.825624 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.825608 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.825680 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.825635 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.825926 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.825885 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.826164 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.826145 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/633eeef0-8e51-4038-a878-9cac839068d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.830598 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.830574 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clghm\" (UniqueName: \"kubernetes.io/projected/633eeef0-8e51-4038-a878-9cac839068d6-kube-api-access-clghm\") pod \"alertmanager-main-0\" (UID: \"633eeef0-8e51-4038-a878-9cac839068d6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:57.898721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:57.898692 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 16:49:58.040281 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:58.040248 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 16:49:58.043159 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:49:58.043130 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633eeef0_8e51_4038_a878_9cac839068d6.slice/crio-e28e46ef22864271c574ae7c402c17345d0d6e96b24a319ca18b36d800e28e95 WatchSource:0}: Error finding container e28e46ef22864271c574ae7c402c17345d0d6e96b24a319ca18b36d800e28e95: Status 404 returned error can't find the container with id e28e46ef22864271c574ae7c402c17345d0d6e96b24a319ca18b36d800e28e95 Jun 10 16:49:58.442237 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:58.442145 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48ecad84-4ce0-424a-bf20-f9e7b699bee1" path="/var/lib/kubelet/pods/48ecad84-4ce0-424a-bf20-f9e7b699bee1/volumes" Jun 10 16:49:58.521809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:58.521769 2553 generic.go:356] "Generic (PLEG): container finished" podID="633eeef0-8e51-4038-a878-9cac839068d6" containerID="c6f586725e833466d82d3afa3a4ffed3d5b8f73bbaad55a9d415341f028c100e" exitCode=0 Jun 10 16:49:58.521998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:58.521853 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerDied","Data":"c6f586725e833466d82d3afa3a4ffed3d5b8f73bbaad55a9d415341f028c100e"} Jun 10 16:49:58.521998 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:58.521947 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerStarted","Data":"e28e46ef22864271c574ae7c402c17345d0d6e96b24a319ca18b36d800e28e95"} Jun 10 16:49:59.529755 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:59.529722 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerStarted","Data":"2f67908e69fef7f9a70b3389a425a05142cfd57b43897a8a0a8035db97930fed"} Jun 10 16:49:59.530197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:59.529797 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerStarted","Data":"f4c2ed865f7681db152a9da6403c9600015849fcdc58d6d16d72ce6055322099"} Jun 10 16:49:59.530197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:59.529827 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerStarted","Data":"6f1e47bba11121c908a1f8b483559537c3900f83b2c5d47e45cecb0b88fc8de1"} Jun 10 16:49:59.530197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:59.529861 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerStarted","Data":"355c0380baf62216f65572243db88a41282eedafa6259729c0776c0f1c234df2"} Jun 10 16:49:59.530197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:59.529885 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerStarted","Data":"9db844e947624d3ad03b0988577e1519ed79ba473fb9dea475eee8d5aa017795"} Jun 10 16:49:59.530197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:59.529925 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"633eeef0-8e51-4038-a878-9cac839068d6","Type":"ContainerStarted","Data":"b2607ab65573edad3f9156fa6bee75f5560dacf4eed4b3cd85b2b08cc87d49ce"} Jun 10 16:49:59.585204 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:49:59.585154 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.568093234 podStartE2EDuration="2.58513875s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.045516ms" isStatefulPod=false podCreationTimestamp="2026-06-10 16:49:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:49:59.583106577 +0000 UTC m=+313.574409244" watchObservedRunningTime="2026-06-10 16:49:59.58513875 +0000 UTC m=+313.576441433" Jun 10 16:50:07.510115 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.510041 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9697fb458-k8fl4" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" containerID="cri-o://17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079" gracePeriod=15 Jun 10 16:50:07.750150 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.750127 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:50:07.804421 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804351 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwvkx\" (UniqueName: \"kubernetes.io/projected/57264d09-7562-4eab-b9ed-fb296a352245-kube-api-access-rwvkx\") pod \"57264d09-7562-4eab-b9ed-fb296a352245\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " Jun 10 16:50:07.804421 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804381 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-oauth-config\") pod \"57264d09-7562-4eab-b9ed-fb296a352245\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " Jun 10 16:50:07.804630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804427 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-serving-cert\") pod \"57264d09-7562-4eab-b9ed-fb296a352245\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " Jun 10 16:50:07.804630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804481 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-oauth-serving-cert\") pod \"57264d09-7562-4eab-b9ed-fb296a352245\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " Jun 10 16:50:07.804630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804516 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-console-config\") pod \"57264d09-7562-4eab-b9ed-fb296a352245\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " Jun 10 16:50:07.804630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804534 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-service-ca\") pod \"57264d09-7562-4eab-b9ed-fb296a352245\" (UID: \"57264d09-7562-4eab-b9ed-fb296a352245\") " Jun 10 16:50:07.804948 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804879 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "57264d09-7562-4eab-b9ed-fb296a352245" (UID: "57264d09-7562-4eab-b9ed-fb296a352245"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:07.805053 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804949 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-console-config" (OuterVolumeSpecName: "console-config") pod "57264d09-7562-4eab-b9ed-fb296a352245" (UID: "57264d09-7562-4eab-b9ed-fb296a352245"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:07.805053 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.804977 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-service-ca" (OuterVolumeSpecName: "service-ca") pod "57264d09-7562-4eab-b9ed-fb296a352245" (UID: "57264d09-7562-4eab-b9ed-fb296a352245"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 16:50:07.806571 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.806552 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "57264d09-7562-4eab-b9ed-fb296a352245" (UID: "57264d09-7562-4eab-b9ed-fb296a352245"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:07.806828 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.806804 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "57264d09-7562-4eab-b9ed-fb296a352245" (UID: "57264d09-7562-4eab-b9ed-fb296a352245"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:50:07.806828 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.806808 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57264d09-7562-4eab-b9ed-fb296a352245-kube-api-access-rwvkx" (OuterVolumeSpecName: "kube-api-access-rwvkx") pod "57264d09-7562-4eab-b9ed-fb296a352245" (UID: "57264d09-7562-4eab-b9ed-fb296a352245"). InnerVolumeSpecName "kube-api-access-rwvkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:50:07.905236 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.905206 2553 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-serving-cert\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:50:07.905236 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.905229 2553 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-oauth-serving-cert\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:50:07.905236 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.905240 2553 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-console-config\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:50:07.905436 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.905250 2553 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/57264d09-7562-4eab-b9ed-fb296a352245-service-ca\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:50:07.905436 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.905259 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwvkx\" (UniqueName: \"kubernetes.io/projected/57264d09-7562-4eab-b9ed-fb296a352245-kube-api-access-rwvkx\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:50:07.905436 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:07.905267 2553 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/57264d09-7562-4eab-b9ed-fb296a352245-console-oauth-config\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:50:08.568460 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.568426 2553 generic.go:356] "Generic (PLEG): container finished" podID="57264d09-7562-4eab-b9ed-fb296a352245" containerID="17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079" exitCode=0 Jun 10 16:50:08.568851 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.568468 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9697fb458-k8fl4" Jun 10 16:50:08.568851 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.568506 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9697fb458-k8fl4" event={"ID":"57264d09-7562-4eab-b9ed-fb296a352245","Type":"ContainerDied","Data":"17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079"} Jun 10 16:50:08.568851 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.568554 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9697fb458-k8fl4" event={"ID":"57264d09-7562-4eab-b9ed-fb296a352245","Type":"ContainerDied","Data":"89f49e395757a8a43b12bba8e1995dc5c9461a155a485cca262bd47d0c79da30"} Jun 10 16:50:08.568851 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.568573 2553 scope.go:117] "RemoveContainer" containerID="17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079" Jun 10 16:50:08.576527 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.576512 2553 scope.go:117] "RemoveContainer" containerID="17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079" Jun 10 16:50:08.576809 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:50:08.576790 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079\": container with ID starting with 17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079 not found: ID does not exist" containerID="17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079" Jun 10 16:50:08.576852 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.576816 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079"} err="failed to get container status \"17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079\": rpc error: code = NotFound desc = could not find container \"17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079\": container with ID starting with 17cc7b9b41c429a960c8c5377dbccf139bd3aeee48ddf2693f915f5b0b4f6079 not found: ID does not exist" Jun 10 16:50:08.586334 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.586313 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9697fb458-k8fl4"] Jun 10 16:50:08.589850 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:08.589833 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9697fb458-k8fl4"] Jun 10 16:50:10.437818 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:50:10.437784 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57264d09-7562-4eab-b9ed-fb296a352245" path="/var/lib/kubelet/pods/57264d09-7562-4eab-b9ed-fb296a352245/volumes" Jun 10 16:52:07.459698 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.459629 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr"] Jun 10 16:52:07.460117 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.459926 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" Jun 10 16:52:07.460117 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.459937 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" Jun 10 16:52:07.460117 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.460004 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="57264d09-7562-4eab-b9ed-fb296a352245" containerName="console" Jun 10 16:52:07.462774 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.462760 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.465276 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.465258 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:52:07.465387 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.465293 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 16:52:07.465433 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.465410 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mk8pn\"" Jun 10 16:52:07.475112 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.475090 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr"] Jun 10 16:52:07.634082 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.634046 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmq2f\" (UniqueName: \"kubernetes.io/projected/2110b5dd-5ff6-4b83-8027-656ba7b67b15-kube-api-access-mmq2f\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hs8sr\" (UID: \"2110b5dd-5ff6-4b83-8027-656ba7b67b15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.634210 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.634106 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2110b5dd-5ff6-4b83-8027-656ba7b67b15-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hs8sr\" (UID: \"2110b5dd-5ff6-4b83-8027-656ba7b67b15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.735176 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.735151 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2110b5dd-5ff6-4b83-8027-656ba7b67b15-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hs8sr\" (UID: \"2110b5dd-5ff6-4b83-8027-656ba7b67b15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.735303 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.735202 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmq2f\" (UniqueName: \"kubernetes.io/projected/2110b5dd-5ff6-4b83-8027-656ba7b67b15-kube-api-access-mmq2f\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hs8sr\" (UID: \"2110b5dd-5ff6-4b83-8027-656ba7b67b15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.735508 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.735490 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2110b5dd-5ff6-4b83-8027-656ba7b67b15-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hs8sr\" (UID: \"2110b5dd-5ff6-4b83-8027-656ba7b67b15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.743670 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.743651 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmq2f\" (UniqueName: \"kubernetes.io/projected/2110b5dd-5ff6-4b83-8027-656ba7b67b15-kube-api-access-mmq2f\") pod \"cert-manager-operator-controller-manager-57757f7cfc-hs8sr\" (UID: \"2110b5dd-5ff6-4b83-8027-656ba7b67b15\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.771436 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.771413 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" Jun 10 16:52:07.902002 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.901980 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr"] Jun 10 16:52:07.904097 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:52:07.904068 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2110b5dd_5ff6_4b83_8027_656ba7b67b15.slice/crio-7e9f0a4bb7b401e77a9f4877f17f8467e656a68e48c900b0a77d078c4fe13b1c WatchSource:0}: Error finding container 7e9f0a4bb7b401e77a9f4877f17f8467e656a68e48c900b0a77d078c4fe13b1c: Status 404 returned error can't find the container with id 7e9f0a4bb7b401e77a9f4877f17f8467e656a68e48c900b0a77d078c4fe13b1c Jun 10 16:52:07.906725 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:07.906706 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:52:08.020087 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:08.020024 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" event={"ID":"2110b5dd-5ff6-4b83-8027-656ba7b67b15","Type":"ContainerStarted","Data":"7e9f0a4bb7b401e77a9f4877f17f8467e656a68e48c900b0a77d078c4fe13b1c"} Jun 10 16:52:10.036277 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:10.036240 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" event={"ID":"2110b5dd-5ff6-4b83-8027-656ba7b67b15","Type":"ContainerStarted","Data":"e4e97ff96ffcef56aa5a913ba274e0e005e0018d6451a7cc7df3be26e2e6d383"} Jun 10 16:52:10.061790 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:10.061740 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-hs8sr" podStartSLOduration=1.443377571 podStartE2EDuration="3.061725817s" totalImagesPullingTime="1.618348246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:52:10.060256281 +0000 UTC m=+444.051558937" watchObservedRunningTime="2026-06-10 16:52:10.061725817 +0000 UTC m=+444.053028472" Jun 10 16:52:11.341886 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.341852 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l"] Jun 10 16:52:11.345482 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.345466 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.347876 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.347847 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 16:52:11.348012 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.347996 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 16:52:11.348088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.348073 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tf6zk\"" Jun 10 16:52:11.354149 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.354125 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l"] Jun 10 16:52:11.465685 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.465657 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc79f\" (UniqueName: \"kubernetes.io/projected/100b0b7d-3641-4860-bc6d-14b820e26dc9-kube-api-access-fc79f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.465809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.465696 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.465809 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.465791 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.567126 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.567099 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc79f\" (UniqueName: \"kubernetes.io/projected/100b0b7d-3641-4860-bc6d-14b820e26dc9-kube-api-access-fc79f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.567263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.567139 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.567263 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.567172 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.567498 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.567480 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.567533 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.567515 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.582405 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.582377 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc79f\" (UniqueName: \"kubernetes.io/projected/100b0b7d-3641-4860-bc6d-14b820e26dc9-kube-api-access-fc79f\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.655435 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.655378 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:11.783637 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:11.783609 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l"] Jun 10 16:52:11.785996 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:52:11.785962 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100b0b7d_3641_4860_bc6d_14b820e26dc9.slice/crio-1a7649ce9c82ac2b106db792e4bf9f53add48c8ad6d0b14c36fb0d03db201b95 WatchSource:0}: Error finding container 1a7649ce9c82ac2b106db792e4bf9f53add48c8ad6d0b14c36fb0d03db201b95: Status 404 returned error can't find the container with id 1a7649ce9c82ac2b106db792e4bf9f53add48c8ad6d0b14c36fb0d03db201b95 Jun 10 16:52:12.029767 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.029730 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wsskm"] Jun 10 16:52:12.034153 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.034138 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.036802 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.036784 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 16:52:12.037590 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.037574 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dmq5j\"" Jun 10 16:52:12.037658 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.037574 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 16:52:12.040713 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.040682 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wsskm"] Jun 10 16:52:12.046217 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.046196 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" event={"ID":"100b0b7d-3641-4860-bc6d-14b820e26dc9","Type":"ContainerStarted","Data":"1a7649ce9c82ac2b106db792e4bf9f53add48c8ad6d0b14c36fb0d03db201b95"} Jun 10 16:52:12.171922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.171876 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcr6q\" (UniqueName: \"kubernetes.io/projected/64f8ce7b-7f6a-444f-b483-1d43678c6c06-kube-api-access-jcr6q\") pod \"cert-manager-webhook-7dc76cbb94-wsskm\" (UID: \"64f8ce7b-7f6a-444f-b483-1d43678c6c06\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.172002 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.171927 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64f8ce7b-7f6a-444f-b483-1d43678c6c06-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wsskm\" (UID: \"64f8ce7b-7f6a-444f-b483-1d43678c6c06\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.272664 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.272641 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcr6q\" (UniqueName: \"kubernetes.io/projected/64f8ce7b-7f6a-444f-b483-1d43678c6c06-kube-api-access-jcr6q\") pod \"cert-manager-webhook-7dc76cbb94-wsskm\" (UID: \"64f8ce7b-7f6a-444f-b483-1d43678c6c06\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.272774 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.272670 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64f8ce7b-7f6a-444f-b483-1d43678c6c06-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wsskm\" (UID: \"64f8ce7b-7f6a-444f-b483-1d43678c6c06\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.281270 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.281207 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/64f8ce7b-7f6a-444f-b483-1d43678c6c06-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-wsskm\" (UID: \"64f8ce7b-7f6a-444f-b483-1d43678c6c06\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.281362 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.281306 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcr6q\" (UniqueName: \"kubernetes.io/projected/64f8ce7b-7f6a-444f-b483-1d43678c6c06-kube-api-access-jcr6q\") pod \"cert-manager-webhook-7dc76cbb94-wsskm\" (UID: \"64f8ce7b-7f6a-444f-b483-1d43678c6c06\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.344336 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.344297 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:12.487345 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:12.487315 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-wsskm"] Jun 10 16:52:12.490307 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:52:12.490215 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64f8ce7b_7f6a_444f_b483_1d43678c6c06.slice/crio-f8bdc9e229d7ada4a4665e23b231db61c4dbb407eb21ea124276864cbe4f80ef WatchSource:0}: Error finding container f8bdc9e229d7ada4a4665e23b231db61c4dbb407eb21ea124276864cbe4f80ef: Status 404 returned error can't find the container with id f8bdc9e229d7ada4a4665e23b231db61c4dbb407eb21ea124276864cbe4f80ef Jun 10 16:52:13.053074 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:13.053035 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" event={"ID":"64f8ce7b-7f6a-444f-b483-1d43678c6c06","Type":"ContainerStarted","Data":"f8bdc9e229d7ada4a4665e23b231db61c4dbb407eb21ea124276864cbe4f80ef"} Jun 10 16:52:16.072459 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:16.072395 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" event={"ID":"64f8ce7b-7f6a-444f-b483-1d43678c6c06","Type":"ContainerStarted","Data":"fdf64a60937dccf4d002bf08bc04c7450257d02f312c1fed38ed7c22b23c1f50"} Jun 10 16:52:16.072951 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:16.072486 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:16.093349 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:16.093295 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" podStartSLOduration=1.371860358 podStartE2EDuration="4.0932779s" totalImagesPullingTime="2.721417542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:52:16.091546205 +0000 UTC m=+450.082848873" watchObservedRunningTime="2026-06-10 16:52:16.0932779 +0000 UTC m=+450.084580537" Jun 10 16:52:18.082525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:18.082488 2553 generic.go:356] "Generic (PLEG): container finished" podID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerID="aaffa15a03b61a6f1f98026ad4748f9b9d7cd5642329961004168a7b4b154442" exitCode=0 Jun 10 16:52:18.082883 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:18.082572 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" event={"ID":"100b0b7d-3641-4860-bc6d-14b820e26dc9","Type":"ContainerDied","Data":"aaffa15a03b61a6f1f98026ad4748f9b9d7cd5642329961004168a7b4b154442"} Jun 10 16:52:21.099041 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:21.099007 2553 generic.go:356] "Generic (PLEG): container finished" podID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerID="89d57144916806482509ba239ffba2544450173185f437b4e56d4fa3834edef7" exitCode=0 Jun 10 16:52:21.099423 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:21.099053 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" event={"ID":"100b0b7d-3641-4860-bc6d-14b820e26dc9","Type":"ContainerDied","Data":"89d57144916806482509ba239ffba2544450173185f437b4e56d4fa3834edef7"} Jun 10 16:52:22.079271 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:22.079233 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-wsskm" Jun 10 16:52:28.132405 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:28.132369 2553 generic.go:356] "Generic (PLEG): container finished" podID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerID="babd6737c8e3044488f5723efccb170087f9bbfca5463f0a9d11803876db9612" exitCode=0 Jun 10 16:52:28.132803 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:28.132435 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" event={"ID":"100b0b7d-3641-4860-bc6d-14b820e26dc9","Type":"ContainerDied","Data":"babd6737c8e3044488f5723efccb170087f9bbfca5463f0a9d11803876db9612"} Jun 10 16:52:29.311698 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.311671 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:29.398843 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.398777 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-util\") pod \"100b0b7d-3641-4860-bc6d-14b820e26dc9\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " Jun 10 16:52:29.398843 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.398833 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-bundle\") pod \"100b0b7d-3641-4860-bc6d-14b820e26dc9\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " Jun 10 16:52:29.399020 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.398866 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fc79f\" (UniqueName: \"kubernetes.io/projected/100b0b7d-3641-4860-bc6d-14b820e26dc9-kube-api-access-fc79f\") pod \"100b0b7d-3641-4860-bc6d-14b820e26dc9\" (UID: \"100b0b7d-3641-4860-bc6d-14b820e26dc9\") " Jun 10 16:52:29.399218 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.399196 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-bundle" (OuterVolumeSpecName: "bundle") pod "100b0b7d-3641-4860-bc6d-14b820e26dc9" (UID: "100b0b7d-3641-4860-bc6d-14b820e26dc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:52:29.401169 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.401141 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100b0b7d-3641-4860-bc6d-14b820e26dc9-kube-api-access-fc79f" (OuterVolumeSpecName: "kube-api-access-fc79f") pod "100b0b7d-3641-4860-bc6d-14b820e26dc9" (UID: "100b0b7d-3641-4860-bc6d-14b820e26dc9"). InnerVolumeSpecName "kube-api-access-fc79f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:52:29.403104 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.403072 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-util" (OuterVolumeSpecName: "util") pod "100b0b7d-3641-4860-bc6d-14b820e26dc9" (UID: "100b0b7d-3641-4860-bc6d-14b820e26dc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:52:29.499690 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.499669 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-bundle\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:52:29.499690 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.499688 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fc79f\" (UniqueName: \"kubernetes.io/projected/100b0b7d-3641-4860-bc6d-14b820e26dc9-kube-api-access-fc79f\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:52:29.499805 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:29.499698 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0b7d-3641-4860-bc6d-14b820e26dc9-util\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:52:30.142475 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:30.142440 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" event={"ID":"100b0b7d-3641-4860-bc6d-14b820e26dc9","Type":"ContainerDied","Data":"1a7649ce9c82ac2b106db792e4bf9f53add48c8ad6d0b14c36fb0d03db201b95"} Jun 10 16:52:30.142475 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:30.142463 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fn5f9l" Jun 10 16:52:30.142674 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:30.142488 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a7649ce9c82ac2b106db792e4bf9f53add48c8ad6d0b14c36fb0d03db201b95" Jun 10 16:52:35.773491 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773458 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d"] Jun 10 16:52:35.773946 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773778 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerName="util" Jun 10 16:52:35.773946 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773789 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerName="util" Jun 10 16:52:35.773946 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773796 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerName="extract" Jun 10 16:52:35.773946 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773802 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerName="extract" Jun 10 16:52:35.773946 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773813 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerName="pull" Jun 10 16:52:35.773946 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773818 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerName="pull" Jun 10 16:52:35.773946 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.773877 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="100b0b7d-3641-4860-bc6d-14b820e26dc9" containerName="extract" Jun 10 16:52:35.775760 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.775745 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:35.778404 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.778384 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 16:52:35.778404 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.778397 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 16:52:35.779364 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.779345 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gfwsq\"" Jun 10 16:52:35.784525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.784506 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d"] Jun 10 16:52:35.844408 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.844378 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mp67d\" (UID: \"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:35.844515 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.844433 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvn9l\" (UniqueName: \"kubernetes.io/projected/1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5-kube-api-access-hvn9l\") pod \"openshift-lws-operator-fd8ccff4c-mp67d\" (UID: \"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:35.945299 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.945273 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvn9l\" (UniqueName: \"kubernetes.io/projected/1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5-kube-api-access-hvn9l\") pod \"openshift-lws-operator-fd8ccff4c-mp67d\" (UID: \"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:35.945412 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.945327 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mp67d\" (UID: \"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:35.945608 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.945593 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-mp67d\" (UID: \"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:35.955866 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:35.955846 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvn9l\" (UniqueName: \"kubernetes.io/projected/1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5-kube-api-access-hvn9l\") pod \"openshift-lws-operator-fd8ccff4c-mp67d\" (UID: \"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:36.084834 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:36.084766 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" Jun 10 16:52:36.208706 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:36.208682 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d"] Jun 10 16:52:36.210552 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:52:36.210525 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b74eadb_5ebc_4fb0_9bef_7ec5250ebcc5.slice/crio-9822058ec24a5866b825d164783d1aca47669bdf4394b3baffc9a5b2e4f7c419 WatchSource:0}: Error finding container 9822058ec24a5866b825d164783d1aca47669bdf4394b3baffc9a5b2e4f7c419: Status 404 returned error can't find the container with id 9822058ec24a5866b825d164783d1aca47669bdf4394b3baffc9a5b2e4f7c419 Jun 10 16:52:37.176256 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:37.176225 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" event={"ID":"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5","Type":"ContainerStarted","Data":"9822058ec24a5866b825d164783d1aca47669bdf4394b3baffc9a5b2e4f7c419"} Jun 10 16:52:39.187349 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:39.187316 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" event={"ID":"1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5","Type":"ContainerStarted","Data":"428399e6987b7f8bdcaa17a936275f6410971cb122e0c85c7d1f340dafd53ab7"} Jun 10 16:52:39.205252 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:39.205210 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-mp67d" podStartSLOduration=2.104034982 podStartE2EDuration="4.205196033s" totalImagesPullingTime="2.101161051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:52:39.204309677 +0000 UTC m=+473.195612332" watchObservedRunningTime="2026-06-10 16:52:39.205196033 +0000 UTC m=+473.196498689" Jun 10 16:52:54.518550 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.518519 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv"] Jun 10 16:52:54.521694 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.521677 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.524347 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.524315 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 16:52:54.524558 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.524542 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t289x\"" Jun 10 16:52:54.525298 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.525284 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 16:52:54.525396 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.525376 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 16:52:54.534549 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.534529 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv"] Jun 10 16:52:54.587168 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.587145 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48a29776-feca-4c7b-a911-9a0f3817de98-cert\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.587272 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.587204 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn48p\" (UniqueName: \"kubernetes.io/projected/48a29776-feca-4c7b-a911-9a0f3817de98-kube-api-access-hn48p\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.587272 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.587225 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48a29776-feca-4c7b-a911-9a0f3817de98-manager-config\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.587272 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.587244 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48a29776-feca-4c7b-a911-9a0f3817de98-metrics-cert\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.688515 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.688489 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn48p\" (UniqueName: \"kubernetes.io/projected/48a29776-feca-4c7b-a911-9a0f3817de98-kube-api-access-hn48p\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.688624 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.688522 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48a29776-feca-4c7b-a911-9a0f3817de98-manager-config\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.688624 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.688542 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48a29776-feca-4c7b-a911-9a0f3817de98-metrics-cert\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.688624 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.688570 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48a29776-feca-4c7b-a911-9a0f3817de98-cert\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.689261 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.689233 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48a29776-feca-4c7b-a911-9a0f3817de98-manager-config\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.690866 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.690846 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48a29776-feca-4c7b-a911-9a0f3817de98-cert\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.690972 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.690900 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48a29776-feca-4c7b-a911-9a0f3817de98-metrics-cert\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.702152 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.702129 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn48p\" (UniqueName: \"kubernetes.io/projected/48a29776-feca-4c7b-a911-9a0f3817de98-kube-api-access-hn48p\") pod \"lws-controller-manager-5b699dc98-fjgvv\" (UID: \"48a29776-feca-4c7b-a911-9a0f3817de98\") " pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.831570 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.831496 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:54.959520 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:54.959493 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv"] Jun 10 16:52:54.961741 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:52:54.961716 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a29776_feca_4c7b_a911_9a0f3817de98.slice/crio-37c4a80db802993b2f8e49c9ee261b1b109c2e1905b667894c6f20d993a57903 WatchSource:0}: Error finding container 37c4a80db802993b2f8e49c9ee261b1b109c2e1905b667894c6f20d993a57903: Status 404 returned error can't find the container with id 37c4a80db802993b2f8e49c9ee261b1b109c2e1905b667894c6f20d993a57903 Jun 10 16:52:55.255677 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:55.255647 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" event={"ID":"48a29776-feca-4c7b-a911-9a0f3817de98","Type":"ContainerStarted","Data":"37c4a80db802993b2f8e49c9ee261b1b109c2e1905b667894c6f20d993a57903"} Jun 10 16:52:56.399340 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.399242 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t"] Jun 10 16:52:56.403114 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.403093 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.406367 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.406347 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 16:52:56.406500 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.406387 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 16:52:56.406500 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.406442 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dr7hr\"" Jun 10 16:52:56.406712 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.406682 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 16:52:56.406800 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.406752 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 16:52:56.423406 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.423380 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t"] Jun 10 16:52:56.505006 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.504978 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0b5b877c-ef70-413a-8803-955d957b185d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.505150 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.505036 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b5b877c-ef70-413a-8803-955d957b185d-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.505150 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.505103 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jnvv\" (UniqueName: \"kubernetes.io/projected/0b5b877c-ef70-413a-8803-955d957b185d-kube-api-access-9jnvv\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.505150 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.505134 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5b877c-ef70-413a-8803-955d957b185d-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.505250 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.505167 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0b5b877c-ef70-413a-8803-955d957b185d-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.606035 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.606001 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b5b877c-ef70-413a-8803-955d957b185d-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.606213 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.606047 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jnvv\" (UniqueName: \"kubernetes.io/projected/0b5b877c-ef70-413a-8803-955d957b185d-kube-api-access-9jnvv\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.606278 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.606206 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5b877c-ef70-413a-8803-955d957b185d-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.606278 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.606260 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0b5b877c-ef70-413a-8803-955d957b185d-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.606376 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.606307 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0b5b877c-ef70-413a-8803-955d957b185d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.606679 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.606649 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0b5b877c-ef70-413a-8803-955d957b185d-manifests\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.608684 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.608659 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b5b877c-ef70-413a-8803-955d957b185d-tmp\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.608806 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.608724 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0b5b877c-ef70-413a-8803-955d957b185d-webhook-cert\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.608872 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.608839 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0b5b877c-ef70-413a-8803-955d957b185d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.616120 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.616097 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jnvv\" (UniqueName: \"kubernetes.io/projected/0b5b877c-ef70-413a-8803-955d957b185d-kube-api-access-9jnvv\") pod \"opendatahub-operator-controller-manager-696f888447-f6v5t\" (UID: \"0b5b877c-ef70-413a-8803-955d957b185d\") " pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.715676 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.715604 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:52:56.937958 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:56.937929 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t"] Jun 10 16:52:56.939547 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:52:56.939518 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b5b877c_ef70_413a_8803_955d957b185d.slice/crio-989d754439fb587abec70e1679874da77913031c363e7be46c6c028d5de0f0b1 WatchSource:0}: Error finding container 989d754439fb587abec70e1679874da77913031c363e7be46c6c028d5de0f0b1: Status 404 returned error can't find the container with id 989d754439fb587abec70e1679874da77913031c363e7be46c6c028d5de0f0b1 Jun 10 16:52:57.266922 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:57.266874 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" event={"ID":"0b5b877c-ef70-413a-8803-955d957b185d","Type":"ContainerStarted","Data":"989d754439fb587abec70e1679874da77913031c363e7be46c6c028d5de0f0b1"} Jun 10 16:52:57.268411 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:57.268384 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" event={"ID":"48a29776-feca-4c7b-a911-9a0f3817de98","Type":"ContainerStarted","Data":"3b8012626c84d67230f60fbd5b5270ef9beaba585ee2cc4bee0ee34b50f26cc0"} Jun 10 16:52:57.268561 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:57.268500 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:52:57.298592 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:52:57.298553 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" podStartSLOduration=1.392191386 podStartE2EDuration="3.298535503s" totalImagesPullingTime="1.906344117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:52:57.297425816 +0000 UTC m=+491.288728471" watchObservedRunningTime="2026-06-10 16:52:57.298535503 +0000 UTC m=+491.289838159" Jun 10 16:53:00.283846 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:00.283814 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" event={"ID":"0b5b877c-ef70-413a-8803-955d957b185d","Type":"ContainerStarted","Data":"4b971ae76b55abd419beff285cf71aa05db20f2bdd9744a1ff99a1bae6989c4a"} Jun 10 16:53:01.289766 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:01.289728 2553 generic.go:356] "Generic (PLEG): container finished" podID="0b5b877c-ef70-413a-8803-955d957b185d" containerID="4b971ae76b55abd419beff285cf71aa05db20f2bdd9744a1ff99a1bae6989c4a" exitCode=0 Jun 10 16:53:01.290134 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:01.289813 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" event={"ID":"0b5b877c-ef70-413a-8803-955d957b185d","Type":"ContainerDied","Data":"4b971ae76b55abd419beff285cf71aa05db20f2bdd9744a1ff99a1bae6989c4a"} Jun 10 16:53:02.296238 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:02.296203 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" event={"ID":"0b5b877c-ef70-413a-8803-955d957b185d","Type":"ContainerStarted","Data":"b0ef2def9a4f9903c7cfab5d3b0b96912ba581270cea126764ee17deb7a5a0dd"} Jun 10 16:53:02.296663 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:02.296287 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:53:02.318677 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:02.318633 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" podStartSLOduration=2.045875824 podStartE2EDuration="6.318620603s" totalImagesPullingTime="3.363355937s" totalInitContainerRuntime="909.388842ms" isStatefulPod=false podCreationTimestamp="2026-06-10 16:52:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:02.316959466 +0000 UTC m=+496.308262123" watchObservedRunningTime="2026-06-10 16:53:02.318620603 +0000 UTC m=+496.309923258" Jun 10 16:53:08.275726 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:08.275693 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5b699dc98-fjgvv" Jun 10 16:53:13.302647 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:13.302619 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696f888447-f6v5t" Jun 10 16:53:44.722089 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.722059 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x"] Jun 10 16:53:44.731827 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.731807 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.736444 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.736426 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pnbjv\"" Jun 10 16:53:44.736890 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.736875 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 16:53:44.742772 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.742751 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x"] Jun 10 16:53:44.794227 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794202 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794344 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794230 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794344 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794251 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrd76\" (UniqueName: \"kubernetes.io/projected/841965a2-7f79-42c6-813b-41df34cd5415-kube-api-access-hrd76\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794344 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794269 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/841965a2-7f79-42c6-813b-41df34cd5415-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794373 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794398 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/841965a2-7f79-42c6-813b-41df34cd5415-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794418 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794571 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794471 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.794571 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.794485 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/841965a2-7f79-42c6-813b-41df34cd5415-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.895790 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.895753 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.895790 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.895791 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/841965a2-7f79-42c6-813b-41df34cd5415-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896050 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.895821 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896050 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.895842 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896050 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.895862 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrd76\" (UniqueName: \"kubernetes.io/projected/841965a2-7f79-42c6-813b-41df34cd5415-kube-api-access-hrd76\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896050 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.895987 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/841965a2-7f79-42c6-813b-41df34cd5415-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896229 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896080 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896229 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896108 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/841965a2-7f79-42c6-813b-41df34cd5415-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896229 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896137 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896379 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896234 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896379 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896337 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896627 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896607 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896698 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896656 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.896875 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.896858 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/841965a2-7f79-42c6-813b-41df34cd5415-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.898256 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.898239 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/841965a2-7f79-42c6-813b-41df34cd5415-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.898453 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.898437 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/841965a2-7f79-42c6-813b-41df34cd5415-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.917749 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.917730 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/841965a2-7f79-42c6-813b-41df34cd5415-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:44.918655 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:44.918627 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrd76\" (UniqueName: \"kubernetes.io/projected/841965a2-7f79-42c6-813b-41df34cd5415-kube-api-access-hrd76\") pod \"data-science-gateway-data-science-gateway-class-74759f9795lzg5x\" (UID: \"841965a2-7f79-42c6-813b-41df34cd5415\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:45.043461 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.043384 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:45.188608 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.188559 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x"] Jun 10 16:53:45.191356 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:53:45.191326 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841965a2_7f79_42c6_813b_41df34cd5415.slice/crio-4cc403b7315e477be82148a7a42fdcf4b5f358d06dc501a010b05f05177c5565 WatchSource:0}: Error finding container 4cc403b7315e477be82148a7a42fdcf4b5f358d06dc501a010b05f05177c5565: Status 404 returned error can't find the container with id 4cc403b7315e477be82148a7a42fdcf4b5f358d06dc501a010b05f05177c5565 Jun 10 16:53:45.284483 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.284439 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6785b76bc9-8xnz6"] Jun 10 16:53:45.289582 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.289554 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.292253 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.292234 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k7dwj\"" Jun 10 16:53:45.292901 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.292881 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 16:53:45.298936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.298917 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6785b76bc9-8xnz6"] Jun 10 16:53:45.399509 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.399472 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc5jk\" (UniqueName: \"kubernetes.io/projected/d3c88fe8-9b52-4fd2-a2e0-63400339c255-kube-api-access-lc5jk\") pod \"dashboard-redirect-6785b76bc9-8xnz6\" (UID: \"d3c88fe8-9b52-4fd2-a2e0-63400339c255\") " pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.399660 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.399572 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d3c88fe8-9b52-4fd2-a2e0-63400339c255-redirect-config\") pod \"dashboard-redirect-6785b76bc9-8xnz6\" (UID: \"d3c88fe8-9b52-4fd2-a2e0-63400339c255\") " pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.492039 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.492002 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" event={"ID":"841965a2-7f79-42c6-813b-41df34cd5415","Type":"ContainerStarted","Data":"4cc403b7315e477be82148a7a42fdcf4b5f358d06dc501a010b05f05177c5565"} Jun 10 16:53:45.500464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.500430 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d3c88fe8-9b52-4fd2-a2e0-63400339c255-redirect-config\") pod \"dashboard-redirect-6785b76bc9-8xnz6\" (UID: \"d3c88fe8-9b52-4fd2-a2e0-63400339c255\") " pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.500583 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.500477 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc5jk\" (UniqueName: \"kubernetes.io/projected/d3c88fe8-9b52-4fd2-a2e0-63400339c255-kube-api-access-lc5jk\") pod \"dashboard-redirect-6785b76bc9-8xnz6\" (UID: \"d3c88fe8-9b52-4fd2-a2e0-63400339c255\") " pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.501122 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.501105 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d3c88fe8-9b52-4fd2-a2e0-63400339c255-redirect-config\") pod \"dashboard-redirect-6785b76bc9-8xnz6\" (UID: \"d3c88fe8-9b52-4fd2-a2e0-63400339c255\") " pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.509194 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.509178 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc5jk\" (UniqueName: \"kubernetes.io/projected/d3c88fe8-9b52-4fd2-a2e0-63400339c255-kube-api-access-lc5jk\") pod \"dashboard-redirect-6785b76bc9-8xnz6\" (UID: \"d3c88fe8-9b52-4fd2-a2e0-63400339c255\") " pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.601232 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.601150 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" Jun 10 16:53:45.938695 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:45.938667 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6785b76bc9-8xnz6"] Jun 10 16:53:45.941467 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:53:45.941437 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c88fe8_9b52_4fd2_a2e0_63400339c255.slice/crio-46a04ddb4b08457a5bc5c315a3d2a883795bebb63268712ef4d958fbf702016e WatchSource:0}: Error finding container 46a04ddb4b08457a5bc5c315a3d2a883795bebb63268712ef4d958fbf702016e: Status 404 returned error can't find the container with id 46a04ddb4b08457a5bc5c315a3d2a883795bebb63268712ef4d958fbf702016e Jun 10 16:53:46.502740 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:46.502704 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" event={"ID":"d3c88fe8-9b52-4fd2-a2e0-63400339c255","Type":"ContainerStarted","Data":"46a04ddb4b08457a5bc5c315a3d2a883795bebb63268712ef4d958fbf702016e"} Jun 10 16:53:50.372747 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:50.372650 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:53:50.372747 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:50.372739 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:53:50.373228 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:50.372769 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:53:50.526586 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:50.526554 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" event={"ID":"841965a2-7f79-42c6-813b-41df34cd5415","Type":"ContainerStarted","Data":"24268c3abbab682bc86b04f9bd2481d66b5cc2b7448f27f49bd1f52045529a88"} Jun 10 16:53:50.528184 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:50.528159 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" event={"ID":"d3c88fe8-9b52-4fd2-a2e0-63400339c255","Type":"ContainerStarted","Data":"f5e198839124bc755f2510202d95376c6767b3b09c26af4757ae08845cc90e83"} Jun 10 16:53:50.552237 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:50.552175 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" podStartSLOduration=1.3729842300000001 podStartE2EDuration="6.552155643s" totalImagesPullingTime="5.179171413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:50.550781477 +0000 UTC m=+544.542084134" watchObservedRunningTime="2026-06-10 16:53:50.552155643 +0000 UTC m=+544.543458301" Jun 10 16:53:50.570352 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:50.570301 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6785b76bc9-8xnz6" podStartSLOduration=1.069957064 podStartE2EDuration="5.570282952s" totalImagesPullingTime="4.500325888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:50.569181224 +0000 UTC m=+544.560483892" watchObservedRunningTime="2026-06-10 16:53:50.570282952 +0000 UTC m=+544.561585608" Jun 10 16:53:51.044042 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:51.044009 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:51.048285 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:51.048263 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:51.533672 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:51.533642 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:51.534422 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:51.534403 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795lzg5x" Jun 10 16:53:53.057614 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.057582 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56dfff4fd5-69ktl"] Jun 10 16:53:53.061570 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.061549 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.065109 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.065092 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lcnrc\"" Jun 10 16:53:53.065345 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.065328 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 16:53:53.065414 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.065343 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 16:53:53.066153 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.066121 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 16:53:53.066153 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.066140 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 16:53:53.066291 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.066155 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 16:53:53.066291 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.066181 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 16:53:53.066291 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.066227 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 16:53:53.074288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.074269 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 16:53:53.074773 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.074752 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dfff4fd5-69ktl"] Jun 10 16:53:53.174203 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.174177 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-oauth-config\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.174308 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.174212 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc5m8\" (UniqueName: \"kubernetes.io/projected/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-kube-api-access-xc5m8\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.174308 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.174242 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-serving-cert\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.174308 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.174258 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-service-ca\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.174408 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.174336 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-trusted-ca-bundle\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.174408 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.174369 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-config\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.174408 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.174396 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-oauth-serving-cert\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.275460 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.275436 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-trusted-ca-bundle\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.275543 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.275469 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-config\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.275543 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.275487 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-oauth-serving-cert\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.275628 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.275612 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-oauth-config\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.275665 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.275656 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc5m8\" (UniqueName: \"kubernetes.io/projected/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-kube-api-access-xc5m8\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.275715 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.275702 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-serving-cert\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.275755 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.275726 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-service-ca\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.276227 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.276202 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-config\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.276325 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.276285 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-oauth-serving-cert\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.276388 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.276324 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-trusted-ca-bundle\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.276388 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.276345 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-service-ca\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.278065 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.278046 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-serving-cert\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.278161 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.278146 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-console-oauth-config\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.286695 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.286674 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc5m8\" (UniqueName: \"kubernetes.io/projected/fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4-kube-api-access-xc5m8\") pod \"console-56dfff4fd5-69ktl\" (UID: \"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4\") " pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.372160 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.372090 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:53:53.499426 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.499405 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dfff4fd5-69ktl"] Jun 10 16:53:53.500947 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:53:53.500920 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc70e17c_4bca_4e7a_8c0e_91b7a2379ec4.slice/crio-86e99ffb4893a409d5c7941d4b46f31e347ced3a0fbdbe8b3d91d1e981086751 WatchSource:0}: Error finding container 86e99ffb4893a409d5c7941d4b46f31e347ced3a0fbdbe8b3d91d1e981086751: Status 404 returned error can't find the container with id 86e99ffb4893a409d5c7941d4b46f31e347ced3a0fbdbe8b3d91d1e981086751 Jun 10 16:53:53.542632 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:53.542604 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dfff4fd5-69ktl" event={"ID":"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4","Type":"ContainerStarted","Data":"86e99ffb4893a409d5c7941d4b46f31e347ced3a0fbdbe8b3d91d1e981086751"} Jun 10 16:53:54.548527 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:54.548495 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dfff4fd5-69ktl" event={"ID":"fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4","Type":"ContainerStarted","Data":"cc95e8201a9f3dba7d0662cf5bc0251597b35f0f0622033428835021d5cb5c3b"} Jun 10 16:53:54.568636 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:53:54.568584 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56dfff4fd5-69ktl" podStartSLOduration=1.5685677120000001 podStartE2EDuration="1.568567712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:53:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:53:54.567290021 +0000 UTC m=+548.558592695" watchObservedRunningTime="2026-06-10 16:53:54.568567712 +0000 UTC m=+548.559870368" Jun 10 16:54:03.372371 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:03.372334 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:54:03.372749 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:03.372399 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:54:03.377169 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:03.377144 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:54:03.593244 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:03.593216 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56dfff4fd5-69ktl" Jun 10 16:54:17.124699 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.124669 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q8ws"] Jun 10 16:54:17.130959 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.130938 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" Jun 10 16:54:17.134501 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.134479 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 16:54:17.134620 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.134531 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 16:54:17.136222 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.136150 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-hcw2m\"" Jun 10 16:54:17.138212 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.138191 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q8ws"] Jun 10 16:54:17.281108 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.281073 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt77j\" (UniqueName: \"kubernetes.io/projected/67287d72-4ccb-4216-bcb2-730591018bf6-kube-api-access-bt77j\") pod \"kuadrant-operator-catalog-5q8ws\" (UID: \"67287d72-4ccb-4216-bcb2-730591018bf6\") " pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" Jun 10 16:54:17.382158 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.382092 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt77j\" (UniqueName: \"kubernetes.io/projected/67287d72-4ccb-4216-bcb2-730591018bf6-kube-api-access-bt77j\") pod \"kuadrant-operator-catalog-5q8ws\" (UID: \"67287d72-4ccb-4216-bcb2-730591018bf6\") " pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" Jun 10 16:54:17.390539 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.390511 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt77j\" (UniqueName: \"kubernetes.io/projected/67287d72-4ccb-4216-bcb2-730591018bf6-kube-api-access-bt77j\") pod \"kuadrant-operator-catalog-5q8ws\" (UID: \"67287d72-4ccb-4216-bcb2-730591018bf6\") " pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" Jun 10 16:54:17.443713 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.443677 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" Jun 10 16:54:17.467367 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.467337 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q8ws"] Jun 10 16:54:17.570765 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.570741 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q8ws"] Jun 10 16:54:17.572998 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:54:17.572963 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67287d72_4ccb_4216_bcb2_730591018bf6.slice/crio-12c689b93c3fb21febf3cc2bd5815dc62deaf2bc8bc5ec146f728a49221fecf5 WatchSource:0}: Error finding container 12c689b93c3fb21febf3cc2bd5815dc62deaf2bc8bc5ec146f728a49221fecf5: Status 404 returned error can't find the container with id 12c689b93c3fb21febf3cc2bd5815dc62deaf2bc8bc5ec146f728a49221fecf5 Jun 10 16:54:17.651812 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.651747 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" event={"ID":"67287d72-4ccb-4216-bcb2-730591018bf6","Type":"ContainerStarted","Data":"12c689b93c3fb21febf3cc2bd5815dc62deaf2bc8bc5ec146f728a49221fecf5"} Jun 10 16:54:17.677301 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.677275 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7hv5"] Jun 10 16:54:17.682666 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.682649 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:17.688234 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.688215 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7hv5"] Jun 10 16:54:17.786368 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.786337 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47499\" (UniqueName: \"kubernetes.io/projected/204c82b7-4cc9-4846-94f2-fab2b91a0768-kube-api-access-47499\") pod \"kuadrant-operator-catalog-n7hv5\" (UID: \"204c82b7-4cc9-4846-94f2-fab2b91a0768\") " pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:17.887187 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.887161 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47499\" (UniqueName: \"kubernetes.io/projected/204c82b7-4cc9-4846-94f2-fab2b91a0768-kube-api-access-47499\") pod \"kuadrant-operator-catalog-n7hv5\" (UID: \"204c82b7-4cc9-4846-94f2-fab2b91a0768\") " pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:17.896125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.896104 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47499\" (UniqueName: \"kubernetes.io/projected/204c82b7-4cc9-4846-94f2-fab2b91a0768-kube-api-access-47499\") pod \"kuadrant-operator-catalog-n7hv5\" (UID: \"204c82b7-4cc9-4846-94f2-fab2b91a0768\") " pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:17.992653 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:17.992591 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:18.136610 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:18.136586 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-n7hv5"] Jun 10 16:54:18.144539 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:54:18.144513 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204c82b7_4cc9_4846_94f2_fab2b91a0768.slice/crio-b6f18b7080873d3cc1ad3445f85afbad14aa11898c513de399cd905507bfff5b WatchSource:0}: Error finding container b6f18b7080873d3cc1ad3445f85afbad14aa11898c513de399cd905507bfff5b: Status 404 returned error can't find the container with id b6f18b7080873d3cc1ad3445f85afbad14aa11898c513de399cd905507bfff5b Jun 10 16:54:18.659788 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:18.659749 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" event={"ID":"204c82b7-4cc9-4846-94f2-fab2b91a0768","Type":"ContainerStarted","Data":"b6f18b7080873d3cc1ad3445f85afbad14aa11898c513de399cd905507bfff5b"} Jun 10 16:54:20.674394 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:20.674349 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" event={"ID":"67287d72-4ccb-4216-bcb2-730591018bf6","Type":"ContainerStarted","Data":"b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e"} Jun 10 16:54:20.674394 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:20.674370 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" podUID="67287d72-4ccb-4216-bcb2-730591018bf6" containerName="registry-server" containerID="cri-o://b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e" gracePeriod=2 Jun 10 16:54:20.675868 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:20.675844 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" event={"ID":"204c82b7-4cc9-4846-94f2-fab2b91a0768","Type":"ContainerStarted","Data":"15f634ccebdb0fdce8bbccddbd71e83e1d2e6dfaea541c5cb9bdff7dd5679d6b"} Jun 10 16:54:20.692034 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:20.691993 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" podStartSLOduration=1.5044731759999999 podStartE2EDuration="3.6919817s" totalImagesPullingTime="2.187508524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:54:20.690400755 +0000 UTC m=+574.681703411" watchObservedRunningTime="2026-06-10 16:54:20.6919817 +0000 UTC m=+574.683284355" Jun 10 16:54:20.707285 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:20.707248 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" podStartSLOduration=2.088342005 podStartE2EDuration="3.707236915s" totalImagesPullingTime="1.61889491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:54:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:54:20.706870795 +0000 UTC m=+574.698173450" watchObservedRunningTime="2026-06-10 16:54:20.707236915 +0000 UTC m=+574.698539571" Jun 10 16:54:20.930006 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:20.929956 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" Jun 10 16:54:21.118239 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.118206 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt77j\" (UniqueName: \"kubernetes.io/projected/67287d72-4ccb-4216-bcb2-730591018bf6-kube-api-access-bt77j\") pod \"67287d72-4ccb-4216-bcb2-730591018bf6\" (UID: \"67287d72-4ccb-4216-bcb2-730591018bf6\") " Jun 10 16:54:21.120222 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.120199 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67287d72-4ccb-4216-bcb2-730591018bf6-kube-api-access-bt77j" (OuterVolumeSpecName: "kube-api-access-bt77j") pod "67287d72-4ccb-4216-bcb2-730591018bf6" (UID: "67287d72-4ccb-4216-bcb2-730591018bf6"). InnerVolumeSpecName "kube-api-access-bt77j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:54:21.219714 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.219695 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt77j\" (UniqueName: \"kubernetes.io/projected/67287d72-4ccb-4216-bcb2-730591018bf6-kube-api-access-bt77j\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:21.682127 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.682046 2553 generic.go:356] "Generic (PLEG): container finished" podID="67287d72-4ccb-4216-bcb2-730591018bf6" containerID="b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e" exitCode=0 Jun 10 16:54:21.682127 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.682094 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" Jun 10 16:54:21.682609 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.682129 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" event={"ID":"67287d72-4ccb-4216-bcb2-730591018bf6","Type":"ContainerDied","Data":"b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e"} Jun 10 16:54:21.682609 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.682177 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5q8ws" event={"ID":"67287d72-4ccb-4216-bcb2-730591018bf6","Type":"ContainerDied","Data":"12c689b93c3fb21febf3cc2bd5815dc62deaf2bc8bc5ec146f728a49221fecf5"} Jun 10 16:54:21.682609 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.682197 2553 scope.go:117] "RemoveContainer" containerID="b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e" Jun 10 16:54:21.691174 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.691158 2553 scope.go:117] "RemoveContainer" containerID="b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e" Jun 10 16:54:21.691420 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:54:21.691401 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e\": container with ID starting with b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e not found: ID does not exist" containerID="b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e" Jun 10 16:54:21.691490 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.691429 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e"} err="failed to get container status \"b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e\": rpc error: code = NotFound desc = could not find container \"b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e\": container with ID starting with b02240feb6d5c1028c9c20767e4f1d62132ddf51a12c650fa6c23a6cfac5154e not found: ID does not exist" Jun 10 16:54:21.703418 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.703393 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q8ws"] Jun 10 16:54:21.709173 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:21.709153 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5q8ws"] Jun 10 16:54:22.439629 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:22.439598 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67287d72-4ccb-4216-bcb2-730591018bf6" path="/var/lib/kubelet/pods/67287d72-4ccb-4216-bcb2-730591018bf6/volumes" Jun 10 16:54:27.993134 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:27.993104 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:27.993559 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:27.993309 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:28.014712 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:28.014692 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:28.737524 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:28.737500 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-n7hv5" Jun 10 16:54:32.714676 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.714639 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj"] Jun 10 16:54:32.715052 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.715018 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67287d72-4ccb-4216-bcb2-730591018bf6" containerName="registry-server" Jun 10 16:54:32.715052 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.715029 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="67287d72-4ccb-4216-bcb2-730591018bf6" containerName="registry-server" Jun 10 16:54:32.715122 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.715085 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="67287d72-4ccb-4216-bcb2-730591018bf6" containerName="registry-server" Jun 10 16:54:32.718299 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.718283 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.721027 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.721006 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ft79b\"" Jun 10 16:54:32.727559 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.727538 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj"] Jun 10 16:54:32.810589 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.810550 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.810748 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.810614 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4447\" (UniqueName: \"kubernetes.io/projected/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-kube-api-access-m4447\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.810748 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.810643 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.911631 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.911598 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.911790 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.911657 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.911790 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.911710 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4447\" (UniqueName: \"kubernetes.io/projected/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-kube-api-access-m4447\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.912016 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.911996 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.912059 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.912019 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:32.921422 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:32.921399 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4447\" (UniqueName: \"kubernetes.io/projected/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-kube-api-access-m4447\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:33.027898 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.027866 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:33.117583 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.117555 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw"] Jun 10 16:54:33.122138 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.122116 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.130734 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.130704 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw"] Jun 10 16:54:33.157168 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.157149 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj"] Jun 10 16:54:33.159434 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:54:33.159409 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e2d224_ff06_4dd4_bf0c_46b1fe240e9b.slice/crio-fa9649995ff240f745772048ac2f1979085f0e5913e955b20a43b26b77e862bf WatchSource:0}: Error finding container fa9649995ff240f745772048ac2f1979085f0e5913e955b20a43b26b77e862bf: Status 404 returned error can't find the container with id fa9649995ff240f745772048ac2f1979085f0e5913e955b20a43b26b77e862bf Jun 10 16:54:33.214423 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.214403 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.214507 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.214450 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzm8x\" (UniqueName: \"kubernetes.io/projected/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-kube-api-access-dzm8x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.214546 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.214507 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.315625 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.315559 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.315625 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.315606 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.315793 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.315649 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzm8x\" (UniqueName: \"kubernetes.io/projected/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-kube-api-access-dzm8x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.315895 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.315876 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.316006 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.315986 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.324105 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.324084 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzm8x\" (UniqueName: \"kubernetes.io/projected/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-kube-api-access-dzm8x\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.434486 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.434464 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:33.518184 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.518156 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh"] Jun 10 16:54:33.523437 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.523415 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.530770 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.530709 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh"] Jun 10 16:54:33.563116 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.563091 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw"] Jun 10 16:54:33.565958 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:54:33.565877 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cecf4c2_e55b_44f6_ac8b_a873a6600b6b.slice/crio-be7b35780a76b76df7d064f6c4f557518f02c5f7eead082abd379f3c0fc5b21f WatchSource:0}: Error finding container be7b35780a76b76df7d064f6c4f557518f02c5f7eead082abd379f3c0fc5b21f: Status 404 returned error can't find the container with id be7b35780a76b76df7d064f6c4f557518f02c5f7eead082abd379f3c0fc5b21f Jun 10 16:54:33.618960 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.618937 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.619054 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.618990 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99kbh\" (UniqueName: \"kubernetes.io/projected/5892c414-1017-4232-9c67-20f32325f713-kube-api-access-99kbh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.619089 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.619074 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.720502 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.720471 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.720800 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.720535 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99kbh\" (UniqueName: \"kubernetes.io/projected/5892c414-1017-4232-9c67-20f32325f713-kube-api-access-99kbh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.720800 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.720566 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.720883 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.720866 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.720944 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.720878 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.728914 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.728887 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99kbh\" (UniqueName: \"kubernetes.io/projected/5892c414-1017-4232-9c67-20f32325f713-kube-api-access-99kbh\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.745794 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.745762 2553 generic.go:356] "Generic (PLEG): container finished" podID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerID="520e8086b1a14d0c74485e873a89a0535f6a3e43a7c5abed5ff360f8cd8a91e9" exitCode=0 Jun 10 16:54:33.745886 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.745848 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" event={"ID":"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b","Type":"ContainerDied","Data":"520e8086b1a14d0c74485e873a89a0535f6a3e43a7c5abed5ff360f8cd8a91e9"} Jun 10 16:54:33.745968 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.745953 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" event={"ID":"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b","Type":"ContainerStarted","Data":"fa9649995ff240f745772048ac2f1979085f0e5913e955b20a43b26b77e862bf"} Jun 10 16:54:33.747440 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.747422 2553 generic.go:356] "Generic (PLEG): container finished" podID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerID="c221f4f310c9ba618592591303a3c43ae1a6f9ac57eb7957ec3498ce8ec72f1a" exitCode=0 Jun 10 16:54:33.747540 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.747458 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" event={"ID":"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b","Type":"ContainerDied","Data":"c221f4f310c9ba618592591303a3c43ae1a6f9ac57eb7957ec3498ce8ec72f1a"} Jun 10 16:54:33.747540 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.747501 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" event={"ID":"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b","Type":"ContainerStarted","Data":"be7b35780a76b76df7d064f6c4f557518f02c5f7eead082abd379f3c0fc5b21f"} Jun 10 16:54:33.834670 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.834610 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:33.919318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.919284 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv"] Jun 10 16:54:33.931249 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.931222 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:33.931667 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.931628 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv"] Jun 10 16:54:33.965219 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:33.965194 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh"] Jun 10 16:54:33.968129 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:54:33.968102 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5892c414_1017_4232_9c67_20f32325f713.slice/crio-8512781b0e753d8906f80f2f296a7175fc27adfd812e7d64e8707d017e4c1f77 WatchSource:0}: Error finding container 8512781b0e753d8906f80f2f296a7175fc27adfd812e7d64e8707d017e4c1f77: Status 404 returned error can't find the container with id 8512781b0e753d8906f80f2f296a7175fc27adfd812e7d64e8707d017e4c1f77 Jun 10 16:54:34.022776 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.022750 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.022856 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.022787 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.023012 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.022986 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xfx7\" (UniqueName: \"kubernetes.io/projected/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-kube-api-access-9xfx7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.124294 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.124235 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.124451 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.124382 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xfx7\" (UniqueName: \"kubernetes.io/projected/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-kube-api-access-9xfx7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.124451 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.124424 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.124658 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.124637 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.124715 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.124659 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.133675 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.133653 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xfx7\" (UniqueName: \"kubernetes.io/projected/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-kube-api-access-9xfx7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.249862 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.249836 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:34.382246 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.382222 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv"] Jun 10 16:54:34.408142 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:54:34.408117 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bcda0e6_8914_40f0_a6a2_00892aa3bdfd.slice/crio-f355ef5f62ab400d68351b9c2a95d095db72b6be7a8dc2812ffe0c805c1bc24b WatchSource:0}: Error finding container f355ef5f62ab400d68351b9c2a95d095db72b6be7a8dc2812ffe0c805c1bc24b: Status 404 returned error can't find the container with id f355ef5f62ab400d68351b9c2a95d095db72b6be7a8dc2812ffe0c805c1bc24b Jun 10 16:54:34.755172 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.755147 2553 generic.go:356] "Generic (PLEG): container finished" podID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerID="1d68aa4b2be9d5cffabda2b73ccaf0cc2b023af45700425eaed70692d743f4c1" exitCode=0 Jun 10 16:54:34.755515 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.755232 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" event={"ID":"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b","Type":"ContainerDied","Data":"1d68aa4b2be9d5cffabda2b73ccaf0cc2b023af45700425eaed70692d743f4c1"} Jun 10 16:54:34.756733 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.756688 2553 generic.go:356] "Generic (PLEG): container finished" podID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerID="198947c3bdc29a3b5ed76bde7516ee57cbc8cd327ea155bd3d0b8c8b4282935f" exitCode=0 Jun 10 16:54:34.756792 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.756765 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" event={"ID":"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd","Type":"ContainerDied","Data":"198947c3bdc29a3b5ed76bde7516ee57cbc8cd327ea155bd3d0b8c8b4282935f"} Jun 10 16:54:34.756845 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.756803 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" event={"ID":"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd","Type":"ContainerStarted","Data":"f355ef5f62ab400d68351b9c2a95d095db72b6be7a8dc2812ffe0c805c1bc24b"} Jun 10 16:54:34.758434 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.758413 2553 generic.go:356] "Generic (PLEG): container finished" podID="5892c414-1017-4232-9c67-20f32325f713" containerID="20b713356da285879f0f9fa3ede8054738f184449711535acf86cacc7591450e" exitCode=0 Jun 10 16:54:34.758520 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.758501 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" event={"ID":"5892c414-1017-4232-9c67-20f32325f713","Type":"ContainerDied","Data":"20b713356da285879f0f9fa3ede8054738f184449711535acf86cacc7591450e"} Jun 10 16:54:34.758569 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.758545 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" event={"ID":"5892c414-1017-4232-9c67-20f32325f713","Type":"ContainerStarted","Data":"8512781b0e753d8906f80f2f296a7175fc27adfd812e7d64e8707d017e4c1f77"} Jun 10 16:54:34.760595 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.760576 2553 generic.go:356] "Generic (PLEG): container finished" podID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerID="606893a8704b8442c067057d1f45a6cfcc807a39c6c901681fb318ceb3559456" exitCode=0 Jun 10 16:54:34.760666 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:34.760640 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" event={"ID":"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b","Type":"ContainerDied","Data":"606893a8704b8442c067057d1f45a6cfcc807a39c6c901681fb318ceb3559456"} Jun 10 16:54:35.767680 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.767611 2553 generic.go:356] "Generic (PLEG): container finished" podID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerID="3ed2def5e203e39ea3fedddb732895c0d8224d9a26925aae5f9d7b46ed86bd7c" exitCode=0 Jun 10 16:54:35.768045 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.767692 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" event={"ID":"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b","Type":"ContainerDied","Data":"3ed2def5e203e39ea3fedddb732895c0d8224d9a26925aae5f9d7b46ed86bd7c"} Jun 10 16:54:35.769631 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.769614 2553 generic.go:356] "Generic (PLEG): container finished" podID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerID="6040c10f1838ae1c115ddc2dc66977ae5948c9baeb9404a82e1b387c3a9a5e26" exitCode=0 Jun 10 16:54:35.769722 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.769669 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" event={"ID":"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b","Type":"ContainerDied","Data":"6040c10f1838ae1c115ddc2dc66977ae5948c9baeb9404a82e1b387c3a9a5e26"} Jun 10 16:54:35.771207 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.771189 2553 generic.go:356] "Generic (PLEG): container finished" podID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerID="98aeebd0fbb27f8bde4c0dcbc1cb38cfc283feac71b669f19063c4a67e9f3cee" exitCode=0 Jun 10 16:54:35.771287 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.771259 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" event={"ID":"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd","Type":"ContainerDied","Data":"98aeebd0fbb27f8bde4c0dcbc1cb38cfc283feac71b669f19063c4a67e9f3cee"} Jun 10 16:54:35.773017 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.772999 2553 generic.go:356] "Generic (PLEG): container finished" podID="5892c414-1017-4232-9c67-20f32325f713" containerID="c5112b48e66db988bd9cc8f2fefc3654721e21c0dbd7396ee362b20992bf9079" exitCode=0 Jun 10 16:54:35.773085 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:35.773041 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" event={"ID":"5892c414-1017-4232-9c67-20f32325f713","Type":"ContainerDied","Data":"c5112b48e66db988bd9cc8f2fefc3654721e21c0dbd7396ee362b20992bf9079"} Jun 10 16:54:36.779950 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:36.779915 2553 generic.go:356] "Generic (PLEG): container finished" podID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerID="7992bef3bf114dcd5c4c3f896cdebd414f719f946b09e8954d584ed0d5d75fd9" exitCode=0 Jun 10 16:54:36.780359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:36.779999 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" event={"ID":"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd","Type":"ContainerDied","Data":"7992bef3bf114dcd5c4c3f896cdebd414f719f946b09e8954d584ed0d5d75fd9"} Jun 10 16:54:36.781868 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:36.781848 2553 generic.go:356] "Generic (PLEG): container finished" podID="5892c414-1017-4232-9c67-20f32325f713" containerID="4459870e5b9934752a50873c9566804afe09d2c796b9d2c6b26976eed7a6de70" exitCode=0 Jun 10 16:54:36.782003 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:36.781873 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" event={"ID":"5892c414-1017-4232-9c67-20f32325f713","Type":"ContainerDied","Data":"4459870e5b9934752a50873c9566804afe09d2c796b9d2c6b26976eed7a6de70"} Jun 10 16:54:36.935584 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:36.935563 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:36.938441 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:36.938425 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:37.059006 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.058936 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-bundle\") pod \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " Jun 10 16:54:37.059006 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.058970 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4447\" (UniqueName: \"kubernetes.io/projected/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-kube-api-access-m4447\") pod \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " Jun 10 16:54:37.059006 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.059001 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-util\") pod \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " Jun 10 16:54:37.059245 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.059037 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-util\") pod \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\" (UID: \"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b\") " Jun 10 16:54:37.059245 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.059066 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzm8x\" (UniqueName: \"kubernetes.io/projected/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-kube-api-access-dzm8x\") pod \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " Jun 10 16:54:37.059245 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.059096 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-bundle\") pod \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\" (UID: \"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b\") " Jun 10 16:54:37.059542 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.059512 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-bundle" (OuterVolumeSpecName: "bundle") pod "a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" (UID: "a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:37.059754 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.059730 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-bundle" (OuterVolumeSpecName: "bundle") pod "7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" (UID: "7cecf4c2-e55b-44f6-ac8b-a873a6600b6b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:37.061208 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.061185 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-kube-api-access-dzm8x" (OuterVolumeSpecName: "kube-api-access-dzm8x") pod "7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" (UID: "7cecf4c2-e55b-44f6-ac8b-a873a6600b6b"). InnerVolumeSpecName "kube-api-access-dzm8x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:54:37.061432 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.061412 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-kube-api-access-m4447" (OuterVolumeSpecName: "kube-api-access-m4447") pod "a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" (UID: "a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b"). InnerVolumeSpecName "kube-api-access-m4447". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:54:37.065441 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.065409 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-util" (OuterVolumeSpecName: "util") pod "7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" (UID: "7cecf4c2-e55b-44f6-ac8b-a873a6600b6b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:37.067088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.067066 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-util" (OuterVolumeSpecName: "util") pod "a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" (UID: "a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:37.160404 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.160382 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzm8x\" (UniqueName: \"kubernetes.io/projected/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-kube-api-access-dzm8x\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:37.160404 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.160404 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-bundle\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:37.160525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.160413 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-bundle\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:37.160525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.160421 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4447\" (UniqueName: \"kubernetes.io/projected/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-kube-api-access-m4447\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:37.160525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.160428 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7cecf4c2-e55b-44f6-ac8b-a873a6600b6b-util\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:37.160525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.160436 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b-util\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:37.788014 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.787984 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" Jun 10 16:54:37.788441 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.788014 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw" event={"ID":"7cecf4c2-e55b-44f6-ac8b-a873a6600b6b","Type":"ContainerDied","Data":"be7b35780a76b76df7d064f6c4f557518f02c5f7eead082abd379f3c0fc5b21f"} Jun 10 16:54:37.788441 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.788058 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be7b35780a76b76df7d064f6c4f557518f02c5f7eead082abd379f3c0fc5b21f" Jun 10 16:54:37.789867 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.789839 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" Jun 10 16:54:37.790014 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.789880 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj" event={"ID":"a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b","Type":"ContainerDied","Data":"fa9649995ff240f745772048ac2f1979085f0e5913e955b20a43b26b77e862bf"} Jun 10 16:54:37.790014 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.789939 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa9649995ff240f745772048ac2f1979085f0e5913e955b20a43b26b77e862bf" Jun 10 16:54:37.940974 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.940955 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:37.942967 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:37.942952 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:38.068812 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.068739 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-bundle\") pod \"5892c414-1017-4232-9c67-20f32325f713\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " Jun 10 16:54:38.068812 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.068766 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-bundle\") pod \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " Jun 10 16:54:38.068812 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.068811 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99kbh\" (UniqueName: \"kubernetes.io/projected/5892c414-1017-4232-9c67-20f32325f713-kube-api-access-99kbh\") pod \"5892c414-1017-4232-9c67-20f32325f713\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " Jun 10 16:54:38.069091 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.068830 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-util\") pod \"5892c414-1017-4232-9c67-20f32325f713\" (UID: \"5892c414-1017-4232-9c67-20f32325f713\") " Jun 10 16:54:38.069091 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.068845 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-util\") pod \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " Jun 10 16:54:38.069091 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.068860 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xfx7\" (UniqueName: \"kubernetes.io/projected/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-kube-api-access-9xfx7\") pod \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\" (UID: \"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd\") " Jun 10 16:54:38.069355 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.069332 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-bundle" (OuterVolumeSpecName: "bundle") pod "0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" (UID: "0bcda0e6-8914-40f0-a6a2-00892aa3bdfd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:38.069482 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.069457 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-bundle" (OuterVolumeSpecName: "bundle") pod "5892c414-1017-4232-9c67-20f32325f713" (UID: "5892c414-1017-4232-9c67-20f32325f713"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:38.071464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.071437 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-kube-api-access-9xfx7" (OuterVolumeSpecName: "kube-api-access-9xfx7") pod "0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" (UID: "0bcda0e6-8914-40f0-a6a2-00892aa3bdfd"). InnerVolumeSpecName "kube-api-access-9xfx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:54:38.071464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.071445 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5892c414-1017-4232-9c67-20f32325f713-kube-api-access-99kbh" (OuterVolumeSpecName: "kube-api-access-99kbh") pod "5892c414-1017-4232-9c67-20f32325f713" (UID: "5892c414-1017-4232-9c67-20f32325f713"). InnerVolumeSpecName "kube-api-access-99kbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:54:38.074456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.074434 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-util" (OuterVolumeSpecName: "util") pod "5892c414-1017-4232-9c67-20f32325f713" (UID: "5892c414-1017-4232-9c67-20f32325f713"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:38.074618 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.074596 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-util" (OuterVolumeSpecName: "util") pod "0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" (UID: "0bcda0e6-8914-40f0-a6a2-00892aa3bdfd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:54:38.169972 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.169948 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-bundle\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:38.169972 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.169967 2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-bundle\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:38.170111 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.169976 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99kbh\" (UniqueName: \"kubernetes.io/projected/5892c414-1017-4232-9c67-20f32325f713-kube-api-access-99kbh\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:38.170111 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.169985 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5892c414-1017-4232-9c67-20f32325f713-util\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:38.170111 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.169992 2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-util\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:38.170111 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.170000 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xfx7\" (UniqueName: \"kubernetes.io/projected/0bcda0e6-8914-40f0-a6a2-00892aa3bdfd-kube-api-access-9xfx7\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:54:38.796776 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.796747 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" Jun 10 16:54:38.797153 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.796747 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv" event={"ID":"0bcda0e6-8914-40f0-a6a2-00892aa3bdfd","Type":"ContainerDied","Data":"f355ef5f62ab400d68351b9c2a95d095db72b6be7a8dc2812ffe0c805c1bc24b"} Jun 10 16:54:38.797153 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.796871 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f355ef5f62ab400d68351b9c2a95d095db72b6be7a8dc2812ffe0c805c1bc24b" Jun 10 16:54:38.798751 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.798733 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" Jun 10 16:54:38.798892 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.798767 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh" event={"ID":"5892c414-1017-4232-9c67-20f32325f713","Type":"ContainerDied","Data":"8512781b0e753d8906f80f2f296a7175fc27adfd812e7d64e8707d017e4c1f77"} Jun 10 16:54:38.798892 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:38.798806 2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8512781b0e753d8906f80f2f296a7175fc27adfd812e7d64e8707d017e4c1f77" Jun 10 16:54:44.924374 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924336 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q"] Jun 10 16:54:44.924853 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924833 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5892c414-1017-4232-9c67-20f32325f713" containerName="util" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924856 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5892c414-1017-4232-9c67-20f32325f713" containerName="util" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924869 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerName="pull" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924877 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerName="pull" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924889 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerName="extract" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924898 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerName="extract" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924923 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerName="extract" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924931 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerName="extract" Jun 10 16:54:44.924955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924956 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerName="util" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924964 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerName="util" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924981 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerName="extract" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.924989 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerName="extract" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925002 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerName="util" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925010 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerName="util" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925021 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerName="pull" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925029 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerName="pull" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925039 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5892c414-1017-4232-9c67-20f32325f713" containerName="pull" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925046 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5892c414-1017-4232-9c67-20f32325f713" containerName="pull" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925060 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerName="util" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925067 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerName="util" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925080 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerName="pull" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925088 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerName="pull" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925098 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5892c414-1017-4232-9c67-20f32325f713" containerName="extract" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925106 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5892c414-1017-4232-9c67-20f32325f713" containerName="extract" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925198 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cecf4c2-e55b-44f6-ac8b-a873a6600b6b" containerName="extract" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925210 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5892c414-1017-4232-9c67-20f32325f713" containerName="extract" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925221 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b" containerName="extract" Jun 10 16:54:44.925313 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.925228 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bcda0e6-8914-40f0-a6a2-00892aa3bdfd" containerName="extract" Jun 10 16:54:44.929492 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.929472 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:44.932919 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.932884 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-n4tj9\"" Jun 10 16:54:44.949576 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:44.949554 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q"] Jun 10 16:54:45.023345 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.023322 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtvr\" (UniqueName: \"kubernetes.io/projected/27a7223f-0d2d-4c65-bd54-193e11e4860b-kube-api-access-tbtvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:45.023553 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.023361 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27a7223f-0d2d-4c65-bd54-193e11e4860b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:45.124168 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.124142 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtvr\" (UniqueName: \"kubernetes.io/projected/27a7223f-0d2d-4c65-bd54-193e11e4860b-kube-api-access-tbtvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:45.124248 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.124187 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27a7223f-0d2d-4c65-bd54-193e11e4860b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:45.124568 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.124552 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27a7223f-0d2d-4c65-bd54-193e11e4860b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:45.134128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.134100 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtvr\" (UniqueName: \"kubernetes.io/projected/27a7223f-0d2d-4c65-bd54-193e11e4860b-kube-api-access-tbtvr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:45.238838 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.238814 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:45.379634 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.379607 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q"] Jun 10 16:54:45.380779 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:54:45.380753 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a7223f_0d2d_4c65_bd54_193e11e4860b.slice/crio-78b651485e7a9b231caf3d0372d7e2f53f1ceba60d14751931f200acbfa8456a WatchSource:0}: Error finding container 78b651485e7a9b231caf3d0372d7e2f53f1ceba60d14751931f200acbfa8456a: Status 404 returned error can't find the container with id 78b651485e7a9b231caf3d0372d7e2f53f1ceba60d14751931f200acbfa8456a Jun 10 16:54:45.835441 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:45.835406 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" event={"ID":"27a7223f-0d2d-4c65-bd54-193e11e4860b","Type":"ContainerStarted","Data":"78b651485e7a9b231caf3d0372d7e2f53f1ceba60d14751931f200acbfa8456a"} Jun 10 16:54:46.439097 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:46.439078 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:54:46.439502 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:46.439484 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:54:51.871288 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:51.871262 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" event={"ID":"27a7223f-0d2d-4c65-bd54-193e11e4860b","Type":"ContainerStarted","Data":"55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241"} Jun 10 16:54:51.871578 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:51.871408 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:54:51.902080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:51.902038 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" podStartSLOduration=1.4855126570000001 podStartE2EDuration="7.902024526s" totalImagesPullingTime="6.416511869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:54:51.898576116 +0000 UTC m=+605.889878796" watchObservedRunningTime="2026-06-10 16:54:51.902024526 +0000 UTC m=+605.893327257" Jun 10 16:54:53.347094 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.347061 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2"] Jun 10 16:54:53.350653 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.350635 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" Jun 10 16:54:53.353936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.353916 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-n9p6d\"" Jun 10 16:54:53.372526 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.372506 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2"] Jun 10 16:54:53.491970 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.491939 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-659vj\" (UniqueName: \"kubernetes.io/projected/5ad6da15-65a0-4079-903b-e12af85be7b5-kube-api-access-659vj\") pod \"authorino-operator-75cc8d5cb7-xgwj2\" (UID: \"5ad6da15-65a0-4079-903b-e12af85be7b5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" Jun 10 16:54:53.593157 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.593123 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-659vj\" (UniqueName: \"kubernetes.io/projected/5ad6da15-65a0-4079-903b-e12af85be7b5-kube-api-access-659vj\") pod \"authorino-operator-75cc8d5cb7-xgwj2\" (UID: \"5ad6da15-65a0-4079-903b-e12af85be7b5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" Jun 10 16:54:53.604424 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.604362 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-659vj\" (UniqueName: \"kubernetes.io/projected/5ad6da15-65a0-4079-903b-e12af85be7b5-kube-api-access-659vj\") pod \"authorino-operator-75cc8d5cb7-xgwj2\" (UID: \"5ad6da15-65a0-4079-903b-e12af85be7b5\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" Jun 10 16:54:53.660980 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.660954 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" Jun 10 16:54:53.800744 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.800715 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2"] Jun 10 16:54:53.883078 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:53.883012 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" event={"ID":"5ad6da15-65a0-4079-903b-e12af85be7b5","Type":"ContainerStarted","Data":"dfcf9eea1683c5ac908b624a9e1df016b5583eba7c1d1d155128075413b05222"} Jun 10 16:54:56.900889 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:56.900855 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" event={"ID":"5ad6da15-65a0-4079-903b-e12af85be7b5","Type":"ContainerStarted","Data":"b4ae8a3927c418fadb0f3735039419016c15359a2deb273de4af98d76de280fe"} Jun 10 16:54:56.901291 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:56.900995 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" Jun 10 16:54:56.919817 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:54:56.919768 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" podStartSLOduration=1.384484899 podStartE2EDuration="3.919754995s" totalImagesPullingTime="2.535270096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:54:56.918475125 +0000 UTC m=+610.909777780" watchObservedRunningTime="2026-06-10 16:54:56.919754995 +0000 UTC m=+610.911057650" Jun 10 16:55:02.879644 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:02.879614 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:04.553259 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.553218 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q"] Jun 10 16:55:04.553695 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.553429 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" containerName="manager" containerID="cri-o://55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241" gracePeriod=2 Jun 10 16:55:04.568374 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.568352 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q"] Jun 10 16:55:04.627533 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.627502 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w"] Jun 10 16:55:04.628491 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.628466 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" containerName="manager" Jun 10 16:55:04.628620 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.628610 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" containerName="manager" Jun 10 16:55:04.628935 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.628900 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" containerName="manager" Jun 10 16:55:04.633246 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.633205 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.636028 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:04.636002 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" is forbidden: User \"system:node:ip-10-0-128-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-59.ec2.internal' and this object" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:04.654293 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.654270 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w"] Jun 10 16:55:04.788569 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.788529 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kjnd\" (UniqueName: \"kubernetes.io/projected/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-kube-api-access-2kjnd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2sp9w\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.788747 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.788599 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2sp9w\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.809721 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.809665 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:04.812071 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:04.812047 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" is forbidden: User \"system:node:ip-10-0-128-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-59.ec2.internal' and this object" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:04.889647 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.889617 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kjnd\" (UniqueName: \"kubernetes.io/projected/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-kube-api-access-2kjnd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2sp9w\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.889753 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.889661 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2sp9w\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.890002 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.889986 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2sp9w\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.904089 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.904066 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kjnd\" (UniqueName: \"kubernetes.io/projected/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-kube-api-access-2kjnd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2sp9w\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.944002 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.943977 2553 generic.go:356] "Generic (PLEG): container finished" podID="27a7223f-0d2d-4c65-bd54-193e11e4860b" containerID="55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241" exitCode=0 Jun 10 16:55:04.944088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.944017 2553 scope.go:117] "RemoveContainer" containerID="55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241" Jun 10 16:55:04.944088 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.944024 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:04.946420 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:04.946393 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" is forbidden: User \"system:node:ip-10-0-128-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-59.ec2.internal' and this object" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:04.948669 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.948650 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:04.954848 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.954832 2553 scope.go:117] "RemoveContainer" containerID="55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241" Jun 10 16:55:04.956296 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:04.956276 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241\": container with ID starting with 55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241 not found: ID does not exist" containerID="55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241" Jun 10 16:55:04.956380 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.956304 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241"} err="failed to get container status \"55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241\": rpc error: code = NotFound desc = could not find container \"55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241\": container with ID starting with 55300d712e1e97eed389687ab2560c40e14af0a978ee31c485b7942bbbf07241 not found: ID does not exist" Jun 10 16:55:04.990774 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.990742 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27a7223f-0d2d-4c65-bd54-193e11e4860b-extensions-socket-volume\") pod \"27a7223f-0d2d-4c65-bd54-193e11e4860b\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " Jun 10 16:55:04.990927 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.990825 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbtvr\" (UniqueName: \"kubernetes.io/projected/27a7223f-0d2d-4c65-bd54-193e11e4860b-kube-api-access-tbtvr\") pod \"27a7223f-0d2d-4c65-bd54-193e11e4860b\" (UID: \"27a7223f-0d2d-4c65-bd54-193e11e4860b\") " Jun 10 16:55:04.991186 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.991162 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a7223f-0d2d-4c65-bd54-193e11e4860b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "27a7223f-0d2d-4c65-bd54-193e11e4860b" (UID: "27a7223f-0d2d-4c65-bd54-193e11e4860b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:55:04.992762 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:04.992745 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a7223f-0d2d-4c65-bd54-193e11e4860b-kube-api-access-tbtvr" (OuterVolumeSpecName: "kube-api-access-tbtvr") pod "27a7223f-0d2d-4c65-bd54-193e11e4860b" (UID: "27a7223f-0d2d-4c65-bd54-193e11e4860b"). InnerVolumeSpecName "kube-api-access-tbtvr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:55:05.084539 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:05.084514 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w"] Jun 10 16:55:05.086472 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:55:05.086446 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5d6365_3951_4f91_a0b2_4a7fcf14d4d5.slice/crio-be4cfd227d4cb234f7947fc521186b6756468d9509b6ed0a74626faa8e455ee2 WatchSource:0}: Error finding container be4cfd227d4cb234f7947fc521186b6756468d9509b6ed0a74626faa8e455ee2: Status 404 returned error can't find the container with id be4cfd227d4cb234f7947fc521186b6756468d9509b6ed0a74626faa8e455ee2 Jun 10 16:55:05.091544 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:05.091522 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27a7223f-0d2d-4c65-bd54-193e11e4860b-extensions-socket-volume\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:55:05.091544 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:05.091545 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbtvr\" (UniqueName: \"kubernetes.io/projected/27a7223f-0d2d-4c65-bd54-193e11e4860b-kube-api-access-tbtvr\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:55:05.254035 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:05.254004 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" is forbidden: User \"system:node:ip-10-0-128-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-59.ec2.internal' and this object" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:05.951333 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:05.951225 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" event={"ID":"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5","Type":"ContainerStarted","Data":"79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677"} Jun 10 16:55:05.951733 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:05.951356 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:05.951733 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:05.951395 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" event={"ID":"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5","Type":"ContainerStarted","Data":"be4cfd227d4cb234f7947fc521186b6756468d9509b6ed0a74626faa8e455ee2"} Jun 10 16:55:05.953950 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:05.953925 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" is forbidden: User \"system:node:ip-10-0-128-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-59.ec2.internal' and this object" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:05.980692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:05.980653 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" podStartSLOduration=1.980641058 podStartE2EDuration="1.980641058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:55:05.979138632 +0000 UTC m=+619.970441290" watchObservedRunningTime="2026-06-10 16:55:05.980641058 +0000 UTC m=+619.971943714" Jun 10 16:55:06.437442 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:06.437410 2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-vjh2q\" is forbidden: User \"system:node:ip-10-0-128-59.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-59.ec2.internal' and this object" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-vjh2q" Jun 10 16:55:06.438629 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:06.438609 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a7223f-0d2d-4c65-bd54-193e11e4860b" path="/var/lib/kubelet/pods/27a7223f-0d2d-4c65-bd54-193e11e4860b/volumes" Jun 10 16:55:07.908762 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:07.908737 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xgwj2" Jun 10 16:55:16.959218 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:16.959189 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:39.637628 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:39.637591 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w"] Jun 10 16:55:39.638109 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:39.637788 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" podUID="8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" containerName="manager" containerID="cri-o://79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677" gracePeriod=10 Jun 10 16:55:39.887409 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:39.887388 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:39.975187 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:39.975155 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kjnd\" (UniqueName: \"kubernetes.io/projected/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-kube-api-access-2kjnd\") pod \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " Jun 10 16:55:39.975340 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:39.975206 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-extensions-socket-volume\") pod \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\" (UID: \"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5\") " Jun 10 16:55:39.975684 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:39.975649 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" (UID: "8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 16:55:39.977153 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:39.977129 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-kube-api-access-2kjnd" (OuterVolumeSpecName: "kube-api-access-2kjnd") pod "8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" (UID: "8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5"). InnerVolumeSpecName "kube-api-access-2kjnd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:55:40.076359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.076325 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kjnd\" (UniqueName: \"kubernetes.io/projected/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-kube-api-access-2kjnd\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:55:40.076359 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.076354 2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5-extensions-socket-volume\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:55:40.130417 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.130381 2553 generic.go:356] "Generic (PLEG): container finished" podID="8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" containerID="79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677" exitCode=0 Jun 10 16:55:40.130550 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.130443 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" Jun 10 16:55:40.130550 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.130457 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" event={"ID":"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5","Type":"ContainerDied","Data":"79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677"} Jun 10 16:55:40.130550 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.130544 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w" event={"ID":"8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5","Type":"ContainerDied","Data":"be4cfd227d4cb234f7947fc521186b6756468d9509b6ed0a74626faa8e455ee2"} Jun 10 16:55:40.130655 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.130566 2553 scope.go:117] "RemoveContainer" containerID="79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677" Jun 10 16:55:40.141471 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.141421 2553 scope.go:117] "RemoveContainer" containerID="79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677" Jun 10 16:55:40.141899 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:55:40.141874 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677\": container with ID starting with 79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677 not found: ID does not exist" containerID="79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677" Jun 10 16:55:40.142024 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.141978 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677"} err="failed to get container status \"79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677\": rpc error: code = NotFound desc = could not find container \"79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677\": container with ID starting with 79a745cc6ecc8de8620ba28ce2961d8f8abca649b9daf800e73a004059ab6677 not found: ID does not exist" Jun 10 16:55:40.152742 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.152714 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w"] Jun 10 16:55:40.158527 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.158507 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2sp9w"] Jun 10 16:55:40.438576 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:40.438500 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" path="/var/lib/kubelet/pods/8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5/volumes" Jun 10 16:55:55.932340 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:55.932305 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t"] Jun 10 16:55:55.932901 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:55.932884 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" containerName="manager" Jun 10 16:55:55.932901 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:55.932927 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" containerName="manager" Jun 10 16:55:55.933064 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:55.933024 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5d6365-3951-4f91-a0b2-4a7fcf14d4d5" containerName="manager" Jun 10 16:55:55.937898 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:55.937877 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:55.940414 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:55.940392 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rssxs\"" Jun 10 16:55:55.949875 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:55.949847 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t"] Jun 10 16:55:56.102429 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102389 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102429 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102433 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102649 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102649 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102538 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102649 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102579 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkr9\" (UniqueName: \"kubernetes.io/projected/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-kube-api-access-rwkr9\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102649 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102601 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102649 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102618 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102649 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102636 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.102883 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.102654 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204003 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.203898 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204003 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.203955 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204003 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.203994 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204013 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkr9\" (UniqueName: \"kubernetes.io/projected/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-kube-api-access-rwkr9\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204053 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204073 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204098 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204273 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204225 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204723 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204566 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204723 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204637 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204723 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204657 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204874 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204783 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.204955 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.204887 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.206425 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.206390 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.206561 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.206538 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.212493 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.212421 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.212610 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.212594 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkr9\" (UniqueName: \"kubernetes.io/projected/7f4b0037-7a8c-4235-9707-fe6d1fb29dd4-kube-api-access-rwkr9\") pod \"maas-default-gateway-openshift-default-687ff6996-4x46t\" (UID: \"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.248394 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.248363 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:56.381227 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.381205 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t"] Jun 10 16:55:56.382628 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:55:56.382593 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4b0037_7a8c_4235_9707_fe6d1fb29dd4.slice/crio-2090181454a7bd79f364c9d3059c615a159f353c61f8bb5f3eacae0980c63ca8 WatchSource:0}: Error finding container 2090181454a7bd79f364c9d3059c615a159f353c61f8bb5f3eacae0980c63ca8: Status 404 returned error can't find the container with id 2090181454a7bd79f364c9d3059c615a159f353c61f8bb5f3eacae0980c63ca8 Jun 10 16:55:56.384749 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.384720 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:55:56.384821 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.384781 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:55:56.384821 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:56.384808 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:55:57.221398 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:57.221365 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" event={"ID":"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4","Type":"ContainerStarted","Data":"6e202784f817b2a7ddef712d0b9c6b035308e789ce2089b3749cc12847720797"} Jun 10 16:55:57.221737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:57.221422 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" event={"ID":"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4","Type":"ContainerStarted","Data":"2090181454a7bd79f364c9d3059c615a159f353c61f8bb5f3eacae0980c63ca8"} Jun 10 16:55:57.246630 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:57.246585 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" podStartSLOduration=2.246570659 podStartE2EDuration="2.246570659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:55:57.244200366 +0000 UTC m=+671.235503020" watchObservedRunningTime="2026-06-10 16:55:57.246570659 +0000 UTC m=+671.237873313" Jun 10 16:55:57.248888 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:57.248865 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:57.253525 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:57.253506 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:58.229140 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:58.229112 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:55:58.229980 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:55:58.229958 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:56:00.595513 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.595478 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:56:00.599010 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.598994 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:00.601340 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.601319 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 16:56:00.601464 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.601322 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ft79b\"" Jun 10 16:56:00.607992 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.607963 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:56:00.638737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.638711 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:56:00.739091 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.739062 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlwrl\" (UniqueName: \"kubernetes.io/projected/2a38e567-5370-4c69-8bbd-164a7a15ff73-kube-api-access-vlwrl\") pod \"limitador-limitador-54d6d988d5-bng4s\" (UID: \"2a38e567-5370-4c69-8bbd-164a7a15ff73\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:00.739188 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.739099 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a38e567-5370-4c69-8bbd-164a7a15ff73-config-file\") pod \"limitador-limitador-54d6d988d5-bng4s\" (UID: \"2a38e567-5370-4c69-8bbd-164a7a15ff73\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:00.840224 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.840195 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlwrl\" (UniqueName: \"kubernetes.io/projected/2a38e567-5370-4c69-8bbd-164a7a15ff73-kube-api-access-vlwrl\") pod \"limitador-limitador-54d6d988d5-bng4s\" (UID: \"2a38e567-5370-4c69-8bbd-164a7a15ff73\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:00.840346 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.840231 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a38e567-5370-4c69-8bbd-164a7a15ff73-config-file\") pod \"limitador-limitador-54d6d988d5-bng4s\" (UID: \"2a38e567-5370-4c69-8bbd-164a7a15ff73\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:00.840802 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.840785 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2a38e567-5370-4c69-8bbd-164a7a15ff73-config-file\") pod \"limitador-limitador-54d6d988d5-bng4s\" (UID: \"2a38e567-5370-4c69-8bbd-164a7a15ff73\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:00.848868 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.848827 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlwrl\" (UniqueName: \"kubernetes.io/projected/2a38e567-5370-4c69-8bbd-164a7a15ff73-kube-api-access-vlwrl\") pod \"limitador-limitador-54d6d988d5-bng4s\" (UID: \"2a38e567-5370-4c69-8bbd-164a7a15ff73\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:00.909899 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:00.909872 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:01.036532 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.036510 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:56:01.038667 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:56:01.038643 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a38e567_5370_4c69_8bbd_164a7a15ff73.slice/crio-af3a3fc1676c6b17f2fc4533cde27380e68e41d310fe40bd2a1a6448f934a182 WatchSource:0}: Error finding container af3a3fc1676c6b17f2fc4533cde27380e68e41d310fe40bd2a1a6448f934a182: Status 404 returned error can't find the container with id af3a3fc1676c6b17f2fc4533cde27380e68e41d310fe40bd2a1a6448f934a182 Jun 10 16:56:01.090574 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.090553 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zq76t"] Jun 10 16:56:01.094976 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.094961 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zq76t" Jun 10 16:56:01.097373 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.097354 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bkf8x\"" Jun 10 16:56:01.102092 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.102066 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zq76t"] Jun 10 16:56:01.193412 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.193387 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfrpn"] Jun 10 16:56:01.196799 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.196783 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfrpn" Jun 10 16:56:01.201606 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.201586 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfrpn"] Jun 10 16:56:01.245294 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.245266 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cqjc\" (UniqueName: \"kubernetes.io/projected/efba97dc-abad-4b79-8d8e-fd6c623e1f58-kube-api-access-5cqjc\") pod \"authorino-58cd955675-zq76t\" (UID: \"efba97dc-abad-4b79-8d8e-fd6c623e1f58\") " pod="kuadrant-system/authorino-58cd955675-zq76t" Jun 10 16:56:01.249372 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.249352 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" event={"ID":"2a38e567-5370-4c69-8bbd-164a7a15ff73","Type":"ContainerStarted","Data":"af3a3fc1676c6b17f2fc4533cde27380e68e41d310fe40bd2a1a6448f934a182"} Jun 10 16:56:01.345958 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.345934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cqjc\" (UniqueName: \"kubernetes.io/projected/efba97dc-abad-4b79-8d8e-fd6c623e1f58-kube-api-access-5cqjc\") pod \"authorino-58cd955675-zq76t\" (UID: \"efba97dc-abad-4b79-8d8e-fd6c623e1f58\") " pod="kuadrant-system/authorino-58cd955675-zq76t" Jun 10 16:56:01.346049 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.346008 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktkpx\" (UniqueName: \"kubernetes.io/projected/b359e389-220c-4d76-8f6c-bdb571ff341f-kube-api-access-ktkpx\") pod \"authorino-75d556bd77-nfrpn\" (UID: \"b359e389-220c-4d76-8f6c-bdb571ff341f\") " pod="kuadrant-system/authorino-75d556bd77-nfrpn" Jun 10 16:56:01.354472 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.354411 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cqjc\" (UniqueName: \"kubernetes.io/projected/efba97dc-abad-4b79-8d8e-fd6c623e1f58-kube-api-access-5cqjc\") pod \"authorino-58cd955675-zq76t\" (UID: \"efba97dc-abad-4b79-8d8e-fd6c623e1f58\") " pod="kuadrant-system/authorino-58cd955675-zq76t" Jun 10 16:56:01.404173 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.404149 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zq76t" Jun 10 16:56:01.446593 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.446564 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktkpx\" (UniqueName: \"kubernetes.io/projected/b359e389-220c-4d76-8f6c-bdb571ff341f-kube-api-access-ktkpx\") pod \"authorino-75d556bd77-nfrpn\" (UID: \"b359e389-220c-4d76-8f6c-bdb571ff341f\") " pod="kuadrant-system/authorino-75d556bd77-nfrpn" Jun 10 16:56:01.455468 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.455442 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktkpx\" (UniqueName: \"kubernetes.io/projected/b359e389-220c-4d76-8f6c-bdb571ff341f-kube-api-access-ktkpx\") pod \"authorino-75d556bd77-nfrpn\" (UID: \"b359e389-220c-4d76-8f6c-bdb571ff341f\") " pod="kuadrant-system/authorino-75d556bd77-nfrpn" Jun 10 16:56:01.505874 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.505848 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfrpn" Jun 10 16:56:01.530133 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.530112 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zq76t"] Jun 10 16:56:01.532038 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:56:01.532013 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefba97dc_abad_4b79_8d8e_fd6c623e1f58.slice/crio-86c30b7ec0ad43a0cf875e8a4b8e7958dad02f27e609aa7fdca7111fb473a8bf WatchSource:0}: Error finding container 86c30b7ec0ad43a0cf875e8a4b8e7958dad02f27e609aa7fdca7111fb473a8bf: Status 404 returned error can't find the container with id 86c30b7ec0ad43a0cf875e8a4b8e7958dad02f27e609aa7fdca7111fb473a8bf Jun 10 16:56:01.686534 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:01.686476 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfrpn"] Jun 10 16:56:01.688419 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:56:01.688386 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb359e389_220c_4d76_8f6c_bdb571ff341f.slice/crio-572e5144439e44bb77e21742c121569b234fc5771bae417f4ef69b019ddc5b74 WatchSource:0}: Error finding container 572e5144439e44bb77e21742c121569b234fc5771bae417f4ef69b019ddc5b74: Status 404 returned error can't find the container with id 572e5144439e44bb77e21742c121569b234fc5771bae417f4ef69b019ddc5b74 Jun 10 16:56:02.261925 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:02.261860 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfrpn" event={"ID":"b359e389-220c-4d76-8f6c-bdb571ff341f","Type":"ContainerStarted","Data":"572e5144439e44bb77e21742c121569b234fc5771bae417f4ef69b019ddc5b74"} Jun 10 16:56:02.264972 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:02.264935 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zq76t" event={"ID":"efba97dc-abad-4b79-8d8e-fd6c623e1f58","Type":"ContainerStarted","Data":"86c30b7ec0ad43a0cf875e8a4b8e7958dad02f27e609aa7fdca7111fb473a8bf"} Jun 10 16:56:06.302446 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.302412 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zq76t" event={"ID":"efba97dc-abad-4b79-8d8e-fd6c623e1f58","Type":"ContainerStarted","Data":"64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e"} Jun 10 16:56:06.303962 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.303933 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" event={"ID":"2a38e567-5370-4c69-8bbd-164a7a15ff73","Type":"ContainerStarted","Data":"1c0455c886386565918b3f8ded05742633d197dd28bb8548a2ddce19ce8243f9"} Jun 10 16:56:06.304101 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.304026 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:56:06.305389 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.305358 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfrpn" event={"ID":"b359e389-220c-4d76-8f6c-bdb571ff341f","Type":"ContainerStarted","Data":"bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc"} Jun 10 16:56:06.318348 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.318312 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zq76t" podStartSLOduration=0.983661973 podStartE2EDuration="5.318300028s" totalImagesPullingTime="4.334638055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:56:06.318001869 +0000 UTC m=+680.309304527" watchObservedRunningTime="2026-06-10 16:56:06.318300028 +0000 UTC m=+680.309602683" Jun 10 16:56:06.344385 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.344340 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nfrpn" podStartSLOduration=1.153408901 podStartE2EDuration="5.344325061s" totalImagesPullingTime="4.19091616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:56:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:56:06.343249213 +0000 UTC m=+680.334551891" watchObservedRunningTime="2026-06-10 16:56:06.344325061 +0000 UTC m=+680.335627717" Jun 10 16:56:06.365410 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.365355 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" podStartSLOduration=1.538397554 podStartE2EDuration="6.365335211s" totalImagesPullingTime="4.826937657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:56:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:56:06.361635755 +0000 UTC m=+680.352938411" watchObservedRunningTime="2026-06-10 16:56:06.365335211 +0000 UTC m=+680.356637868" Jun 10 16:56:06.371810 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:06.371782 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zq76t"] Jun 10 16:56:08.316410 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:08.316370 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zq76t" podUID="efba97dc-abad-4b79-8d8e-fd6c623e1f58" containerName="authorino" containerID="cri-o://64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e" gracePeriod=30 Jun 10 16:56:08.562664 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:08.562634 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zq76t" Jun 10 16:56:08.612648 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:08.612571 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cqjc\" (UniqueName: \"kubernetes.io/projected/efba97dc-abad-4b79-8d8e-fd6c623e1f58-kube-api-access-5cqjc\") pod \"efba97dc-abad-4b79-8d8e-fd6c623e1f58\" (UID: \"efba97dc-abad-4b79-8d8e-fd6c623e1f58\") " Jun 10 16:56:08.614590 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:08.614567 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efba97dc-abad-4b79-8d8e-fd6c623e1f58-kube-api-access-5cqjc" (OuterVolumeSpecName: "kube-api-access-5cqjc") pod "efba97dc-abad-4b79-8d8e-fd6c623e1f58" (UID: "efba97dc-abad-4b79-8d8e-fd6c623e1f58"). InnerVolumeSpecName "kube-api-access-5cqjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:56:08.713845 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:08.713818 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cqjc\" (UniqueName: \"kubernetes.io/projected/efba97dc-abad-4b79-8d8e-fd6c623e1f58-kube-api-access-5cqjc\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:56:09.322682 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.322645 2553 generic.go:356] "Generic (PLEG): container finished" podID="efba97dc-abad-4b79-8d8e-fd6c623e1f58" containerID="64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e" exitCode=0 Jun 10 16:56:09.323128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.322683 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zq76t" event={"ID":"efba97dc-abad-4b79-8d8e-fd6c623e1f58","Type":"ContainerDied","Data":"64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e"} Jun 10 16:56:09.323128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.322734 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zq76t" event={"ID":"efba97dc-abad-4b79-8d8e-fd6c623e1f58","Type":"ContainerDied","Data":"86c30b7ec0ad43a0cf875e8a4b8e7958dad02f27e609aa7fdca7111fb473a8bf"} Jun 10 16:56:09.323128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.322750 2553 scope.go:117] "RemoveContainer" containerID="64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e" Jun 10 16:56:09.323128 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.322691 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zq76t" Jun 10 16:56:09.331773 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.331758 2553 scope.go:117] "RemoveContainer" containerID="64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e" Jun 10 16:56:09.332051 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:56:09.332029 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e\": container with ID starting with 64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e not found: ID does not exist" containerID="64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e" Jun 10 16:56:09.332101 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.332059 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e"} err="failed to get container status \"64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e\": rpc error: code = NotFound desc = could not find container \"64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e\": container with ID starting with 64547f2154009540a534c3e4b9059b0563e1450dd498ed38c0fb9b1e20e7299e not found: ID does not exist" Jun 10 16:56:09.343606 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.343583 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zq76t"] Jun 10 16:56:09.347619 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:09.347600 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zq76t"] Jun 10 16:56:10.438270 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:10.438239 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efba97dc-abad-4b79-8d8e-fd6c623e1f58" path="/var/lib/kubelet/pods/efba97dc-abad-4b79-8d8e-fd6c623e1f58/volumes" Jun 10 16:56:17.312324 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:56:17.312296 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-bng4s" Jun 10 16:57:37.055564 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.055533 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pz2dx"] Jun 10 16:57:37.056011 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.055949 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efba97dc-abad-4b79-8d8e-fd6c623e1f58" containerName="authorino" Jun 10 16:57:37.056011 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.055962 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="efba97dc-abad-4b79-8d8e-fd6c623e1f58" containerName="authorino" Jun 10 16:57:37.056084 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.056040 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="efba97dc-abad-4b79-8d8e-fd6c623e1f58" containerName="authorino" Jun 10 16:57:37.058021 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.058006 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pz2dx" Jun 10 16:57:37.065755 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.065726 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pz2dx"] Jun 10 16:57:37.152657 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.152633 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcccd\" (UniqueName: \"kubernetes.io/projected/afd78bb0-250f-449e-9b70-d0dc60ae60cc-kube-api-access-lcccd\") pod \"authorino-5d4b67c446-pz2dx\" (UID: \"afd78bb0-250f-449e-9b70-d0dc60ae60cc\") " pod="kuadrant-system/authorino-5d4b67c446-pz2dx" Jun 10 16:57:37.253783 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.253757 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcccd\" (UniqueName: \"kubernetes.io/projected/afd78bb0-250f-449e-9b70-d0dc60ae60cc-kube-api-access-lcccd\") pod \"authorino-5d4b67c446-pz2dx\" (UID: \"afd78bb0-250f-449e-9b70-d0dc60ae60cc\") " pod="kuadrant-system/authorino-5d4b67c446-pz2dx" Jun 10 16:57:37.255014 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.254991 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pz2dx"] Jun 10 16:57:37.255222 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:57:37.255202 2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lcccd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-pz2dx" podUID="afd78bb0-250f-449e-9b70-d0dc60ae60cc" Jun 10 16:57:37.264524 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.264503 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcccd\" (UniqueName: \"kubernetes.io/projected/afd78bb0-250f-449e-9b70-d0dc60ae60cc-kube-api-access-lcccd\") pod \"authorino-5d4b67c446-pz2dx\" (UID: \"afd78bb0-250f-449e-9b70-d0dc60ae60cc\") " pod="kuadrant-system/authorino-5d4b67c446-pz2dx" Jun 10 16:57:37.290745 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.290718 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6584f5d557-mtwjx"] Jun 10 16:57:37.293080 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.293065 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.295429 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.295411 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 16:57:37.301243 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.301223 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6584f5d557-mtwjx"] Jun 10 16:57:37.354367 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.354317 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3abe62-0afe-4cdb-9286-636a264505b2-tls-cert\") pod \"authorino-6584f5d557-mtwjx\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.354367 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.354356 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvnkz\" (UniqueName: \"kubernetes.io/projected/9a3abe62-0afe-4cdb-9286-636a264505b2-kube-api-access-kvnkz\") pod \"authorino-6584f5d557-mtwjx\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.455043 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.455015 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3abe62-0afe-4cdb-9286-636a264505b2-tls-cert\") pod \"authorino-6584f5d557-mtwjx\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.455157 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.455058 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvnkz\" (UniqueName: \"kubernetes.io/projected/9a3abe62-0afe-4cdb-9286-636a264505b2-kube-api-access-kvnkz\") pod \"authorino-6584f5d557-mtwjx\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.457316 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.457290 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3abe62-0afe-4cdb-9286-636a264505b2-tls-cert\") pod \"authorino-6584f5d557-mtwjx\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.463260 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.463241 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvnkz\" (UniqueName: \"kubernetes.io/projected/9a3abe62-0afe-4cdb-9286-636a264505b2-kube-api-access-kvnkz\") pod \"authorino-6584f5d557-mtwjx\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.602838 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.602814 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:57:37.729679 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.729654 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6584f5d557-mtwjx"] Jun 10 16:57:37.731126 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:57:37.731102 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a3abe62_0afe_4cdb_9286_636a264505b2.slice/crio-92d2cd1f66735da12c5b36954382d52f5d11bd7baafc775745cf2a6d052013b0 WatchSource:0}: Error finding container 92d2cd1f66735da12c5b36954382d52f5d11bd7baafc775745cf2a6d052013b0: Status 404 returned error can't find the container with id 92d2cd1f66735da12c5b36954382d52f5d11bd7baafc775745cf2a6d052013b0 Jun 10 16:57:37.732394 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.732376 2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 16:57:37.772940 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.772897 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6584f5d557-mtwjx" event={"ID":"9a3abe62-0afe-4cdb-9286-636a264505b2","Type":"ContainerStarted","Data":"92d2cd1f66735da12c5b36954382d52f5d11bd7baafc775745cf2a6d052013b0"} Jun 10 16:57:37.773044 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.772942 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pz2dx" Jun 10 16:57:37.779543 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.779525 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pz2dx" Jun 10 16:57:37.859460 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.859402 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcccd\" (UniqueName: \"kubernetes.io/projected/afd78bb0-250f-449e-9b70-d0dc60ae60cc-kube-api-access-lcccd\") pod \"afd78bb0-250f-449e-9b70-d0dc60ae60cc\" (UID: \"afd78bb0-250f-449e-9b70-d0dc60ae60cc\") " Jun 10 16:57:37.861308 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.861285 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afd78bb0-250f-449e-9b70-d0dc60ae60cc-kube-api-access-lcccd" (OuterVolumeSpecName: "kube-api-access-lcccd") pod "afd78bb0-250f-449e-9b70-d0dc60ae60cc" (UID: "afd78bb0-250f-449e-9b70-d0dc60ae60cc"). InnerVolumeSpecName "kube-api-access-lcccd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:57:37.960241 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:37.960203 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcccd\" (UniqueName: \"kubernetes.io/projected/afd78bb0-250f-449e-9b70-d0dc60ae60cc-kube-api-access-lcccd\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:57:38.779158 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:38.779123 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-pz2dx" Jun 10 16:57:38.779573 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:38.779115 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6584f5d557-mtwjx" event={"ID":"9a3abe62-0afe-4cdb-9286-636a264505b2","Type":"ContainerStarted","Data":"7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d"} Jun 10 16:57:38.795552 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:38.795509 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6584f5d557-mtwjx" podStartSLOduration=1.456333026 podStartE2EDuration="1.79549774s" totalImagesPullingTime="339.164714ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:57:38.794081144 +0000 UTC m=+772.785383801" watchObservedRunningTime="2026-06-10 16:57:38.79549774 +0000 UTC m=+772.786800395" Jun 10 16:57:38.830083 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:38.830056 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pz2dx"] Jun 10 16:57:38.832268 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:38.832243 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfrpn"] Jun 10 16:57:38.832462 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:38.832434 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nfrpn" podUID="b359e389-220c-4d76-8f6c-bdb571ff341f" containerName="authorino" containerID="cri-o://bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc" gracePeriod=30 Jun 10 16:57:38.837548 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:38.837516 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-pz2dx"] Jun 10 16:57:39.072523 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.072501 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfrpn" Jun 10 16:57:39.169995 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.169970 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktkpx\" (UniqueName: \"kubernetes.io/projected/b359e389-220c-4d76-8f6c-bdb571ff341f-kube-api-access-ktkpx\") pod \"b359e389-220c-4d76-8f6c-bdb571ff341f\" (UID: \"b359e389-220c-4d76-8f6c-bdb571ff341f\") " Jun 10 16:57:39.171877 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.171856 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b359e389-220c-4d76-8f6c-bdb571ff341f-kube-api-access-ktkpx" (OuterVolumeSpecName: "kube-api-access-ktkpx") pod "b359e389-220c-4d76-8f6c-bdb571ff341f" (UID: "b359e389-220c-4d76-8f6c-bdb571ff341f"). InnerVolumeSpecName "kube-api-access-ktkpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:57:39.271174 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.271144 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktkpx\" (UniqueName: \"kubernetes.io/projected/b359e389-220c-4d76-8f6c-bdb571ff341f-kube-api-access-ktkpx\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:57:39.785830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.785791 2553 generic.go:356] "Generic (PLEG): container finished" podID="b359e389-220c-4d76-8f6c-bdb571ff341f" containerID="bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc" exitCode=0 Jun 10 16:57:39.785830 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.785834 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nfrpn" Jun 10 16:57:39.786356 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.785877 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfrpn" event={"ID":"b359e389-220c-4d76-8f6c-bdb571ff341f","Type":"ContainerDied","Data":"bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc"} Jun 10 16:57:39.786356 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.785943 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nfrpn" event={"ID":"b359e389-220c-4d76-8f6c-bdb571ff341f","Type":"ContainerDied","Data":"572e5144439e44bb77e21742c121569b234fc5771bae417f4ef69b019ddc5b74"} Jun 10 16:57:39.786356 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.785962 2553 scope.go:117] "RemoveContainer" containerID="bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc" Jun 10 16:57:39.796921 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.795289 2553 scope.go:117] "RemoveContainer" containerID="bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc" Jun 10 16:57:39.797292 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:57:39.797273 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc\": container with ID starting with bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc not found: ID does not exist" containerID="bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc" Jun 10 16:57:39.797368 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.797317 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc"} err="failed to get container status \"bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc\": rpc error: code = NotFound desc = could not find container \"bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc\": container with ID starting with bc93b450c521487a2ac79525be8d23070b9f1e1a64dd99b1d2f3b193cac387cc not found: ID does not exist" Jun 10 16:57:39.807945 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.807897 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfrpn"] Jun 10 16:57:39.814049 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:39.814024 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nfrpn"] Jun 10 16:57:40.440318 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:40.440286 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afd78bb0-250f-449e-9b70-d0dc60ae60cc" path="/var/lib/kubelet/pods/afd78bb0-250f-449e-9b70-d0dc60ae60cc/volumes" Jun 10 16:57:40.440543 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:57:40.440530 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b359e389-220c-4d76-8f6c-bdb571ff341f" path="/var/lib/kubelet/pods/b359e389-220c-4d76-8f6c-bdb571ff341f/volumes" Jun 10 16:58:18.579864 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:18.579776 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:58:26.026125 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:26.026092 2553 generic.go:356] "Generic (PLEG): container finished" podID="7f4b0037-7a8c-4235-9707-fe6d1fb29dd4" containerID="6e202784f817b2a7ddef712d0b9c6b035308e789ce2089b3749cc12847720797" exitCode=0 Jun 10 16:58:26.026507 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:26.026164 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" event={"ID":"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4","Type":"ContainerDied","Data":"6e202784f817b2a7ddef712d0b9c6b035308e789ce2089b3749cc12847720797"} Jun 10 16:58:26.026550 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:26.026504 2553 scope.go:117] "RemoveContainer" containerID="6e202784f817b2a7ddef712d0b9c6b035308e789ce2089b3749cc12847720797" Jun 10 16:58:26.027425 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:26.027398 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:58:26.027495 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:26.027480 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:58:26.027542 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:26.027526 2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 16:58:27.036334 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:27.036291 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" event={"ID":"7f4b0037-7a8c-4235-9707-fe6d1fb29dd4","Type":"ContainerStarted","Data":"8dd59903bf410d0f8a7f44af69eca5b282975fb02b5f73325ed82e1ae01da32c"} Jun 10 16:58:27.249089 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:27.249048 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:58:27.250491 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:27.250441 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4x46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 10 16:58:27.250724 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:27.250697 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" podUID="7f4b0037-7a8c-4235-9707-fe6d1fb29dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 10 16:58:28.229404 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:28.229375 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:58:28.249488 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:28.249456 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4x46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 10 16:58:28.249705 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:28.249679 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" podUID="7f4b0037-7a8c-4235-9707-fe6d1fb29dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 10 16:58:29.249804 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:29.249764 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4x46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 10 16:58:29.250394 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:29.250361 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" podUID="7f4b0037-7a8c-4235-9707-fe6d1fb29dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 10 16:58:30.249073 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:30.249032 2553 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-4x46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jun 10 16:58:30.249282 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:30.249101 2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" podUID="7f4b0037-7a8c-4235-9707-fe6d1fb29dd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jun 10 16:58:31.252879 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:31.252854 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:58:31.253861 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:58:31.253842 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-4x46t" Jun 10 16:59:06.614919 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.614882 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bb4d68865-hghn9"] Jun 10 16:59:06.615375 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.615291 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b359e389-220c-4d76-8f6c-bdb571ff341f" containerName="authorino" Jun 10 16:59:06.615375 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.615303 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b359e389-220c-4d76-8f6c-bdb571ff341f" containerName="authorino" Jun 10 16:59:06.615375 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.615369 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b359e389-220c-4d76-8f6c-bdb571ff341f" containerName="authorino" Jun 10 16:59:06.618251 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.618235 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.620807 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.620785 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 16:59:06.623810 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.623788 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bb4d68865-hghn9"] Jun 10 16:59:06.709401 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.709366 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efa531dc-7a7b-459e-abca-cd0192720b3c-tls-cert\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.709559 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.709479 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qskc2\" (UniqueName: \"kubernetes.io/projected/efa531dc-7a7b-459e-abca-cd0192720b3c-kube-api-access-qskc2\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.709559 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.709513 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efa531dc-7a7b-459e-abca-cd0192720b3c-oidc-ca\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.810446 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.810418 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efa531dc-7a7b-459e-abca-cd0192720b3c-oidc-ca\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.810581 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.810454 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efa531dc-7a7b-459e-abca-cd0192720b3c-tls-cert\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.810581 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.810514 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qskc2\" (UniqueName: \"kubernetes.io/projected/efa531dc-7a7b-459e-abca-cd0192720b3c-kube-api-access-qskc2\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.811160 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.811142 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/efa531dc-7a7b-459e-abca-cd0192720b3c-oidc-ca\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.812823 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.812806 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/efa531dc-7a7b-459e-abca-cd0192720b3c-tls-cert\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.818609 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.818589 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qskc2\" (UniqueName: \"kubernetes.io/projected/efa531dc-7a7b-459e-abca-cd0192720b3c-kube-api-access-qskc2\") pod \"authorino-5bb4d68865-hghn9\" (UID: \"efa531dc-7a7b-459e-abca-cd0192720b3c\") " pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:06.928947 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:06.928878 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb4d68865-hghn9" Jun 10 16:59:07.056936 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:07.056895 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bb4d68865-hghn9"] Jun 10 16:59:07.058544 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:59:07.058506 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefa531dc_7a7b_459e_abca_cd0192720b3c.slice/crio-11961d962751bb34b957d94b101108a2a48c79d1859a6410de5218fc7e850c4b WatchSource:0}: Error finding container 11961d962751bb34b957d94b101108a2a48c79d1859a6410de5218fc7e850c4b: Status 404 returned error can't find the container with id 11961d962751bb34b957d94b101108a2a48c79d1859a6410de5218fc7e850c4b Jun 10 16:59:07.258811 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:07.258781 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb4d68865-hghn9" event={"ID":"efa531dc-7a7b-459e-abca-cd0192720b3c","Type":"ContainerStarted","Data":"11961d962751bb34b957d94b101108a2a48c79d1859a6410de5218fc7e850c4b"} Jun 10 16:59:08.265974 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.265938 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb4d68865-hghn9" event={"ID":"efa531dc-7a7b-459e-abca-cd0192720b3c","Type":"ContainerStarted","Data":"f607324c67b8721bbe73eca44dfc4fcf3c8d4d8d6442608a8e01e8391caef035"} Jun 10 16:59:08.283397 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.283352 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5bb4d68865-hghn9" podStartSLOduration=1.836991394 podStartE2EDuration="2.283338939s" totalImagesPullingTime="446.347545ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:59:08.281280607 +0000 UTC m=+862.272583273" watchObservedRunningTime="2026-06-10 16:59:08.283338939 +0000 UTC m=+862.274641595" Jun 10 16:59:08.314173 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.314144 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6584f5d557-mtwjx"] Jun 10 16:59:08.314389 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.314343 2553 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6584f5d557-mtwjx" podUID="9a3abe62-0afe-4cdb-9286-636a264505b2" containerName="authorino" containerID="cri-o://7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d" gracePeriod=30 Jun 10 16:59:08.567357 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.567328 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:59:08.630281 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.630251 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvnkz\" (UniqueName: \"kubernetes.io/projected/9a3abe62-0afe-4cdb-9286-636a264505b2-kube-api-access-kvnkz\") pod \"9a3abe62-0afe-4cdb-9286-636a264505b2\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " Jun 10 16:59:08.630433 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.630303 2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3abe62-0afe-4cdb-9286-636a264505b2-tls-cert\") pod \"9a3abe62-0afe-4cdb-9286-636a264505b2\" (UID: \"9a3abe62-0afe-4cdb-9286-636a264505b2\") " Jun 10 16:59:08.632259 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.632230 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a3abe62-0afe-4cdb-9286-636a264505b2-kube-api-access-kvnkz" (OuterVolumeSpecName: "kube-api-access-kvnkz") pod "9a3abe62-0afe-4cdb-9286-636a264505b2" (UID: "9a3abe62-0afe-4cdb-9286-636a264505b2"). InnerVolumeSpecName "kube-api-access-kvnkz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 16:59:08.641952 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.641930 2553 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a3abe62-0afe-4cdb-9286-636a264505b2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9a3abe62-0afe-4cdb-9286-636a264505b2" (UID: "9a3abe62-0afe-4cdb-9286-636a264505b2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 16:59:08.731392 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.731361 2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvnkz\" (UniqueName: \"kubernetes.io/projected/9a3abe62-0afe-4cdb-9286-636a264505b2-kube-api-access-kvnkz\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:59:08.731392 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:08.731388 2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a3abe62-0afe-4cdb-9286-636a264505b2-tls-cert\") on node \"ip-10-0-128-59.ec2.internal\" DevicePath \"\"" Jun 10 16:59:09.272198 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.272167 2553 generic.go:356] "Generic (PLEG): container finished" podID="9a3abe62-0afe-4cdb-9286-636a264505b2" containerID="7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d" exitCode=0 Jun 10 16:59:09.272634 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.272211 2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6584f5d557-mtwjx" Jun 10 16:59:09.272634 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.272254 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6584f5d557-mtwjx" event={"ID":"9a3abe62-0afe-4cdb-9286-636a264505b2","Type":"ContainerDied","Data":"7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d"} Jun 10 16:59:09.272634 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.272301 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6584f5d557-mtwjx" event={"ID":"9a3abe62-0afe-4cdb-9286-636a264505b2","Type":"ContainerDied","Data":"92d2cd1f66735da12c5b36954382d52f5d11bd7baafc775745cf2a6d052013b0"} Jun 10 16:59:09.272634 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.272330 2553 scope.go:117] "RemoveContainer" containerID="7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d" Jun 10 16:59:09.281382 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.281361 2553 scope.go:117] "RemoveContainer" containerID="7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d" Jun 10 16:59:09.281631 ip-10-0-128-59 kubenswrapper[2553]: E0610 16:59:09.281612 2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d\": container with ID starting with 7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d not found: ID does not exist" containerID="7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d" Jun 10 16:59:09.281698 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.281636 2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d"} err="failed to get container status \"7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d\": rpc error: code = NotFound desc = could not find container \"7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d\": container with ID starting with 7ecefffbc9afbf6ea098795bc8273aea5850ee57f733cec66d3a9bb682c5804d not found: ID does not exist" Jun 10 16:59:09.292737 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.292718 2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6584f5d557-mtwjx"] Jun 10 16:59:09.296252 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:09.296227 2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6584f5d557-mtwjx"] Jun 10 16:59:10.446311 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:10.446276 2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a3abe62-0afe-4cdb-9286-636a264505b2" path="/var/lib/kubelet/pods/9a3abe62-0afe-4cdb-9286-636a264505b2/volumes" Jun 10 16:59:19.979458 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:19.979425 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:59:24.870210 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.870132 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8"] Jun 10 16:59:24.870729 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.870707 2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a3abe62-0afe-4cdb-9286-636a264505b2" containerName="authorino" Jun 10 16:59:24.870820 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.870732 2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a3abe62-0afe-4cdb-9286-636a264505b2" containerName="authorino" Jun 10 16:59:24.870877 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.870864 2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a3abe62-0afe-4cdb-9286-636a264505b2" containerName="authorino" Jun 10 16:59:24.876060 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.876043 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:24.879508 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.879482 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gnjgd\"" Jun 10 16:59:24.879625 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.879482 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 16:59:24.879625 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.879574 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 16:59:24.879625 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.879575 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 16:59:24.882570 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.882549 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8"] Jun 10 16:59:24.966595 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.966571 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:24.966689 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.966626 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:24.966743 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.966685 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee1ebb23-a2d1-4626-9483-77f97904179d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:24.966743 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.966712 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng5tm\" (UniqueName: \"kubernetes.io/projected/ee1ebb23-a2d1-4626-9483-77f97904179d-kube-api-access-ng5tm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:24.966818 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.966772 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:24.966818 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:24.966813 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067241 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067206 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067241 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067254 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067279 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067326 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067349 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee1ebb23-a2d1-4626-9483-77f97904179d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067456 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067364 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng5tm\" (UniqueName: \"kubernetes.io/projected/ee1ebb23-a2d1-4626-9483-77f97904179d-kube-api-access-ng5tm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067661 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067640 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067718 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067699 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.067755 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.067742 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.069539 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.069520 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee1ebb23-a2d1-4626-9483-77f97904179d-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.069695 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.069679 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee1ebb23-a2d1-4626-9483-77f97904179d-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.075320 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.075299 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng5tm\" (UniqueName: \"kubernetes.io/projected/ee1ebb23-a2d1-4626-9483-77f97904179d-kube-api-access-ng5tm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-srrb8\" (UID: \"ee1ebb23-a2d1-4626-9483-77f97904179d\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.207197 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.207114 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:25.340043 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.340020 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8"] Jun 10 16:59:25.342112 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:59:25.342080 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1ebb23_a2d1_4626_9483_77f97904179d.slice/crio-cdab80ad6d20878c31246064bf3dcc493776803513c6564cf58fcc4f1cfdfc9f WatchSource:0}: Error finding container cdab80ad6d20878c31246064bf3dcc493776803513c6564cf58fcc4f1cfdfc9f: Status 404 returned error can't find the container with id cdab80ad6d20878c31246064bf3dcc493776803513c6564cf58fcc4f1cfdfc9f Jun 10 16:59:25.360740 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.360708 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" event={"ID":"ee1ebb23-a2d1-4626-9483-77f97904179d","Type":"ContainerStarted","Data":"cdab80ad6d20878c31246064bf3dcc493776803513c6564cf58fcc4f1cfdfc9f"} Jun 10 16:59:25.363657 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:25.363636 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:59:29.387627 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:29.387589 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" event={"ID":"ee1ebb23-a2d1-4626-9483-77f97904179d","Type":"ContainerStarted","Data":"e373554af209cae54a43090802763fc64bda16de47c7ad7bc6a512608d84f0ce"} Jun 10 16:59:30.394640 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.394547 2553 generic.go:356] "Generic (PLEG): container finished" podID="ee1ebb23-a2d1-4626-9483-77f97904179d" containerID="e373554af209cae54a43090802763fc64bda16de47c7ad7bc6a512608d84f0ce" exitCode=0 Jun 10 16:59:30.394640 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.394592 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" event={"ID":"ee1ebb23-a2d1-4626-9483-77f97904179d","Type":"ContainerDied","Data":"e373554af209cae54a43090802763fc64bda16de47c7ad7bc6a512608d84f0ce"} Jun 10 16:59:30.680087 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.680008 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8"] Jun 10 16:59:30.684283 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.684259 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.686729 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.686703 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 16:59:30.693917 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.693881 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8"] Jun 10 16:59:30.823400 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.823368 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.823633 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.823433 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.823633 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.823461 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw2jm\" (UniqueName: \"kubernetes.io/projected/77a6025d-ab6b-42bf-9b27-489597ddeff1-kube-api-access-vw2jm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.823633 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.823499 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77a6025d-ab6b-42bf-9b27-489597ddeff1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.823633 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.823587 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.823633 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.823618 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.924695 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.924650 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.924860 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.924709 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.924860 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.924791 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.924860 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.924840 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.925079 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.924874 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw2jm\" (UniqueName: \"kubernetes.io/projected/77a6025d-ab6b-42bf-9b27-489597ddeff1-kube-api-access-vw2jm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.925079 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.924934 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77a6025d-ab6b-42bf-9b27-489597ddeff1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.925155 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.925106 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.925580 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.925552 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.925700 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.925643 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.927718 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.927694 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77a6025d-ab6b-42bf-9b27-489597ddeff1-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.928056 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.928009 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77a6025d-ab6b-42bf-9b27-489597ddeff1-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.939692 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.939463 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw2jm\" (UniqueName: \"kubernetes.io/projected/77a6025d-ab6b-42bf-9b27-489597ddeff1-kube-api-access-vw2jm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8\" (UID: \"77a6025d-ab6b-42bf-9b27-489597ddeff1\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:30.999729 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:30.999693 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:31.160205 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:31.160175 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 16:59:31.210161 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:31.210130 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8"] Jun 10 16:59:31.457553 ip-10-0-128-59 kubenswrapper[2553]: W0610 16:59:31.457466 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a6025d_ab6b_42bf_9b27_489597ddeff1.slice/crio-5330c359d7f9463ca8c7be5f90a0932eaf09b2c199354aca1df140df9ca63897 WatchSource:0}: Error finding container 5330c359d7f9463ca8c7be5f90a0932eaf09b2c199354aca1df140df9ca63897: Status 404 returned error can't find the container with id 5330c359d7f9463ca8c7be5f90a0932eaf09b2c199354aca1df140df9ca63897 Jun 10 16:59:32.408447 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:32.408405 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" event={"ID":"77a6025d-ab6b-42bf-9b27-489597ddeff1","Type":"ContainerStarted","Data":"abbebdf1dc96f4a0b49c31b90d1bea08c01b3cbf63b625dd37114935a563ce2e"} Jun 10 16:59:32.408621 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:32.408485 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" event={"ID":"77a6025d-ab6b-42bf-9b27-489597ddeff1","Type":"ContainerStarted","Data":"5330c359d7f9463ca8c7be5f90a0932eaf09b2c199354aca1df140df9ca63897"} Jun 10 16:59:32.410397 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:32.410374 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" event={"ID":"ee1ebb23-a2d1-4626-9483-77f97904179d","Type":"ContainerStarted","Data":"d8219aea0010fc574a051936196b3fb9b0f799b5d638a01e71739a91fe2aa236"} Jun 10 16:59:32.444671 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:32.444623 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" podStartSLOduration=2.654172587 podStartE2EDuration="8.444610371s" totalImagesPullingTime="4.492856889s" totalInitContainerRuntime="1.297580895s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:59:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:59:32.442973603 +0000 UTC m=+886.434276265" watchObservedRunningTime="2026-06-10 16:59:32.444610371 +0000 UTC m=+886.435913048" Jun 10 16:59:33.416640 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:33.416609 2553 generic.go:356] "Generic (PLEG): container finished" podID="77a6025d-ab6b-42bf-9b27-489597ddeff1" containerID="abbebdf1dc96f4a0b49c31b90d1bea08c01b3cbf63b625dd37114935a563ce2e" exitCode=0 Jun 10 16:59:33.417095 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:33.416690 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" event={"ID":"77a6025d-ab6b-42bf-9b27-489597ddeff1","Type":"ContainerDied","Data":"abbebdf1dc96f4a0b49c31b90d1bea08c01b3cbf63b625dd37114935a563ce2e"} Jun 10 16:59:34.423458 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:34.423428 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" event={"ID":"77a6025d-ab6b-42bf-9b27-489597ddeff1","Type":"ContainerStarted","Data":"eca5607fcd2ec711eaaa0db9c2cda84346fb59c2e0411ac2e527fb7822d2f417"} Jun 10 16:59:34.443671 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:34.443620 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" podStartSLOduration=2.938013523 podStartE2EDuration="4.443605252s" totalImagesPullingTime="204.984791ms" totalInitContainerRuntime="1.300606938s" isStatefulPod=false podCreationTimestamp="2026-06-10 16:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 16:59:34.441214269 +0000 UTC m=+888.432516936" watchObservedRunningTime="2026-06-10 16:59:34.443605252 +0000 UTC m=+888.434907907" Jun 10 16:59:35.207752 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:35.207722 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:35.207967 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:35.207806 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:35.219545 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:35.219526 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:35.444667 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:35.444630 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-srrb8" Jun 10 16:59:41.000780 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:41.000735 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:41.000780 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:41.000795 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:41.013012 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:41.012989 2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:41.476519 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:41.476490 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8" Jun 10 16:59:46.476325 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:46.476298 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 16:59:46.476706 ip-10-0-128-59 kubenswrapper[2553]: I0610 16:59:46.476408 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 17:00:00.359420 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:00.359380 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 17:00:25.464973 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.464937 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5"] Jun 10 17:00:25.468886 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.468866 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.472936 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.472894 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 17:00:25.481712 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.481690 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5"] Jun 10 17:00:25.590051 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.590015 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.590215 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.590058 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w99jt\" (UniqueName: \"kubernetes.io/projected/5639d956-aa25-40ba-9202-761871c7250c-kube-api-access-w99jt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.590215 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.590092 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.590215 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.590162 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5639d956-aa25-40ba-9202-761871c7250c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.590348 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.590242 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.590348 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.590281 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.690828 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.690783 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.690828 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.690833 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w99jt\" (UniqueName: \"kubernetes.io/projected/5639d956-aa25-40ba-9202-761871c7250c-kube-api-access-w99jt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.691115 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.690855 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.691115 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.690893 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5639d956-aa25-40ba-9202-761871c7250c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.691115 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.690937 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.691115 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.690976 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.691402 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.691377 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.691485 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.691419 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.691485 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.691458 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.693195 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.693173 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5639d956-aa25-40ba-9202-761871c7250c-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.693360 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.693342 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5639d956-aa25-40ba-9202-761871c7250c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.699444 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.699424 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w99jt\" (UniqueName: \"kubernetes.io/projected/5639d956-aa25-40ba-9202-761871c7250c-kube-api-access-w99jt\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5\" (UID: \"5639d956-aa25-40ba-9202-761871c7250c\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.778482 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.778445 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" Jun 10 17:00:25.909821 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:25.909765 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5"] Jun 10 17:00:25.911120 ip-10-0-128-59 kubenswrapper[2553]: W0610 17:00:25.911089 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5639d956_aa25_40ba_9202_761871c7250c.slice/crio-3f791ca19770b2a4ad74ca545853a7bdbd3b6671f727dfafcd1fcff52fe89213 WatchSource:0}: Error finding container 3f791ca19770b2a4ad74ca545853a7bdbd3b6671f727dfafcd1fcff52fe89213: Status 404 returned error can't find the container with id 3f791ca19770b2a4ad74ca545853a7bdbd3b6671f727dfafcd1fcff52fe89213 Jun 10 17:00:26.061532 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:26.061439 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 17:00:26.710209 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:26.710176 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" event={"ID":"5639d956-aa25-40ba-9202-761871c7250c","Type":"ContainerStarted","Data":"d7e01f2a6033baf1700a0cf4116761e8a452f86db6ad12689e299f81dffd076c"} Jun 10 17:00:26.710558 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:26.710228 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5" event={"ID":"5639d956-aa25-40ba-9202-761871c7250c","Type":"ContainerStarted","Data":"3f791ca19770b2a4ad74ca545853a7bdbd3b6671f727dfafcd1fcff52fe89213"} Jun 10 17:00:30.451041 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:00:30.451012 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-bng4s"] Jun 10 17:04:11.932632 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:11.932554 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5_5639d956-aa25-40ba-9202-761871c7250c/storage-initializer/0.log" Jun 10 17:04:12.834935 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:12.834896 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bb4d68865-hghn9_efa531dc-7a7b-459e-abca-cd0192720b3c/authorino/0.log" Jun 10 17:04:17.187868 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:17.187839 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6785b76bc9-8xnz6_d3c88fe8-9b52-4fd2-a2e0-63400339c255/nginx/0.log" Jun 10 17:04:18.200307 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:18.200280 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-f6v5t_0b5b877c-ef70-413a-8803-955d957b185d/copy-manifests/0.log" Jun 10 17:04:18.211915 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:18.211880 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-f6v5t_0b5b877c-ef70-413a-8803-955d957b185d/manager/0.log" Jun 10 17:04:19.289290 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.289262 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj_a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b/util/0.log" Jun 10 17:04:19.295227 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.295207 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj_a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b/pull/0.log" Jun 10 17:04:19.300640 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.300625 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj_a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b/extract/0.log" Jun 10 17:04:19.414014 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.413987 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv_0bcda0e6-8914-40f0-a6a2-00892aa3bdfd/pull/0.log" Jun 10 17:04:19.419060 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.419044 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv_0bcda0e6-8914-40f0-a6a2-00892aa3bdfd/extract/0.log" Jun 10 17:04:19.426676 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.426655 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv_0bcda0e6-8914-40f0-a6a2-00892aa3bdfd/util/0.log" Jun 10 17:04:19.532931 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.532891 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh_5892c414-1017-4232-9c67-20f32325f713/extract/0.log" Jun 10 17:04:19.540935 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.540874 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh_5892c414-1017-4232-9c67-20f32325f713/util/0.log" Jun 10 17:04:19.546721 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.546699 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh_5892c414-1017-4232-9c67-20f32325f713/pull/0.log" Jun 10 17:04:19.652853 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.652824 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw_7cecf4c2-e55b-44f6-ac8b-a873a6600b6b/util/0.log" Jun 10 17:04:19.658879 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.658863 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw_7cecf4c2-e55b-44f6-ac8b-a873a6600b6b/pull/0.log" Jun 10 17:04:19.666934 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.666900 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw_7cecf4c2-e55b-44f6-ac8b-a873a6600b6b/extract/0.log" Jun 10 17:04:19.770961 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.770940 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bb4d68865-hghn9_efa531dc-7a7b-459e-abca-cd0192720b3c/authorino/0.log" Jun 10 17:04:19.888384 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:19.888316 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xgwj2_5ad6da15-65a0-4079-903b-e12af85be7b5/manager/0.log" Jun 10 17:04:20.218553 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:20.218520 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n7hv5_204c82b7-4cc9-4846-94f2-fab2b91a0768/registry-server/0.log" Jun 10 17:04:20.452497 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:20.452467 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bng4s_2a38e567-5370-4c69-8bbd-164a7a15ff73/limitador/0.log" Jun 10 17:04:20.898478 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:20.898451 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lzg5x_841965a2-7f79-42c6-813b-41df34cd5415/istio-proxy/0.log" Jun 10 17:04:21.349327 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:21.349295 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4x46t_7f4b0037-7a8c-4235-9707-fe6d1fb29dd4/istio-proxy/1.log" Jun 10 17:04:21.689340 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:21.689257 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f755785-n58lj_8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9/router/0.log" Jun 10 17:04:22.140713 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:22.140682 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-srrb8_ee1ebb23-a2d1-4626-9483-77f97904179d/main/0.log" Jun 10 17:04:22.146297 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:22.146280 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-srrb8_ee1ebb23-a2d1-4626-9483-77f97904179d/storage-initializer/0.log" Jun 10 17:04:22.257426 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:22.257401 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8_77a6025d-ab6b-42bf-9b27-489597ddeff1/storage-initializer/0.log" Jun 10 17:04:22.263801 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:22.263782 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-874p8_77a6025d-ab6b-42bf-9b27-489597ddeff1/main/0.log" Jun 10 17:04:22.491897 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:22.491869 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-9p2w5_5639d956-aa25-40ba-9202-761871c7250c/storage-initializer/0.log" Jun 10 17:04:29.119206 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:29.119177 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9c5cl_a1cfb4be-8bf2-43ac-85b8-4d881a636eb4/global-pull-secret-syncer/0.log" Jun 10 17:04:29.278204 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:29.278175 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tsflw_0f70d9be-a2e5-4082-aae2-76d968910a9e/konnectivity-agent/0.log" Jun 10 17:04:29.297244 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:29.297225 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-59.ec2.internal_886f69e135aed4c8da242a0cae9e59d4/haproxy/0.log" Jun 10 17:04:34.097706 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.097679 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj_a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b/extract/0.log" Jun 10 17:04:34.119577 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.119554 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj_a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b/util/0.log" Jun 10 17:04:34.139409 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.139388 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ns5qj_a3e2d224-ff06-4dd4-bf0c-46b1fe240e9b/pull/0.log" Jun 10 17:04:34.165187 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.165161 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv_0bcda0e6-8914-40f0-a6a2-00892aa3bdfd/extract/0.log" Jun 10 17:04:34.184850 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.184823 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv_0bcda0e6-8914-40f0-a6a2-00892aa3bdfd/util/0.log" Jun 10 17:04:34.203503 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.203478 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05txgv_0bcda0e6-8914-40f0-a6a2-00892aa3bdfd/pull/0.log" Jun 10 17:04:34.231357 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.231325 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh_5892c414-1017-4232-9c67-20f32325f713/extract/0.log" Jun 10 17:04:34.251847 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.251819 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh_5892c414-1017-4232-9c67-20f32325f713/util/0.log" Jun 10 17:04:34.271947 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.271869 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed7364rvh_5892c414-1017-4232-9c67-20f32325f713/pull/0.log" Jun 10 17:04:34.306136 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.306116 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw_7cecf4c2-e55b-44f6-ac8b-a873a6600b6b/extract/0.log" Jun 10 17:04:34.326156 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.326132 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw_7cecf4c2-e55b-44f6-ac8b-a873a6600b6b/util/0.log" Jun 10 17:04:34.344065 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.344045 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vqxjw_7cecf4c2-e55b-44f6-ac8b-a873a6600b6b/pull/0.log" Jun 10 17:04:34.369660 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.369638 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5bb4d68865-hghn9_efa531dc-7a7b-459e-abca-cd0192720b3c/authorino/0.log" Jun 10 17:04:34.401506 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.401485 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xgwj2_5ad6da15-65a0-4079-903b-e12af85be7b5/manager/0.log" Jun 10 17:04:34.502731 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.502705 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-n7hv5_204c82b7-4cc9-4846-94f2-fab2b91a0768/registry-server/0.log" Jun 10 17:04:34.567043 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:34.566967 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-bng4s_2a38e567-5370-4c69-8bbd-164a7a15ff73/limitador/0.log" Jun 10 17:04:36.163554 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.163523 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_633eeef0-8e51-4038-a878-9cac839068d6/alertmanager/0.log" Jun 10 17:04:36.186472 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.186449 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_633eeef0-8e51-4038-a878-9cac839068d6/config-reloader/0.log" Jun 10 17:04:36.204741 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.204723 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_633eeef0-8e51-4038-a878-9cac839068d6/kube-rbac-proxy-web/0.log" Jun 10 17:04:36.223180 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.223164 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_633eeef0-8e51-4038-a878-9cac839068d6/kube-rbac-proxy/0.log" Jun 10 17:04:36.243077 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.243059 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_633eeef0-8e51-4038-a878-9cac839068d6/kube-rbac-proxy-metric/0.log" Jun 10 17:04:36.266225 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.266205 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_633eeef0-8e51-4038-a878-9cac839068d6/prom-label-proxy/0.log" Jun 10 17:04:36.287006 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.286988 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_633eeef0-8e51-4038-a878-9cac839068d6/init-config-reloader/0.log" Jun 10 17:04:36.328723 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.328702 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-qbfwv_f4a4afe3-1bc4-494e-8e86-1a044ccf1b86/cluster-monitoring-operator/0.log" Jun 10 17:04:36.476681 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.476656 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-qrcqx_ce1c753e-e8a4-4c82-8210-0c1c0c11f0dc/monitoring-plugin/0.log" Jun 10 17:04:36.619250 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.619220 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wrm9j_ca570bbc-7d70-4e8d-9616-f53fca08e9cf/node-exporter/0.log" Jun 10 17:04:36.640568 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.640548 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wrm9j_ca570bbc-7d70-4e8d-9616-f53fca08e9cf/kube-rbac-proxy/0.log" Jun 10 17:04:36.666816 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.666797 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wrm9j_ca570bbc-7d70-4e8d-9616-f53fca08e9cf/init-textfile/0.log" Jun 10 17:04:36.795630 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.795551 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ztn_39aae06e-c36d-40c2-8ede-f525ff228c56/kube-rbac-proxy-main/0.log" Jun 10 17:04:36.819615 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.819593 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ztn_39aae06e-c36d-40c2-8ede-f525ff228c56/kube-rbac-proxy-self/0.log" Jun 10 17:04:36.842308 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:36.842292 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-n6ztn_39aae06e-c36d-40c2-8ede-f525ff228c56/openshift-state-metrics/0.log" Jun 10 17:04:37.133000 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.132926 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-fm8zt_d2139d90-eb61-40a0-b29c-51c629ee2f19/prometheus-operator-admission-webhook/0.log" Jun 10 17:04:37.166267 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.166241 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695777d855-zmdzv_911e6446-713d-4e77-8cf9-b71a99b7de71/telemeter-client/0.log" Jun 10 17:04:37.189664 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.189633 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695777d855-zmdzv_911e6446-713d-4e77-8cf9-b71a99b7de71/reload/0.log" Jun 10 17:04:37.214950 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.214924 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-695777d855-zmdzv_911e6446-713d-4e77-8cf9-b71a99b7de71/kube-rbac-proxy/0.log" Jun 10 17:04:37.274078 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.274056 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/thanos-query/0.log" Jun 10 17:04:37.313656 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.313635 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy-web/0.log" Jun 10 17:04:37.366532 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.366508 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy/0.log" Jun 10 17:04:37.408258 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.408192 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/prom-label-proxy/0.log" Jun 10 17:04:37.440756 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.440733 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy-rules/0.log" Jun 10 17:04:37.466919 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:37.466889 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-776f445994-t2pnv_fa9a7dfe-6ffc-4951-a455-9a1803f4b465/kube-rbac-proxy-metrics/0.log" Jun 10 17:04:40.294207 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.294174 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56dfff4fd5-69ktl_fc70e17c-4bca-4e7a-8c0e-91b7a2379ec4/console/0.log" Jun 10 17:04:40.532078 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.531960 2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb"] Jun 10 17:04:40.535654 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.535635 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.537986 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.537965 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-854d7\"/\"kube-root-ca.crt\"" Jun 10 17:04:40.538858 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.538839 2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-854d7\"/\"default-dockercfg-cd8ht\"" Jun 10 17:04:40.538983 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.538844 2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-854d7\"/\"openshift-service-ca.crt\"" Jun 10 17:04:40.546164 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.546107 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb"] Jun 10 17:04:40.676502 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.676465 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-podres\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.676680 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.676521 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4q5p\" (UniqueName: \"kubernetes.io/projected/6c3a2d65-858c-4566-a74a-5b4f0317eedc-kube-api-access-w4q5p\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.676680 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.676566 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-lib-modules\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.676680 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.676598 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-proc\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.676810 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.676729 2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-sys\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.777868 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.777829 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-proc\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778058 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.777943 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-proc\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778058 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.777949 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-sys\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778058 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.777999 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-sys\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778058 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.778010 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-podres\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778058 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.778033 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4q5p\" (UniqueName: \"kubernetes.io/projected/6c3a2d65-858c-4566-a74a-5b4f0317eedc-kube-api-access-w4q5p\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778058 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.778057 2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-lib-modules\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778353 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.778162 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-lib-modules\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.778353 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.778161 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6c3a2d65-858c-4566-a74a-5b4f0317eedc-podres\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.785224 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.785195 2553 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4q5p\" (UniqueName: \"kubernetes.io/projected/6c3a2d65-858c-4566-a74a-5b4f0317eedc-kube-api-access-w4q5p\") pod \"perf-node-gather-daemonset-ld6sb\" (UID: \"6c3a2d65-858c-4566-a74a-5b4f0317eedc\") " pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.846159 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.846096 2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:40.975460 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:40.975432 2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb"] Jun 10 17:04:40.977328 ip-10-0-128-59 kubenswrapper[2553]: W0610 17:04:40.977307 2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6c3a2d65_858c_4566_a74a_5b4f0317eedc.slice/crio-cc39593adff0f500214cb6d4f6361532a81a42a4098dcce90608ebe6bdddf60a WatchSource:0}: Error finding container cc39593adff0f500214cb6d4f6361532a81a42a4098dcce90608ebe6bdddf60a: Status 404 returned error can't find the container with id cc39593adff0f500214cb6d4f6361532a81a42a4098dcce90608ebe6bdddf60a Jun 10 17:04:41.043390 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:41.043371 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-852k7_5cfd4bb3-ac0f-4358-afb4-a91df0d4b42d/volume-data-source-validator/0.log" Jun 10 17:04:41.074053 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:41.074029 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" event={"ID":"6c3a2d65-858c-4566-a74a-5b4f0317eedc","Type":"ContainerStarted","Data":"dcb6f212f54f4217a01bffb74396603ff635402cc7951797d4d9165fc634a5e7"} Jun 10 17:04:41.074177 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:41.074080 2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" event={"ID":"6c3a2d65-858c-4566-a74a-5b4f0317eedc","Type":"ContainerStarted","Data":"cc39593adff0f500214cb6d4f6361532a81a42a4098dcce90608ebe6bdddf60a"} Jun 10 17:04:41.074177 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:41.074121 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:41.088844 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:41.088804 2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" podStartSLOduration=1.08879017 podStartE2EDuration="1.08879017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 17:04:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 17:04:41.087753179 +0000 UTC m=+1195.079055837" watchObservedRunningTime="2026-06-10 17:04:41.08879017 +0000 UTC m=+1195.080092825" Jun 10 17:04:42.251789 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:42.251765 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqszt_26987bde-f9c2-429f-aad6-87f7c4f6dd64/dns/0.log" Jun 10 17:04:42.271770 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:42.271746 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rqszt_26987bde-f9c2-429f-aad6-87f7c4f6dd64/kube-rbac-proxy/0.log" Jun 10 17:04:42.423775 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:42.423748 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sfl8c_dc2ea954-31aa-47f4-bb61-480edd611228/dns-node-resolver/0.log" Jun 10 17:04:43.023821 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:43.023792 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xh6hq_32430c61-cd32-4363-a0e0-12385778222c/node-ca/0.log" Jun 10 17:04:43.981402 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:43.981377 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lzg5x_841965a2-7f79-42c6-813b-41df34cd5415/istio-proxy/0.log" Jun 10 17:04:44.145229 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:44.145192 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4x46t_7f4b0037-7a8c-4235-9707-fe6d1fb29dd4/istio-proxy/1.log" Jun 10 17:04:44.145539 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:44.145524 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4x46t_7f4b0037-7a8c-4235-9707-fe6d1fb29dd4/istio-proxy/0.log" Jun 10 17:04:44.214732 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:44.209526 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f755785-n58lj_8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9/router/0.log" Jun 10 17:04:44.817202 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:44.817176 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mfpx7_a22a3418-26ff-47a4-a414-df0c496772a4/serve-healthcheck-canary/0.log" Jun 10 17:04:45.547173 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:45.547147 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4rb9_bd5be301-c516-4a29-95bf-bbdcee3ee3ac/kube-rbac-proxy/0.log" Jun 10 17:04:45.565645 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:45.565620 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4rb9_bd5be301-c516-4a29-95bf-bbdcee3ee3ac/exporter/0.log" Jun 10 17:04:45.585445 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:45.585424 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q4rb9_bd5be301-c516-4a29-95bf-bbdcee3ee3ac/extractor/0.log" Jun 10 17:04:46.514083 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:46.514058 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 17:04:46.515802 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:46.515780 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x4jnt_7cda8b7c-0c33-458a-bbb8-c3ac1a402868/ovn-acl-logging/0.log" Jun 10 17:04:47.089682 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:47.089654 2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-854d7/perf-node-gather-daemonset-ld6sb" Jun 10 17:04:47.894447 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:47.894424 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6785b76bc9-8xnz6_d3c88fe8-9b52-4fd2-a2e0-63400339c255/nginx/0.log" Jun 10 17:04:48.212992 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:48.212920 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-f6v5t_0b5b877c-ef70-413a-8803-955d957b185d/manager/0.log" Jun 10 17:04:48.226961 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:48.226941 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696f888447-f6v5t_0b5b877c-ef70-413a-8803-955d957b185d/copy-manifests/0.log" Jun 10 17:04:50.125586 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:50.125560 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5b699dc98-fjgvv_48a29776-feca-4c7b-a911-9a0f3817de98/manager/0.log" Jun 10 17:04:50.168661 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:50.168636 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-mp67d_1b74eadb-5ebc-4fb0-9bef-7ec5250ebcc5/openshift-lws-operator/0.log" Jun 10 17:04:56.107400 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:56.107371 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lzg5x_841965a2-7f79-42c6-813b-41df34cd5415/istio-proxy/0.log" Jun 10 17:04:56.200395 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:56.200358 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4x46t_7f4b0037-7a8c-4235-9707-fe6d1fb29dd4/istio-proxy/1.log" Jun 10 17:04:56.200704 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:56.200691 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4x46t_7f4b0037-7a8c-4235-9707-fe6d1fb29dd4/istio-proxy/0.log" Jun 10 17:04:56.239364 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:56.239328 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f755785-n58lj_8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9/router/0.log" Jun 10 17:04:57.039621 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.039593 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4mh5x_fdd139f8-e13b-4112-b7e3-2ee1d65dc66c/kube-multus/0.log" Jun 10 17:04:57.204860 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.204832 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmznj_6309fe63-fdc2-48be-91f9-cffabda031de/kube-multus-additional-cni-plugins/0.log" Jun 10 17:04:57.224106 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.224080 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmznj_6309fe63-fdc2-48be-91f9-cffabda031de/egress-router-binary-copy/0.log" Jun 10 17:04:57.242555 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.242536 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmznj_6309fe63-fdc2-48be-91f9-cffabda031de/cni-plugins/0.log" Jun 10 17:04:57.260238 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.260222 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmznj_6309fe63-fdc2-48be-91f9-cffabda031de/bond-cni-plugin/0.log" Jun 10 17:04:57.280718 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.280701 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmznj_6309fe63-fdc2-48be-91f9-cffabda031de/routeoverride-cni/0.log" Jun 10 17:04:57.299358 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.299309 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmznj_6309fe63-fdc2-48be-91f9-cffabda031de/whereabouts-cni-bincopy/0.log" Jun 10 17:04:57.317196 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.317177 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jmznj_6309fe63-fdc2-48be-91f9-cffabda031de/whereabouts-cni/0.log" Jun 10 17:04:57.373527 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.373508 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795lzg5x_841965a2-7f79-42c6-813b-41df34cd5415/istio-proxy/0.log" Jun 10 17:04:57.471918 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.471872 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4x46t_7f4b0037-7a8c-4235-9707-fe6d1fb29dd4/istio-proxy/1.log" Jun 10 17:04:57.472179 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.472164 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-4x46t_7f4b0037-7a8c-4235-9707-fe6d1fb29dd4/istio-proxy/0.log" Jun 10 17:04:57.514735 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.514704 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64f755785-n58lj_8f5a1fec-1fb6-4dde-8c1e-84cbfb805ff9/router/0.log" Jun 10 17:04:57.543838 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.543821 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7q2mx_a7fbb3c9-f5fb-4528-bd65-f8675caced84/network-metrics-daemon/0.log" Jun 10 17:04:57.560978 ip-10-0-128-59 kubenswrapper[2553]: I0610 17:04:57.560929 2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7q2mx_a7fbb3c9-f5fb-4528-bd65-f8675caced84/kube-rbac-proxy/0.log"