Jun 02 01:53:11.470393 ip-10-0-134-54 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 01:53:11.470405 ip-10-0-134-54 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 01:53:11.470412 ip-10-0-134-54 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 01:53:11.470669 ip-10-0-134-54 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 01:53:20.712510 ip-10-0-134-54 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 02 01:53:20.712526 ip-10-0-134-54 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2bfa66408b3045569fcd4bcbef67a2c2 -- Jun 02 01:55:37.077078 ip-10-0-134-54 systemd[1]: Starting Kubernetes Kubelet... Jun 02 01:55:37.446608 ip-10-0-134-54 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:55:37.446608 ip-10-0-134-54 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 01:55:37.446608 ip-10-0-134-54 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:55:37.446608 ip-10-0-134-54 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 01:55:37.446608 ip-10-0-134-54 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 01:55:37.448049 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.447959 2560 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 01:55:37.454575 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454545 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:55:37.454575 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454568 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:55:37.454575 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454572 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:55:37.454575 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454575 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:55:37.454575 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454578 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:55:37.454575 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454582 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:55:37.454575 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454586 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454589 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454592 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454595 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454597 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454600 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454603 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454605 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454608 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454611 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454613 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454617 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454621 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454624 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454627 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454630 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454632 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454635 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454638 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454644 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:55:37.454936 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454647 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454649 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454652 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454654 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454657 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454659 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454662 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454664 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454666 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454670 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454673 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454676 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454679 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454682 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454685 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454688 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454691 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454693 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454696 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454699 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:55:37.455425 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454702 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454704 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454707 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454709 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454712 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454715 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454718 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454720 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454723 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454726 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454729 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454731 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454733 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454736 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454739 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454741 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454744 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454746 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454749 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454752 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:55:37.455924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454754 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454770 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454772 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454775 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454778 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454781 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454785 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454790 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454794 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454797 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454800 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454803 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454808 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454812 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454815 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454818 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454821 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454823 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454826 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:55:37.456405 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.454829 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455230 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455234 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455237 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455240 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455243 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455245 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455248 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455252 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455255 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455258 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455261 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455264 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455266 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455269 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455272 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455274 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455277 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455280 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455283 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:55:37.456882 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455286 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455288 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455291 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455293 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455296 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455299 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455302 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455305 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455308 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455310 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455312 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455315 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455317 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455320 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455324 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455334 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455338 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455340 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455343 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455346 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:55:37.457374 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455348 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455351 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455353 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455357 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455360 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455363 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455365 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455368 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455370 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455374 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455376 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455379 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455381 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455384 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455387 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455389 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455392 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455395 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455398 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:55:37.457877 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455401 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455405 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455409 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455412 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455415 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455418 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455421 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455423 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455426 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455428 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455431 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455434 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455438 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455440 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455443 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455446 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455448 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455451 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455453 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455456 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:55:37.458346 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455459 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455461 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455464 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455467 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455469 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455473 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455477 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.455480 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456529 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456539 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456547 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456552 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456557 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456560 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456565 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456570 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456573 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456576 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456580 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456583 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456587 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456590 2560 flags.go:64] FLAG: --cgroup-root="" Jun 02 01:55:37.458840 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456593 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456596 2560 flags.go:64] FLAG: --client-ca-file="" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456599 2560 flags.go:64] FLAG: --cloud-config="" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456602 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456604 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456608 2560 flags.go:64] FLAG: --cluster-domain="" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456611 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456614 2560 flags.go:64] FLAG: --config-dir="" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456617 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456621 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456625 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456628 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456631 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456635 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456638 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456641 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456644 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456647 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456650 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456654 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456657 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456660 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456663 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456667 2560 flags.go:64] FLAG: --enable-server="true" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456670 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 01:55:37.459377 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456675 2560 flags.go:64] FLAG: --event-burst="100" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456678 2560 flags.go:64] FLAG: --event-qps="50" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456681 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456684 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456687 2560 flags.go:64] FLAG: --eviction-hard="" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456691 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456694 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456697 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456700 2560 flags.go:64] FLAG: --eviction-soft="" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456703 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456706 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456709 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456712 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456715 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456718 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456721 2560 flags.go:64] FLAG: --feature-gates="" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456725 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456728 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456732 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456735 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456738 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456741 2560 flags.go:64] FLAG: --help="false" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456744 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456747 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 01:55:37.460016 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456750 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456753 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456756 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456771 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456774 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456777 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456780 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456784 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456787 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456791 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456794 2560 flags.go:64] FLAG: --kube-reserved="" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456797 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456799 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456803 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456806 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456809 2560 flags.go:64] FLAG: --lock-file="" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456812 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456815 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456818 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456824 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456826 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456829 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456832 2560 flags.go:64] FLAG: --logging-format="text" Jun 02 01:55:37.460581 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456835 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456839 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456842 2560 flags.go:64] FLAG: --manifest-url="" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456844 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456848 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456851 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456856 2560 flags.go:64] FLAG: --max-pods="110" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456859 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456861 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456864 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456867 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456870 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456874 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456877 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456885 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456889 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456892 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456895 2560 flags.go:64] FLAG: --pod-cidr="" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456899 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456904 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456907 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456910 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456913 2560 flags.go:64] FLAG: --port="10250" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456916 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 01:55:37.461168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456919 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0074a73fb0b512a35" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456922 2560 flags.go:64] FLAG: --qos-reserved="" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456926 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456929 2560 flags.go:64] FLAG: --register-node="true" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456932 2560 flags.go:64] FLAG: --register-schedulable="true" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456935 2560 flags.go:64] FLAG: --register-with-taints="" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456939 2560 flags.go:64] FLAG: --registry-burst="10" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456942 2560 flags.go:64] FLAG: --registry-qps="5" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456945 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456948 2560 flags.go:64] FLAG: --reserved-memory="" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456952 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456955 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456957 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456960 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456963 2560 flags.go:64] FLAG: --runonce="false" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456966 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456969 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456972 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456975 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456978 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456981 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456984 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456987 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456991 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456994 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.456997 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 01:55:37.461753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457000 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457003 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457006 2560 flags.go:64] FLAG: --system-cgroups="" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457009 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457014 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457017 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457020 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457024 2560 flags.go:64] FLAG: --tls-min-version="" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457027 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457030 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457033 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457036 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457039 2560 flags.go:64] FLAG: --v="2" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457043 2560 flags.go:64] FLAG: --version="false" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457048 2560 flags.go:64] FLAG: --vmodule="" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457052 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457055 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457151 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457154 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457158 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457160 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457164 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457166 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457169 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:55:37.462420 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457172 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457175 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457177 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457182 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457186 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457188 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457191 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457193 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457196 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457199 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457202 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457204 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457207 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457209 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457212 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457214 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457217 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457219 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457222 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457224 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:55:37.463037 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457227 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457230 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457232 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457235 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457238 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457240 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457243 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457246 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457248 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457251 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457254 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457256 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457259 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457261 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457265 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457267 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457270 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457272 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457275 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457277 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:55:37.463547 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457280 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457282 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457285 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457288 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457291 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457293 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457296 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457299 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457301 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457304 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457306 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457309 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457311 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457314 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457316 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457319 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457321 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457324 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457326 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:55:37.464056 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457329 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457331 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457334 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457336 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457339 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457341 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457345 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457352 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457355 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457358 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457361 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457363 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457366 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457369 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457372 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457375 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457380 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457384 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457387 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:55:37.464524 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.457390 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.457396 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.463720 2560 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.463738 2560 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463800 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463805 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463808 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463811 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463814 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463818 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463821 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463824 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463826 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463829 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463832 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463834 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:55:37.465008 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463837 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463840 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463843 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463845 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463848 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463850 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463853 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463857 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463860 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463862 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463867 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463872 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463875 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463878 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463881 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463884 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463887 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463889 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463893 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463896 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:55:37.465428 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463899 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463902 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463905 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463907 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463910 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463913 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463915 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463918 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463920 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463923 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463926 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463928 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463931 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463933 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463936 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463938 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463941 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463943 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463946 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463949 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:55:37.465925 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463951 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463954 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463956 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463959 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463961 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463964 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463966 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463969 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463972 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463974 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463977 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463980 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463983 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463986 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463988 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463991 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463993 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463996 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.463998 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464001 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:55:37.466402 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464003 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464006 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464008 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464010 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464013 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464016 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464020 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464024 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464026 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464029 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464031 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464034 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464037 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464039 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.464044 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:55:37.466999 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464141 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464145 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464148 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464151 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464154 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464157 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464160 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464163 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464166 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464168 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464171 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464174 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464176 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464179 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464182 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464184 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464187 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464189 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464192 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 01:55:37.467384 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464196 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464199 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464203 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464206 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464208 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464211 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464214 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464216 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464219 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464222 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464224 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464226 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464229 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464231 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464235 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464238 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464241 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464243 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464246 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464249 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 01:55:37.467851 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464251 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464254 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464256 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464259 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464262 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464265 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464267 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464270 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464272 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464274 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464277 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464279 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464282 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464284 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464287 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464290 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464292 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464295 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464297 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 01:55:37.468397 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464300 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464302 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464305 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464307 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464310 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464313 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464315 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464317 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464320 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464322 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464325 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464328 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464330 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464333 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464335 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464338 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464340 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464343 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464346 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464349 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 01:55:37.468889 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464351 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464354 2560 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464357 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464359 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464362 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464364 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464367 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:37.464369 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.464375 2560 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.465178 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.467854 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.468750 2560 server.go:1019] "Starting client certificate rotation" Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.468881 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:55:37.469676 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.468932 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 01:55:37.488340 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.488318 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:55:37.489432 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.489414 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 01:55:37.500417 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.500396 2560 log.go:25] "Validated CRI v1 runtime API" Jun 02 01:55:37.506467 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.506449 2560 log.go:25] "Validated CRI v1 image API" Jun 02 01:55:37.507842 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.507824 2560 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 01:55:37.511183 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.511159 2560 fs.go:135] Filesystem UUIDs: map[25e4771e-9740-4c3b-9d49-38b5ff23f2e3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e728f9bd-d751-4feb-96f6-702218a9adda:/dev/nvme0n1p4] Jun 02 01:55:37.511266 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.511179 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 01:55:37.515540 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.515421 2560 manager.go:217] Machine: {Timestamp:2026-06-02 01:55:37.514887059 +0000 UTC m=+0.337295744 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101316 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec284e4be0efd297f16e5feb6ca9f7ba SystemUUID:ec284e4b-e0ef-d297-f16e-5feb6ca9f7ba BootID:2bfa6640-8b30-4556-9fcd-4bcbef67a2c2 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:15:18:e8:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:15:18:e8:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:ad:5f:cb:7a:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 01:55:37.516191 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.516179 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 01:55:37.516285 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.516272 2560 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 01:55:37.517950 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.517925 2560 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 01:55:37.518116 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.517952 2560 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 01:55:37.518191 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.518132 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 01:55:37.518191 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.518145 2560 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 01:55:37.518191 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.518157 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:55:37.518818 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.518804 2560 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 01:55:37.520277 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.520264 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:55:37.520412 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.520401 2560 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 01:55:37.522351 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.522339 2560 kubelet.go:491] "Attempting to sync node with API server" Jun 02 01:55:37.522407 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.522357 2560 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 01:55:37.522407 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.522374 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 01:55:37.522407 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.522386 2560 kubelet.go:397] "Adding apiserver pod source" Jun 02 01:55:37.522407 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.522397 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 01:55:37.523013 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.522994 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:55:37.523369 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.523356 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:55:37.523430 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.523380 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 01:55:37.525789 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.525774 2560 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 01:55:37.527599 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.527584 2560 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 01:55:37.529655 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529640 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529660 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529670 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529677 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529690 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529711 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529720 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529730 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 01:55:37.529741 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529740 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 01:55:37.530039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529750 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 01:55:37.530039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529782 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 01:55:37.530039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.529793 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 01:55:37.530518 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.530507 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 01:55:37.530571 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.530521 2560 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 01:55:37.533703 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.533686 2560 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 01:55:37.533795 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.533726 2560 server.go:1295] "Started kubelet" Jun 02 01:55:37.534323 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.534259 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 01:55:37.534437 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.534406 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 01:55:37.535170 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.535144 2560 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 01:55:37.535249 ip-10-0-134-54 systemd[1]: Started Kubernetes Kubelet. Jun 02 01:55:37.535358 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.535337 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 01:55:37.535437 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.535382 2560 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 01:55:37.536480 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.536439 2560 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 01:55:37.538654 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.538483 2560 server.go:317] "Adding debug handlers to kubelet server" Jun 02 01:55:37.540551 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.540532 2560 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 01:55:37.542933 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.542913 2560 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 01:55:37.543106 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.542392 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-54.ec2.internal.18b520d77a1d5400 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-54.ec2.internal,UID:ip-10-0-134-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-54.ec2.internal,},FirstTimestamp:2026-06-02 01:55:37.533699072 +0000 UTC m=+0.356107759,LastTimestamp:2026-06-02 01:55:37.533699072 +0000 UTC m=+0.356107759,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-54.ec2.internal,}" Jun 02 01:55:37.543499 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.543487 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 01:55:37.543549 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.543496 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 01:55:37.543623 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.543602 2560 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 01:55:37.543623 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.543621 2560 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 01:55:37.543790 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.543692 2560 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 01:55:37.543790 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.543749 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 02 01:55:37.543790 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.543755 2560 reconciler.go:26] "Reconciler: start to sync state" Jun 02 01:55:37.544227 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.544209 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:37.544669 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.544650 2560 factory.go:153] Registering CRI-O factory Jun 02 01:55:37.544753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.544682 2560 factory.go:223] Registration of the crio container factory successfully Jun 02 01:55:37.544753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.544737 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 01:55:37.544753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.544745 2560 factory.go:55] Registering systemd factory Jun 02 01:55:37.544753 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.544751 2560 factory.go:223] Registration of the systemd container factory successfully Jun 02 01:55:37.544994 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.544783 2560 factory.go:103] Registering Raw factory Jun 02 01:55:37.544994 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.544807 2560 manager.go:1196] Started watching for new ooms in manager Jun 02 01:55:37.545697 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.545681 2560 manager.go:319] Starting recovery of all containers Jun 02 01:55:37.554824 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.554808 2560 manager.go:324] Recovery completed Jun 02 01:55:37.555308 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.555276 2560 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 01:55:37.555308 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.555297 2560 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 01:55:37.559088 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.559074 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:55:37.560913 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.560898 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:55:37.560971 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.560925 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:55:37.560971 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.560937 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:55:37.561435 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.561423 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 01:55:37.561481 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.561435 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 01:55:37.561481 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.561451 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 02 01:55:37.563371 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.563310 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-54.ec2.internal.18b520d77bbc97c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-54.ec2.internal,UID:ip-10-0-134-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-54.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-54.ec2.internal,},FirstTimestamp:2026-06-02 01:55:37.56091386 +0000 UTC m=+0.383322545,LastTimestamp:2026-06-02 01:55:37.56091386 +0000 UTC m=+0.383322545,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-54.ec2.internal,}" Jun 02 01:55:37.563804 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.563792 2560 policy_none.go:49] "None policy: Start" Jun 02 01:55:37.563845 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.563813 2560 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 01:55:37.563845 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.563826 2560 state_mem.go:35] "Initializing new in-memory state store" Jun 02 01:55:37.574999 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.574937 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-54.ec2.internal.18b520d77bbcd7f3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-54.ec2.internal,UID:ip-10-0-134-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-54.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-54.ec2.internal,},FirstTimestamp:2026-06-02 01:55:37.560930291 +0000 UTC m=+0.383338976,LastTimestamp:2026-06-02 01:55:37.560930291 +0000 UTC m=+0.383338976,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-54.ec2.internal,}" Jun 02 01:55:37.586229 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.586203 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6mrp" Jun 02 01:55:37.590072 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.590003 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-54.ec2.internal.18b520d77bbd0352 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-54.ec2.internal,UID:ip-10-0-134-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-54.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-54.ec2.internal,},FirstTimestamp:2026-06-02 01:55:37.560941394 +0000 UTC m=+0.383350079,LastTimestamp:2026-06-02 01:55:37.560941394 +0000 UTC m=+0.383350079,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-54.ec2.internal,}" Jun 02 01:55:37.593260 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.593239 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r6mrp" Jun 02 01:55:37.604410 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.604396 2560 manager.go:341] "Starting Device Plugin manager" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.604428 2560 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.604438 2560 server.go:85] "Starting device plugin registration server" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.604699 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.604711 2560 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.604854 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.604933 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.604939 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.605693 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 01:55:37.611922 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.605729 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:37.635468 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.635435 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 01:55:37.636690 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.636673 2560 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 01:55:37.636745 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.636708 2560 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 01:55:37.636745 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.636730 2560 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 01:55:37.636745 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.636741 2560 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 01:55:37.636908 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.636801 2560 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 01:55:37.640090 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.640075 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:55:37.705412 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.705330 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:55:37.706327 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.706311 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:55:37.706410 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.706341 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:55:37.706410 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.706352 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:55:37.706410 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.706377 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.715203 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.715182 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.715203 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.715205 2560 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-54.ec2.internal\": node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:37.727471 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.727449 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:37.737589 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.737567 2560 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal"] Jun 02 01:55:37.737654 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.737634 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:55:37.739123 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.739109 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:55:37.739183 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.739135 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:55:37.739183 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.739145 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:55:37.740406 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.740394 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:55:37.741030 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741015 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:55:37.741129 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741041 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:55:37.741129 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741053 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:55:37.741129 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741015 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.741278 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741141 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:55:37.741729 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741706 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:55:37.741827 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741733 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:55:37.741827 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.741746 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:55:37.742014 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.742000 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.742065 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.742026 2560 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 01:55:37.742610 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.742592 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientMemory" Jun 02 01:55:37.742716 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.742619 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 01:55:37.742716 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.742632 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeHasSufficientPID" Jun 02 01:55:37.744686 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.744668 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b28c21ff636f985fc35965ab6359f625-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal\" (UID: \"b28c21ff636f985fc35965ab6359f625\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.744778 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.744699 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28c21ff636f985fc35965ab6359f625-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal\" (UID: \"b28c21ff636f985fc35965ab6359f625\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.744778 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.744724 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30e5e45055e5bef559a23f3bde5c0818-config\") pod \"kube-apiserver-proxy-ip-10-0-134-54.ec2.internal\" (UID: \"30e5e45055e5bef559a23f3bde5c0818\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.766641 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.766614 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-54.ec2.internal\" not found" node="ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.771008 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.770991 2560 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-54.ec2.internal\" not found" node="ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.827915 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.827893 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:37.845173 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.845155 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30e5e45055e5bef559a23f3bde5c0818-config\") pod \"kube-apiserver-proxy-ip-10-0-134-54.ec2.internal\" (UID: \"30e5e45055e5bef559a23f3bde5c0818\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.845235 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.845178 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b28c21ff636f985fc35965ab6359f625-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal\" (UID: \"b28c21ff636f985fc35965ab6359f625\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.845235 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.845197 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28c21ff636f985fc35965ab6359f625-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal\" (UID: \"b28c21ff636f985fc35965ab6359f625\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.845235 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.845233 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b28c21ff636f985fc35965ab6359f625-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal\" (UID: \"b28c21ff636f985fc35965ab6359f625\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.845364 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.845258 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30e5e45055e5bef559a23f3bde5c0818-config\") pod \"kube-apiserver-proxy-ip-10-0-134-54.ec2.internal\" (UID: \"30e5e45055e5bef559a23f3bde5c0818\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.845364 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:37.845280 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b28c21ff636f985fc35965ab6359f625-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal\" (UID: \"b28c21ff636f985fc35965ab6359f625\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:37.928333 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:37.928301 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:38.029081 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.028994 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:38.069449 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.069415 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:38.074144 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.074129 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" Jun 02 01:55:38.129909 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.129877 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:38.230389 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.230356 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:38.330941 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.330866 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:38.431382 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.431348 2560 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-54.ec2.internal\" not found" Jun 02 01:55:38.454556 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.454534 2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:55:38.468428 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.468407 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 01:55:38.468541 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.468519 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:55:38.468583 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.468561 2560 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 01:55:38.509852 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.509829 2560 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:55:38.521676 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.521661 2560 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:55:38.522641 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.522628 2560 apiserver.go:52] "Watching apiserver" Jun 02 01:55:38.530712 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.530689 2560 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 01:55:38.532666 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.532635 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-562xl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj","openshift-dns/node-resolver-9qpvq","openshift-image-registry/node-ca-b5922","openshift-multus/multus-782bq","openshift-cluster-node-tuning-operator/tuned-h8vnn","openshift-multus/multus-additional-cni-plugins-mpbn8","openshift-multus/network-metrics-daemon-5crbq","openshift-network-diagnostics/network-check-target-2lplc","openshift-network-operator/iptables-alerter-n9lvt","openshift-ovn-kubernetes/ovnkube-node-7js2s"] Jun 02 01:55:38.536464 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.536440 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.536665 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.536627 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.537849 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.537815 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.538891 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.538864 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6xf72\"" Jun 02 01:55:38.539015 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.538947 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:38.539015 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.538991 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t79dz\"" Jun 02 01:55:38.539143 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.539006 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:38.539143 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.538871 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 01:55:38.539143 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.539054 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 01:55:38.539368 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.539355 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 01:55:38.539814 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.539799 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 01:55:38.539902 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.539836 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:55:38.539902 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.539803 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 01:55:38.539902 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.539877 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 01:55:38.540107 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.540093 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.540187 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.540173 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pp2rm\"" Jun 02 01:55:38.541275 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.541262 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.542391 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.542375 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.543449 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.543408 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.543592 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.543575 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 01:55:38.543726 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.543710 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" Jun 02 01:55:38.543821 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.543807 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 01:55:38.543871 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.543830 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 01:55:38.543871 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.543840 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9fvg9\"" Jun 02 01:55:38.543978 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.543965 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 01:55:38.544100 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.544084 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 01:55:38.544602 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.544582 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-782bq" Jun 02 01:55:38.544987 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.544970 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 01:55:38.545069 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545055 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6m48q\"" Jun 02 01:55:38.545164 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545145 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 01:55:38.545264 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545169 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 01:55:38.545264 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545184 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 01:55:38.545383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545331 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 01:55:38.545383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545331 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-snq6d\"" Jun 02 01:55:38.545477 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545433 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 01:55:38.545477 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545433 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 01:55:38.545477 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545428 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 01:55:38.545992 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.545975 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.546243 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.546225 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5xrff\"" Jun 02 01:55:38.546374 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.546354 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 01:55:38.546599 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.546584 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 01:55:38.547087 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.547068 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 01:55:38.547319 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.547297 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l6rs2\"" Jun 02 01:55:38.547395 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.547374 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 01:55:38.547450 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.547431 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 01:55:38.547538 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.547523 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 01:55:38.547598 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.547583 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:38.547674 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.547655 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:38.548164 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.548148 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 01:55:38.548353 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.548333 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zwp4t\"" Jun 02 01:55:38.548400 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.548367 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 01:55:38.548937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.548906 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-etc-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.548996 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.548953 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30a65403-2c59-4183-a4de-c90b19da6df7-ovn-node-metrics-cert\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.548996 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.548979 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ssd\" (UniqueName: \"kubernetes.io/projected/30a65403-2c59-4183-a4de-c90b19da6df7-kube-api-access-x7ssd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549101 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-system-cni-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.549101 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549028 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw98n\" (UniqueName: \"kubernetes.io/projected/b76b50db-cb13-4227-b38e-0f8d2fcafbae-kube-api-access-mw98n\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.549101 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-env-overrides\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549101 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549085 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-k8s-cni-cncf-io\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.549280 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549109 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9-konnectivity-ca\") pod \"konnectivity-agent-562xl\" (UID: \"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9\") " pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.549280 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-modprobe-d\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.549280 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-cni-bin\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.549280 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549235 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.549280 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-socket-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549303 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-device-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-systemd\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549350 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-node-log\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549378 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysctl-conf\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-run\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549429 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-var-lib-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549457 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549447 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-log-socket\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-run-ovn-kubernetes\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549489 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549565 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-sys\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549592 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c854519f-338d-4365-89a5-9084dbe5f0bc-iptables-alerter-script\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549642 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-cni-bin\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b76b50db-cb13-4227-b38e-0f8d2fcafbae-hosts-file\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-tuned\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.549717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549692 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-ovn\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-cnibin\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-cni-binary-copy\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-etc-kubernetes\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549814 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-var-lib-kubelet\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549872 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-conf-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549886 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-sys-fs\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549899 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xg4v\" (UniqueName: \"kubernetes.io/projected/c854519f-338d-4365-89a5-9084dbe5f0bc-kube-api-access-5xg4v\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.550039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.549923 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-cni-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550428 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-lib-modules\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.550428 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550221 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-systemd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.550428 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550308 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-cni-netd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.550428 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550386 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-cni-multus\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550428 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550415 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-registration-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.550643 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550443 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysctl-d\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.550643 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-slash\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.550643 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-netns\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550643 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmt2\" (UniqueName: \"kubernetes.io/projected/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-kube-api-access-7gmt2\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.550843 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550665 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4767abf9-3872-475e-bba4-c76c53504638-host\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.550843 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550705 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4767abf9-3872-475e-bba4-c76c53504638-serviceca\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.550843 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-host\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.550967 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-systemd-units\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.550967 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550896 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-ovnkube-config\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.550967 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-os-release\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.551208 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550967 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9-agent-certs\") pod \"konnectivity-agent-562xl\" (UID: \"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9\") " pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.551208 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.550993 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b76b50db-cb13-4227-b38e-0f8d2fcafbae-tmp-dir\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.551208 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-kubernetes\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.551592 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:38.551666 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551624 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c854519f-338d-4365-89a5-9084dbe5f0bc-host-slash\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.551666 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551657 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-run-netns\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.551754 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysconfig\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.551754 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551723 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9bd88df-9781-47c5-90a6-04234bfb94b0-tmp\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.551871 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtkpd\" (UniqueName: \"kubernetes.io/projected/f9bd88df-9781-47c5-90a6-04234bfb94b0-kube-api-access-vtkpd\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.551871 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551800 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-kubelet\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.551871 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551835 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-socket-dir-parent\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.552046 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-hostroot\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.552046 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.551965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv2k5\" (UniqueName: \"kubernetes.io/projected/4767abf9-3872-475e-bba4-c76c53504638-kube-api-access-lv2k5\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.552046 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.552023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.552185 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.552053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76lsn\" (UniqueName: \"kubernetes.io/projected/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-kube-api-access-76lsn\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.552185 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.552099 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-ovnkube-script-lib\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.552185 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.552128 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-kubelet\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.552185 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.552158 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-daemon-config\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.552408 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.552187 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-multus-certs\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.558481 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.558461 2560 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 01:55:38.559078 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.559032 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal"] Jun 02 01:55:38.559815 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.559789 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:55:38.559906 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.559863 2560 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" Jun 02 01:55:38.565682 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.565656 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal"] Jun 02 01:55:38.565789 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.565772 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 01:55:38.594745 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.594684 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 01:50:37 +0000 UTC" deadline="2028-03-10 17:37:13.450091998 +0000 UTC" Jun 02 01:55:38.594745 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.594711 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15543h41m34.855383767s" Jun 02 01:55:38.599115 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.599094 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cx2w7" Jun 02 01:55:38.604202 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.604182 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cx2w7" Jun 02 01:55:38.644794 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.644773 2560 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 01:55:38.652508 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652485 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-socket-dir-parent\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652626 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652512 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-hostroot\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652626 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652535 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8xh9\" (UniqueName: \"kubernetes.io/projected/035beb85-018f-4b96-996b-61ec31f45b19-kube-api-access-q8xh9\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.652626 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652554 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lv2k5\" (UniqueName: \"kubernetes.io/projected/4767abf9-3872-475e-bba4-c76c53504638-kube-api-access-lv2k5\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.652626 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652579 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.652626 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652603 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-76lsn\" (UniqueName: \"kubernetes.io/projected/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-kube-api-access-76lsn\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.652626 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652612 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-hostroot\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652616 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-socket-dir-parent\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652682 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-etc-selinux\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652711 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-ovnkube-script-lib\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652750 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-kubelet\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652793 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-daemon-config\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652818 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-multus-certs\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652847 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-os-release\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652875 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-etc-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652889 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-multus-certs\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.652937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652911 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30a65403-2c59-4183-a4de-c90b19da6df7-ovn-node-metrics-cert\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652944 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ssd\" (UniqueName: \"kubernetes.io/projected/30a65403-2c59-4183-a4de-c90b19da6df7-kube-api-access-x7ssd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.652997 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-system-cni-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653024 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653049 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mw98n\" (UniqueName: \"kubernetes.io/projected/b76b50db-cb13-4227-b38e-0f8d2fcafbae-kube-api-access-mw98n\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653085 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-env-overrides\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653108 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-k8s-cni-cncf-io\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653143 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9-konnectivity-ca\") pod \"konnectivity-agent-562xl\" (UID: \"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9\") " pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653186 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653229 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-modprobe-d\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653272 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-cni-bin\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653310 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653339 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-socket-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-kubelet\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.653383 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653359 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-ovnkube-script-lib\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653400 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-k8s-cni-cncf-io\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653421 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653428 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-device-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653371 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-device-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653495 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-system-cni-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653543 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-etc-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653593 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-systemd\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653621 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653644 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-node-log\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653645 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-modprobe-d\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653649 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-socket-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653701 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653703 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-node-log\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653725 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-cni-bin\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653822 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysctl-conf\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653864 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-run\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653893 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-var-lib-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653918 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-log-socket\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653985 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-systemd\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.653986 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-env-overrides\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654019 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-run-ovn-kubernetes\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654039 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-run\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654050 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysctl-conf\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654062 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-var-lib-openvswitch\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654053 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6wl\" (UniqueName: \"kubernetes.io/projected/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-kube-api-access-vt6wl\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-run-ovn-kubernetes\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654142 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-log-socket\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654153 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654166 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-sys\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654198 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c854519f-338d-4365-89a5-9084dbe5f0bc-iptables-alerter-script\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654209 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9-konnectivity-ca\") pod \"konnectivity-agent-562xl\" (UID: \"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9\") " pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654250 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-cni-bin\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.654864 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654258 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-sys\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654277 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-daemon-config\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654279 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b76b50db-cb13-4227-b38e-0f8d2fcafbae-hosts-file\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b76b50db-cb13-4227-b38e-0f8d2fcafbae-hosts-file\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654328 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-cni-bin\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654360 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-tuned\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654384 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-ovn\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654407 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-cnibin\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654434 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-ovn\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654444 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-cni-binary-copy\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-cnibin\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654519 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-etc-kubernetes\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654596 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-var-lib-kubelet\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654620 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-conf-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654644 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-sys-fs\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654670 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5xg4v\" (UniqueName: \"kubernetes.io/projected/c854519f-338d-4365-89a5-9084dbe5f0bc-kube-api-access-5xg4v\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654696 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-cni-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.655647 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654700 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-etc-kubernetes\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654710 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c854519f-338d-4365-89a5-9084dbe5f0bc-iptables-alerter-script\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654719 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-lib-modules\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654743 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-systemd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654757 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-sys-fs\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654811 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-run-systemd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654811 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-cni-netd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654821 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-var-lib-kubelet\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654849 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-cni-multus\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654865 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-conf-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654870 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-cni-netd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654877 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-registration-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654907 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysctl-d\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654931 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-slash\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654929 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-var-lib-cni-multus\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654932 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-cni-binary-copy\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654950 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-lib-modules\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654966 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-netns\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.656516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.654995 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmt2\" (UniqueName: \"kubernetes.io/projected/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-kube-api-access-7gmt2\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655004 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-registration-dir\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655006 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-multus-cni-dir\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-slash\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655062 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-host-run-netns\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655085 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4767abf9-3872-475e-bba4-c76c53504638-host\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysctl-d\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655111 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4767abf9-3872-475e-bba4-c76c53504638-serviceca\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655130 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4767abf9-3872-475e-bba4-c76c53504638-host\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655150 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-cni-binary-copy\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655251 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-host\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655284 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-systemd-units\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655311 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-ovnkube-config\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655333 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-os-release\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655354 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-systemd-units\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655532 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4767abf9-3872-475e-bba4-c76c53504638-serviceca\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655360 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9-agent-certs\") pod \"konnectivity-agent-562xl\" (UID: \"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9\") " pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655298 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-host\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.657393 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655607 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-os-release\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.655658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-cnibin\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.656232 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b76b50db-cb13-4227-b38e-0f8d2fcafbae-tmp-dir\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.656477 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-kubernetes\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.656524 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.656857 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-kubernetes\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.657021 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/30a65403-2c59-4183-a4de-c90b19da6df7-ovnkube-config\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.657347 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b76b50db-cb13-4227-b38e-0f8d2fcafbae-tmp-dir\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.657963 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c854519f-338d-4365-89a5-9084dbe5f0bc-host-slash\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.657999 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-tuned\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.658012 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658011 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-run-netns\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658064 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-system-cni-dir\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658104 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658116 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c854519f-338d-4365-89a5-9084dbe5f0bc-host-slash\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658068 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-run-netns\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658139 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysconfig\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/30a65403-2c59-4183-a4de-c90b19da6df7-ovn-node-metrics-cert\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658174 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9bd88df-9781-47c5-90a6-04234bfb94b0-tmp\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658238 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9bd88df-9781-47c5-90a6-04234bfb94b0-etc-sysconfig\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658299 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9-agent-certs\") pod \"konnectivity-agent-562xl\" (UID: \"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9\") " pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658310 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtkpd\" (UniqueName: \"kubernetes.io/projected/f9bd88df-9781-47c5-90a6-04234bfb94b0-kube-api-access-vtkpd\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.658451 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658369 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-kubelet\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.658937 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.658609 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/30a65403-2c59-4183-a4de-c90b19da6df7-host-kubelet\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.661796 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.661773 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9bd88df-9781-47c5-90a6-04234bfb94b0-tmp\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.662776 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.662739 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:55:38.662886 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.662782 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:55:38.662886 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.662798 2560 projected.go:194] Error preparing data for projected volume kube-api-access-2vvv2 for pod openshift-network-diagnostics/network-check-target-2lplc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:38.663024 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.662892 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2 podName:b96071d2-51c5-47b4-87df-8e1673519e5b nodeName:}" failed. No retries permitted until 2026-06-02 01:55:39.162849485 +0000 UTC m=+1.985258186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2vvv2" (UniqueName: "kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2") pod "network-check-target-2lplc" (UID: "b96071d2-51c5-47b4-87df-8e1673519e5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:38.663939 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.663914 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xg4v\" (UniqueName: \"kubernetes.io/projected/c854519f-338d-4365-89a5-9084dbe5f0bc-kube-api-access-5xg4v\") pod \"iptables-alerter-n9lvt\" (UID: \"c854519f-338d-4365-89a5-9084dbe5f0bc\") " pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.664576 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.664455 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmt2\" (UniqueName: \"kubernetes.io/projected/06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385-kube-api-access-7gmt2\") pod \"multus-782bq\" (UID: \"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385\") " pod="openshift-multus/multus-782bq" Jun 02 01:55:38.664970 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.664946 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv2k5\" (UniqueName: \"kubernetes.io/projected/4767abf9-3872-475e-bba4-c76c53504638-kube-api-access-lv2k5\") pod \"node-ca-b5922\" (UID: \"4767abf9-3872-475e-bba4-c76c53504638\") " pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.665047 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.664975 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw98n\" (UniqueName: \"kubernetes.io/projected/b76b50db-cb13-4227-b38e-0f8d2fcafbae-kube-api-access-mw98n\") pod \"node-resolver-9qpvq\" (UID: \"b76b50db-cb13-4227-b38e-0f8d2fcafbae\") " pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.665047 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.665027 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76lsn\" (UniqueName: \"kubernetes.io/projected/1aa7df49-dc6c-4d37-8b10-8cd1b4a55631-kube-api-access-76lsn\") pod \"aws-ebs-csi-driver-node-nbjrj\" (UID: \"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.665347 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.665331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ssd\" (UniqueName: \"kubernetes.io/projected/30a65403-2c59-4183-a4de-c90b19da6df7-kube-api-access-x7ssd\") pod \"ovnkube-node-7js2s\" (UID: \"30a65403-2c59-4183-a4de-c90b19da6df7\") " pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.666646 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.666607 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtkpd\" (UniqueName: \"kubernetes.io/projected/f9bd88df-9781-47c5-90a6-04234bfb94b0-kube-api-access-vtkpd\") pod \"tuned-h8vnn\" (UID: \"f9bd88df-9781-47c5-90a6-04234bfb94b0\") " pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.666731 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.666653 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" Jun 02 01:55:38.668628 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.668593 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e5e45055e5bef559a23f3bde5c0818.slice/crio-89aeabaec982e736ad8d02b2e60d75ee9768793a7c79fb031bf61c769414d7fc WatchSource:0}: Error finding container 89aeabaec982e736ad8d02b2e60d75ee9768793a7c79fb031bf61c769414d7fc: Status 404 returned error can't find the container with id 89aeabaec982e736ad8d02b2e60d75ee9768793a7c79fb031bf61c769414d7fc Jun 02 01:55:38.668850 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.668830 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb28c21ff636f985fc35965ab6359f625.slice/crio-d6a11f240a5c84482276e5578d60364708aa92b50bf4db61c6dd569a2627a3d4 WatchSource:0}: Error finding container d6a11f240a5c84482276e5578d60364708aa92b50bf4db61c6dd569a2627a3d4: Status 404 returned error can't find the container with id d6a11f240a5c84482276e5578d60364708aa92b50bf4db61c6dd569a2627a3d4 Jun 02 01:55:38.672731 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.672712 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9qpvq" Jun 02 01:55:38.674404 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.674386 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 01:55:38.675411 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.675390 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa7df49_dc6c_4d37_8b10_8cd1b4a55631.slice/crio-506acb053be72fdd211594df8fc9ccf9f26dc2faba9725896da64889cb1e5782 WatchSource:0}: Error finding container 506acb053be72fdd211594df8fc9ccf9f26dc2faba9725896da64889cb1e5782: Status 404 returned error can't find the container with id 506acb053be72fdd211594df8fc9ccf9f26dc2faba9725896da64889cb1e5782 Jun 02 01:55:38.680181 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.680163 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-782bq" Jun 02 01:55:38.682578 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.682554 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76b50db_cb13_4227_b38e_0f8d2fcafbae.slice/crio-deb33d8bd5a237dc3f5ec58163a0d174ef3cc2c990c87efe4c4f6186023d1dd5 WatchSource:0}: Error finding container deb33d8bd5a237dc3f5ec58163a0d174ef3cc2c990c87efe4c4f6186023d1dd5: Status 404 returned error can't find the container with id deb33d8bd5a237dc3f5ec58163a0d174ef3cc2c990c87efe4c4f6186023d1dd5 Jun 02 01:55:38.687519 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.687500 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f6ff7f_86f7_4d7f_9ccd_8b4b70bc1385.slice/crio-99bb064f40c7fd658f0f335377ef3ad3d33e5c5dd0bc5d5b19f84b5422e42018 WatchSource:0}: Error finding container 99bb064f40c7fd658f0f335377ef3ad3d33e5c5dd0bc5d5b19f84b5422e42018: Status 404 returned error can't find the container with id 99bb064f40c7fd658f0f335377ef3ad3d33e5c5dd0bc5d5b19f84b5422e42018 Jun 02 01:55:38.759102 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759074 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-cni-binary-copy\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759102 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759104 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-cnibin\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759331 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759136 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-system-cni-dir\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759331 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759152 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759331 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759186 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q8xh9\" (UniqueName: \"kubernetes.io/projected/035beb85-018f-4b96-996b-61ec31f45b19-kube-api-access-q8xh9\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759331 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759196 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-cnibin\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759331 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759196 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-system-cni-dir\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759331 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759313 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-os-release\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759338 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759344 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759382 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759420 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6wl\" (UniqueName: \"kubernetes.io/projected/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-kube-api-access-vt6wl\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759466 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.759507 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:38.759567 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:39.259549723 +0000 UTC m=+2.081958411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:38.759683 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759418 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/035beb85-018f-4b96-996b-61ec31f45b19-os-release\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.759986 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.759745 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-cni-binary-copy\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.760074 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.760051 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.760108 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.760081 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/035beb85-018f-4b96-996b-61ec31f45b19-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.768315 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.768295 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8xh9\" (UniqueName: \"kubernetes.io/projected/035beb85-018f-4b96-996b-61ec31f45b19-kube-api-access-q8xh9\") pod \"multus-additional-cni-plugins-mpbn8\" (UID: \"035beb85-018f-4b96-996b-61ec31f45b19\") " pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.768411 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.768370 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6wl\" (UniqueName: \"kubernetes.io/projected/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-kube-api-access-vt6wl\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:38.862530 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.862453 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-562xl" Jun 02 01:55:38.868088 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.868064 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1fbf4a_ccd0_4686_b40d_7e1be4351ed9.slice/crio-88e096c5e33212bd0ea5d923a000f72e57f591c04f069f035703d2f3bdc66ffc WatchSource:0}: Error finding container 88e096c5e33212bd0ea5d923a000f72e57f591c04f069f035703d2f3bdc66ffc: Status 404 returned error can't find the container with id 88e096c5e33212bd0ea5d923a000f72e57f591c04f069f035703d2f3bdc66ffc Jun 02 01:55:38.894827 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.894799 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b5922" Jun 02 01:55:38.902801 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.902774 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4767abf9_3872_475e_bba4_c76c53504638.slice/crio-391b896719fdedfffb73424206b6969d6750c48079dca048ff31084505d091a0 WatchSource:0}: Error finding container 391b896719fdedfffb73424206b6969d6750c48079dca048ff31084505d091a0: Status 404 returned error can't find the container with id 391b896719fdedfffb73424206b6969d6750c48079dca048ff31084505d091a0 Jun 02 01:55:38.912835 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.912812 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" Jun 02 01:55:38.918909 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.918885 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bd88df_9781_47c5_90a6_04234bfb94b0.slice/crio-32b0fd7954957dc1e1ea8a4bb444f19a171bfc6d5a135a7268f2c83753defac1 WatchSource:0}: Error finding container 32b0fd7954957dc1e1ea8a4bb444f19a171bfc6d5a135a7268f2c83753defac1: Status 404 returned error can't find the container with id 32b0fd7954957dc1e1ea8a4bb444f19a171bfc6d5a135a7268f2c83753defac1 Jun 02 01:55:38.924882 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.924861 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n9lvt" Jun 02 01:55:38.930491 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.930465 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc854519f_338d_4365_89a5_9084dbe5f0bc.slice/crio-7c90065b90f8e89154da0e8103a2b2b0993f9050fe94a69a0c358e17cdc5ee53 WatchSource:0}: Error finding container 7c90065b90f8e89154da0e8103a2b2b0993f9050fe94a69a0c358e17cdc5ee53: Status 404 returned error can't find the container with id 7c90065b90f8e89154da0e8103a2b2b0993f9050fe94a69a0c358e17cdc5ee53 Jun 02 01:55:38.942667 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.942645 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:55:38.948223 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.948194 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30a65403_2c59_4183_a4de_c90b19da6df7.slice/crio-37f3ae89d6703480279918f0fa0f59bd649be0b6ba24ebd61b9103c08b9103df WatchSource:0}: Error finding container 37f3ae89d6703480279918f0fa0f59bd649be0b6ba24ebd61b9103c08b9103df: Status 404 returned error can't find the container with id 37f3ae89d6703480279918f0fa0f59bd649be0b6ba24ebd61b9103c08b9103df Jun 02 01:55:38.987189 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:38.987155 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" Jun 02 01:55:38.992933 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:55:38.992909 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035beb85_018f_4b96_996b_61ec31f45b19.slice/crio-e4e90198fc4bc691f959adabecd3bf5e743b0efd62c05ebc6940c94e489eb743 WatchSource:0}: Error finding container e4e90198fc4bc691f959adabecd3bf5e743b0efd62c05ebc6940c94e489eb743: Status 404 returned error can't find the container with id e4e90198fc4bc691f959adabecd3bf5e743b0efd62c05ebc6940c94e489eb743 Jun 02 01:55:39.163015 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.162932 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:39.163201 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:39.163178 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:55:39.163201 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:39.163202 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:55:39.163327 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:39.163214 2560 projected.go:194] Error preparing data for projected volume kube-api-access-2vvv2 for pod openshift-network-diagnostics/network-check-target-2lplc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:39.163327 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:39.163271 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2 podName:b96071d2-51c5-47b4-87df-8e1673519e5b nodeName:}" failed. No retries permitted until 2026-06-02 01:55:40.163252746 +0000 UTC m=+2.985661433 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vvv2" (UniqueName: "kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2") pod "network-check-target-2lplc" (UID: "b96071d2-51c5-47b4-87df-8e1673519e5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:39.263415 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.263380 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:39.263593 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:39.263562 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:39.263661 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:39.263627 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:40.263610018 +0000 UTC m=+3.086018693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:39.605905 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.605751 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:50:38 +0000 UTC" deadline="2027-11-14 08:17:13.592530636 +0000 UTC" Jun 02 01:55:39.605905 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.605809 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12726h21m33.986726145s" Jun 02 01:55:39.674867 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.674730 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"37f3ae89d6703480279918f0fa0f59bd649be0b6ba24ebd61b9103c08b9103df"} Jun 02 01:55:39.675043 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.675027 2560 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:55:39.693939 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.693899 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5922" event={"ID":"4767abf9-3872-475e-bba4-c76c53504638","Type":"ContainerStarted","Data":"391b896719fdedfffb73424206b6969d6750c48079dca048ff31084505d091a0"} Jun 02 01:55:39.721280 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.721244 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-562xl" event={"ID":"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9","Type":"ContainerStarted","Data":"88e096c5e33212bd0ea5d923a000f72e57f591c04f069f035703d2f3bdc66ffc"} Jun 02 01:55:39.743960 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.743881 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-782bq" event={"ID":"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385","Type":"ContainerStarted","Data":"99bb064f40c7fd658f0f335377ef3ad3d33e5c5dd0bc5d5b19f84b5422e42018"} Jun 02 01:55:39.766623 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.766588 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" event={"ID":"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631","Type":"ContainerStarted","Data":"506acb053be72fdd211594df8fc9ccf9f26dc2faba9725896da64889cb1e5782"} Jun 02 01:55:39.773667 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.773517 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerStarted","Data":"e4e90198fc4bc691f959adabecd3bf5e743b0efd62c05ebc6940c94e489eb743"} Jun 02 01:55:39.786181 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.786149 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n9lvt" event={"ID":"c854519f-338d-4365-89a5-9084dbe5f0bc","Type":"ContainerStarted","Data":"7c90065b90f8e89154da0e8103a2b2b0993f9050fe94a69a0c358e17cdc5ee53"} Jun 02 01:55:39.793811 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.793722 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" event={"ID":"f9bd88df-9781-47c5-90a6-04234bfb94b0","Type":"ContainerStarted","Data":"32b0fd7954957dc1e1ea8a4bb444f19a171bfc6d5a135a7268f2c83753defac1"} Jun 02 01:55:39.821590 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.821529 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9qpvq" event={"ID":"b76b50db-cb13-4227-b38e-0f8d2fcafbae","Type":"ContainerStarted","Data":"deb33d8bd5a237dc3f5ec58163a0d174ef3cc2c990c87efe4c4f6186023d1dd5"} Jun 02 01:55:39.844225 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.844138 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" event={"ID":"b28c21ff636f985fc35965ab6359f625","Type":"ContainerStarted","Data":"d6a11f240a5c84482276e5578d60364708aa92b50bf4db61c6dd569a2627a3d4"} Jun 02 01:55:39.861930 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:39.861844 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" event={"ID":"30e5e45055e5bef559a23f3bde5c0818","Type":"ContainerStarted","Data":"89aeabaec982e736ad8d02b2e60d75ee9768793a7c79fb031bf61c769414d7fc"} Jun 02 01:55:40.173034 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:40.172934 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:40.173199 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.173134 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:55:40.173199 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.173153 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:55:40.173199 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.173166 2560 projected.go:194] Error preparing data for projected volume kube-api-access-2vvv2 for pod openshift-network-diagnostics/network-check-target-2lplc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:40.173370 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.173227 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2 podName:b96071d2-51c5-47b4-87df-8e1673519e5b nodeName:}" failed. No retries permitted until 2026-06-02 01:55:42.173210057 +0000 UTC m=+4.995618730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vvv2" (UniqueName: "kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2") pod "network-check-target-2lplc" (UID: "b96071d2-51c5-47b4-87df-8e1673519e5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:40.273901 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:40.273867 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:40.274064 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.274017 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:40.274148 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.274086 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:42.274067954 +0000 UTC m=+5.096476633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:40.561594 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:40.561519 2560 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 01:55:40.607032 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:40.606891 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 01:50:38 +0000 UTC" deadline="2028-03-13 15:43:16.69853811 +0000 UTC" Jun 02 01:55:40.607032 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:40.606927 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15613h47m36.091614505s" Jun 02 01:55:40.637983 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:40.637326 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:40.637983 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.637479 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:40.637983 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:40.637847 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:40.637983 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:40.637940 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:42.189948 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:42.189911 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:42.190460 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.190129 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:55:42.190460 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.190149 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:55:42.190460 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.190162 2560 projected.go:194] Error preparing data for projected volume kube-api-access-2vvv2 for pod openshift-network-diagnostics/network-check-target-2lplc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:42.190460 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.190218 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2 podName:b96071d2-51c5-47b4-87df-8e1673519e5b nodeName:}" failed. No retries permitted until 2026-06-02 01:55:46.190199866 +0000 UTC m=+9.012608540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vvv2" (UniqueName: "kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2") pod "network-check-target-2lplc" (UID: "b96071d2-51c5-47b4-87df-8e1673519e5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:42.291587 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:42.291025 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:42.291587 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.291175 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:42.291587 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.291244 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:46.291223971 +0000 UTC m=+9.113632648 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:42.637038 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:42.636946 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:42.637038 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:42.636996 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:42.637251 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.637090 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:42.637632 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:42.637607 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:44.637635 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:44.637509 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:44.638222 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:44.637668 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:44.638222 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:44.637736 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:44.638222 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:44.637826 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:46.222256 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:46.222197 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:46.222681 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.222395 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:55:46.222681 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.222413 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:55:46.222681 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.222429 2560 projected.go:194] Error preparing data for projected volume kube-api-access-2vvv2 for pod openshift-network-diagnostics/network-check-target-2lplc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:46.222681 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.222504 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2 podName:b96071d2-51c5-47b4-87df-8e1673519e5b nodeName:}" failed. No retries permitted until 2026-06-02 01:55:54.222483983 +0000 UTC m=+17.044892660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vvv2" (UniqueName: "kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2") pod "network-check-target-2lplc" (UID: "b96071d2-51c5-47b4-87df-8e1673519e5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:46.323158 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:46.323119 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:46.323355 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.323312 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:46.323430 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.323392 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:55:54.323372427 +0000 UTC m=+17.145781117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:46.637339 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:46.637252 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:46.637719 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:46.637252 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:46.637719 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.637388 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:46.637719 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:46.637476 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:48.637578 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:48.637546 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:48.638070 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:48.637548 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:48.638070 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:48.637682 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:48.638070 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:48.637750 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:50.637696 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:50.637661 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:50.638130 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:50.637661 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:50.638130 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:50.637809 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:50.638130 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:50.637916 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:52.637404 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:52.637365 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:52.637982 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:52.637365 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:52.637982 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:52.637495 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:52.637982 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:52.637603 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:54.280425 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:54.280388 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:54.280883 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.280546 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:55:54.280883 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.280568 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:55:54.280883 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.280582 2560 projected.go:194] Error preparing data for projected volume kube-api-access-2vvv2 for pod openshift-network-diagnostics/network-check-target-2lplc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:54.280883 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.280639 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2 podName:b96071d2-51c5-47b4-87df-8e1673519e5b nodeName:}" failed. No retries permitted until 2026-06-02 01:56:10.280619127 +0000 UTC m=+33.103027799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vvv2" (UniqueName: "kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2") pod "network-check-target-2lplc" (UID: "b96071d2-51c5-47b4-87df-8e1673519e5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:55:54.380973 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:54.380938 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:54.381162 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.381044 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:54.381162 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.381112 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:10.381097021 +0000 UTC m=+33.203505698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:55:54.637628 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:54.637537 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:54.637628 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:54.637592 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:54.637868 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.637710 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:54.637868 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:54.637817 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:56.637844 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:56.637804 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:56.638283 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:56.637819 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:56.638283 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:56.637937 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:56.638283 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:56.638093 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:58.637667 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:58.637436 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:55:58.638108 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:58.637494 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:55:58.638108 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:58.637703 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:55:58.638108 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:58.637812 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:55:58.907417 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:58.907313 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" event={"ID":"f9bd88df-9781-47c5-90a6-04234bfb94b0","Type":"ContainerStarted","Data":"0e72c243012724cfae61e83987bd4e3e0d07bbd8fdbbd9441db7504bb5242ce3"} Jun 02 01:55:58.910170 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:58.910138 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" event={"ID":"30e5e45055e5bef559a23f3bde5c0818","Type":"ContainerStarted","Data":"f0ad6c903914950218115ab14c39d24c4fc5fa93f53612770dc23fbf1b3b18c2"} Jun 02 01:55:58.912895 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:58.912842 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-782bq" event={"ID":"06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385","Type":"ContainerStarted","Data":"2bd55d740f505f642ce106a67f5bdfb2b02d56515bcb3bc8168720f97b4f1210"} Jun 02 01:55:58.922848 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:58.922790 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h8vnn" podStartSLOduration=2.719967038 podStartE2EDuration="21.922757558s" podCreationTimestamp="2026-06-02 01:55:37 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.920406674 +0000 UTC m=+1.742815346" lastFinishedPulling="2026-06-02 01:55:58.123197192 +0000 UTC m=+20.945605866" observedRunningTime="2026-06-02 01:55:58.922569844 +0000 UTC m=+21.744978542" watchObservedRunningTime="2026-06-02 01:55:58.922757558 +0000 UTC m=+21.745166252" Jun 02 01:55:58.937829 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:58.937515 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-782bq" podStartSLOduration=1.230319557 podStartE2EDuration="20.93749471s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.688999955 +0000 UTC m=+1.511408626" lastFinishedPulling="2026-06-02 01:55:58.396175095 +0000 UTC m=+21.218583779" observedRunningTime="2026-06-02 01:55:58.937382726 +0000 UTC m=+21.759791431" watchObservedRunningTime="2026-06-02 01:55:58.93749471 +0000 UTC m=+21.759903405" Jun 02 01:55:59.798821 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.798471 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-54.ec2.internal" podStartSLOduration=21.798450373 podStartE2EDuration="21.798450373s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:55:58.952019987 +0000 UTC m=+21.774428680" watchObservedRunningTime="2026-06-02 01:55:59.798450373 +0000 UTC m=+22.620859070" Jun 02 01:55:59.799460 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.799419 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vrztt"] Jun 02 01:55:59.811139 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.811108 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:55:59.811286 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:55:59.811222 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrztt" podUID="3b5f8112-ad43-4167-bd59-3d749646ec74" Jun 02 01:55:59.915389 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.915351 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b5922" event={"ID":"4767abf9-3872-475e-bba4-c76c53504638","Type":"ContainerStarted","Data":"0c94bdc76e33a809e314bf926d3498fd692f6b031cf48cd619a0d3758b743b3c"} Jun 02 01:55:59.916580 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.916556 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-562xl" event={"ID":"9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9","Type":"ContainerStarted","Data":"8a0c3d26e6376a32c53ac0fd37906aca5089bf0a7588bfb439ee4083139a1af0"} Jun 02 01:55:59.917772 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.917740 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" event={"ID":"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631","Type":"ContainerStarted","Data":"bf8047c38dc0a24a7178328d7205c6987d6475cafd35647c38bd7dc7c2d4ad30"} Jun 02 01:55:59.920037 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.920013 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:55:59.920148 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.920070 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b5f8112-ad43-4167-bd59-3d749646ec74-dbus\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:55:59.920148 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.920120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b5f8112-ad43-4167-bd59-3d749646ec74-kubelet-config\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:55:59.920798 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.920597 2560 generic.go:358] "Generic (PLEG): container finished" podID="035beb85-018f-4b96-996b-61ec31f45b19" containerID="3fa0d109723f1be2a26c7e91e8e178de89c27368c1e4c414ab69095b0b309b20" exitCode=0 Jun 02 01:55:59.920798 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.920625 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerDied","Data":"3fa0d109723f1be2a26c7e91e8e178de89c27368c1e4c414ab69095b0b309b20"} Jun 02 01:55:59.922087 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.922068 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n9lvt" event={"ID":"c854519f-338d-4365-89a5-9084dbe5f0bc","Type":"ContainerStarted","Data":"45ea6fdb695ba8e067f83327069455bc69435b9ebcd9ee31a6b0465da178214d"} Jun 02 01:55:59.923310 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.923281 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9qpvq" event={"ID":"b76b50db-cb13-4227-b38e-0f8d2fcafbae","Type":"ContainerStarted","Data":"adbcabd590406a9e960697275481897daa39d296786d447e1670b04080cd7032"} Jun 02 01:55:59.924519 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.924499 2560 generic.go:358] "Generic (PLEG): container finished" podID="b28c21ff636f985fc35965ab6359f625" containerID="d41045eca8d444b7a8924d51e1090fd1f53c07f393c6ae8c4a9559b5aa74e1ec" exitCode=0 Jun 02 01:55:59.924616 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.924527 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" event={"ID":"b28c21ff636f985fc35965ab6359f625","Type":"ContainerDied","Data":"d41045eca8d444b7a8924d51e1090fd1f53c07f393c6ae8c4a9559b5aa74e1ec"} Jun 02 01:55:59.926717 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.926695 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 01:55:59.926983 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.926962 2560 generic.go:358] "Generic (PLEG): container finished" podID="30a65403-2c59-4183-a4de-c90b19da6df7" containerID="bc381b8fb81649c1fcbac8ed2c120ef3be21eec47a6624dff1ed2216319af037" exitCode=1 Jun 02 01:55:59.927076 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.927057 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"718ab46bf9e5bc734710f4b010b39b1d80205cae1a236c782368b8c1e034d61c"} Jun 02 01:55:59.927131 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.927083 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"f251208b1d68e367b9ede8b518936fe82ca6a2e2b89d7053581c3a5f22d92bed"} Jun 02 01:55:59.927131 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.927097 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"61d44e17a8f23a4030454b40498d2a9097b12a0393353ce11aff0c9bf1d492ba"} Jun 02 01:55:59.927131 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.927109 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"09580566905e39198c5ab737729bcb6eb20e26509aa1d5e2fd241a320714db2b"} Jun 02 01:55:59.927296 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.927131 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerDied","Data":"bc381b8fb81649c1fcbac8ed2c120ef3be21eec47a6624dff1ed2216319af037"} Jun 02 01:55:59.927296 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.927147 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"222f1fd822a6ed23cf4a83b1fa194b32b76717d2c7761cf4495a3a8ff9028296"} Jun 02 01:55:59.953832 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.953778 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b5922" podStartSLOduration=3.736825376 podStartE2EDuration="22.953748474s" podCreationTimestamp="2026-06-02 01:55:37 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.904355919 +0000 UTC m=+1.726764592" lastFinishedPulling="2026-06-02 01:55:58.121279014 +0000 UTC m=+20.943687690" observedRunningTime="2026-06-02 01:55:59.92970979 +0000 UTC m=+22.752118483" watchObservedRunningTime="2026-06-02 01:55:59.953748474 +0000 UTC m=+22.776157172" Jun 02 01:55:59.972748 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.972705 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-562xl" podStartSLOduration=3.720800553 podStartE2EDuration="22.972691683s" podCreationTimestamp="2026-06-02 01:55:37 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.869732251 +0000 UTC m=+1.692140922" lastFinishedPulling="2026-06-02 01:55:58.121623368 +0000 UTC m=+20.944032052" observedRunningTime="2026-06-02 01:55:59.972467707 +0000 UTC m=+22.794876404" watchObservedRunningTime="2026-06-02 01:55:59.972691683 +0000 UTC m=+22.795100376" Jun 02 01:55:59.991557 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:55:59.991503 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-9qpvq" podStartSLOduration=2.5537842509999997 podStartE2EDuration="21.991488768s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.68510455 +0000 UTC m=+1.507513222" lastFinishedPulling="2026-06-02 01:55:58.122809052 +0000 UTC m=+20.945217739" observedRunningTime="2026-06-02 01:55:59.991196387 +0000 UTC m=+22.813605082" watchObservedRunningTime="2026-06-02 01:55:59.991488768 +0000 UTC m=+22.813897462" Jun 02 01:56:00.017944 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.017887 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n9lvt" podStartSLOduration=3.828341318 podStartE2EDuration="23.01787163s" podCreationTimestamp="2026-06-02 01:55:37 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.931854238 +0000 UTC m=+1.754262909" lastFinishedPulling="2026-06-02 01:55:58.121384536 +0000 UTC m=+20.943793221" observedRunningTime="2026-06-02 01:56:00.017430571 +0000 UTC m=+22.839839264" watchObservedRunningTime="2026-06-02 01:56:00.01787163 +0000 UTC m=+22.840280357" Jun 02 01:56:00.021351 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.020738 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b5f8112-ad43-4167-bd59-3d749646ec74-dbus\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:00.021351 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.020885 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b5f8112-ad43-4167-bd59-3d749646ec74-kubelet-config\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:00.021351 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.021248 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:00.021603 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:00.021468 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:00.021603 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.021535 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3b5f8112-ad43-4167-bd59-3d749646ec74-kubelet-config\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:00.021603 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:00.021545 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret podName:3b5f8112-ad43-4167-bd59-3d749646ec74 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:00.521526284 +0000 UTC m=+23.343934967 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret") pod "global-pull-secret-syncer-vrztt" (UID: "3b5f8112-ad43-4167-bd59-3d749646ec74") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:00.021603 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.021590 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3b5f8112-ad43-4167-bd59-3d749646ec74-dbus\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:00.525981 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.525777 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:00.526111 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:00.525893 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:00.526149 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:00.526112 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret podName:3b5f8112-ad43-4167-bd59-3d749646ec74 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:01.526086587 +0000 UTC m=+24.348495276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret") pod "global-pull-secret-syncer-vrztt" (UID: "3b5f8112-ad43-4167-bd59-3d749646ec74") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:00.554985 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.554956 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 01:56:00.619773 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.619628 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T01:56:00.554978093Z","UUID":"a160d851-75e2-41c5-b640-a76b3e263d23","Handler":null,"Name":"","Endpoint":""} Jun 02 01:56:00.622752 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.622732 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 01:56:00.622928 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.622780 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 01:56:00.636952 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.636924 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:00.637091 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.636930 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:00.637091 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:00.637027 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:56:00.637213 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:00.637112 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:56:00.931552 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.931508 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" event={"ID":"b28c21ff636f985fc35965ab6359f625","Type":"ContainerStarted","Data":"5d6b0d78d4809dd715538edb3fcf021d9b1e1e924e8fc4e7ad9ef186b8855d2d"} Jun 02 01:56:00.933481 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.933432 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" event={"ID":"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631","Type":"ContainerStarted","Data":"72f0822f1649cf81dc5b8709d1a36aeb0feea31824be072b654cd5019af5e9db"} Jun 02 01:56:00.947378 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.947330 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-54.ec2.internal" podStartSLOduration=22.947314011 podStartE2EDuration="22.947314011s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:56:00.946842507 +0000 UTC m=+23.769251203" watchObservedRunningTime="2026-06-02 01:56:00.947314011 +0000 UTC m=+23.769722704" Jun 02 01:56:00.969036 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.969003 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-562xl" Jun 02 01:56:00.969644 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:00.969623 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-562xl" Jun 02 01:56:01.533720 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:01.533685 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:01.533920 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:01.533848 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:01.534009 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:01.533925 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret podName:3b5f8112-ad43-4167-bd59-3d749646ec74 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:03.533905824 +0000 UTC m=+26.356314511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret") pod "global-pull-secret-syncer-vrztt" (UID: "3b5f8112-ad43-4167-bd59-3d749646ec74") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:01.637446 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:01.637409 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:01.637633 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:01.637542 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrztt" podUID="3b5f8112-ad43-4167-bd59-3d749646ec74" Jun 02 01:56:01.937529 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:01.937492 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" event={"ID":"1aa7df49-dc6c-4d37-8b10-8cd1b4a55631","Type":"ContainerStarted","Data":"5c9ebfd01dd4de68b93e42a63ca759e36e2181bdfd3fd59498d50faebdf4cec1"} Jun 02 01:56:01.940728 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:01.940706 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 01:56:01.941101 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:01.941073 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"6e694e001275b707205d708eda8a9c00fbc5535dd23c69a50cf716396ae44ebd"} Jun 02 01:56:01.957405 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:01.957350 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nbjrj" podStartSLOduration=0.85953676 podStartE2EDuration="23.95733371s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.678097587 +0000 UTC m=+1.500506259" lastFinishedPulling="2026-06-02 01:56:01.775894537 +0000 UTC m=+24.598303209" observedRunningTime="2026-06-02 01:56:01.957119276 +0000 UTC m=+24.779527970" watchObservedRunningTime="2026-06-02 01:56:01.95733371 +0000 UTC m=+24.779742404" Jun 02 01:56:02.637603 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:02.637570 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:02.637797 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:02.637697 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:56:02.637797 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:02.637739 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:02.637912 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:02.637842 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:56:02.943281 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:02.943202 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 01:56:03.449335 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:03.449298 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-562xl" Jun 02 01:56:03.450068 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:03.450038 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-562xl" Jun 02 01:56:03.549284 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:03.549249 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:03.549447 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:03.549388 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:03.549503 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:03.549456 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret podName:3b5f8112-ad43-4167-bd59-3d749646ec74 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:07.549436061 +0000 UTC m=+30.371844751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret") pod "global-pull-secret-syncer-vrztt" (UID: "3b5f8112-ad43-4167-bd59-3d749646ec74") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:03.637433 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:03.637393 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:03.637619 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:03.637554 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrztt" podUID="3b5f8112-ad43-4167-bd59-3d749646ec74" Jun 02 01:56:04.637175 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.636925 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:04.637533 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.636955 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:04.637533 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:04.637267 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:56:04.637533 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:04.637316 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:56:04.948128 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.948048 2560 generic.go:358] "Generic (PLEG): container finished" podID="035beb85-018f-4b96-996b-61ec31f45b19" containerID="84852de1d2c3fa2cfb366a907daa86539195f41f352be43bf0d1716e05c1c063" exitCode=0 Jun 02 01:56:04.948262 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.948133 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerDied","Data":"84852de1d2c3fa2cfb366a907daa86539195f41f352be43bf0d1716e05c1c063"} Jun 02 01:56:04.951270 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.951250 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 01:56:04.951602 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.951570 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"c20158ffea972637b04274a29ce1a52b945e610c3305dbbc554e6ebafbf138ba"} Jun 02 01:56:04.951915 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.951852 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:56:04.951915 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.951879 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:56:04.951915 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.951893 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:56:04.952067 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.952033 2560 scope.go:117] "RemoveContainer" containerID="bc381b8fb81649c1fcbac8ed2c120ef3be21eec47a6624dff1ed2216319af037" Jun 02 01:56:04.968138 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.968116 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:56:04.968242 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:04.968231 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:56:05.638735 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:05.638698 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:05.639205 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:05.638852 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrztt" podUID="3b5f8112-ad43-4167-bd59-3d749646ec74" Jun 02 01:56:05.956566 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:05.956505 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 01:56:05.956906 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:05.956873 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" event={"ID":"30a65403-2c59-4183-a4de-c90b19da6df7","Type":"ContainerStarted","Data":"2f546fe967ed06fc2bb4fba6d5f85be73be45a3157af7a470203687bdff5a296"} Jun 02 01:56:06.368296 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.368241 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" podStartSLOduration=9.380587207 podStartE2EDuration="29.368221519s" podCreationTimestamp="2026-06-02 01:55:37 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.949693876 +0000 UTC m=+1.772102548" lastFinishedPulling="2026-06-02 01:55:58.937328175 +0000 UTC m=+21.759736860" observedRunningTime="2026-06-02 01:56:05.985737405 +0000 UTC m=+28.808146099" watchObservedRunningTime="2026-06-02 01:56:06.368221519 +0000 UTC m=+29.190630214" Jun 02 01:56:06.368816 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.368795 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrztt"] Jun 02 01:56:06.368940 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.368923 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:06.369049 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:06.369022 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrztt" podUID="3b5f8112-ad43-4167-bd59-3d749646ec74" Jun 02 01:56:06.371511 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.371489 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5crbq"] Jun 02 01:56:06.371644 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.371625 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:06.371754 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:06.371737 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:56:06.372094 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.372073 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2lplc"] Jun 02 01:56:06.372189 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.372176 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:06.372281 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:06.372264 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:56:06.960536 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.960504 2560 generic.go:358] "Generic (PLEG): container finished" podID="035beb85-018f-4b96-996b-61ec31f45b19" containerID="e1aac8374329cd2c2bf64504eb56cf89661a57bd0587cb699eb4f2afb6ba1c30" exitCode=0 Jun 02 01:56:06.961017 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:06.960590 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerDied","Data":"e1aac8374329cd2c2bf64504eb56cf89661a57bd0587cb699eb4f2afb6ba1c30"} Jun 02 01:56:07.582800 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:07.582756 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:07.582961 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:07.582867 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:07.582961 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:07.582914 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret podName:3b5f8112-ad43-4167-bd59-3d749646ec74 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:15.582901067 +0000 UTC m=+38.405309740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret") pod "global-pull-secret-syncer-vrztt" (UID: "3b5f8112-ad43-4167-bd59-3d749646ec74") : object "kube-system"/"original-pull-secret" not registered Jun 02 01:56:07.637860 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:07.637665 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:07.638039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:07.637727 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:07.638039 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:07.637921 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:56:07.638039 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:07.637990 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:56:07.638039 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:07.637743 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:07.638257 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:07.638045 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrztt" podUID="3b5f8112-ad43-4167-bd59-3d749646ec74" Jun 02 01:56:08.966107 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:08.966028 2560 generic.go:358] "Generic (PLEG): container finished" podID="035beb85-018f-4b96-996b-61ec31f45b19" containerID="12618ddc6ac1266b9d7d36789ef06a42bbe286c414b7ec848bd7b83d3ac648d6" exitCode=0 Jun 02 01:56:08.966107 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:08.966070 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerDied","Data":"12618ddc6ac1266b9d7d36789ef06a42bbe286c414b7ec848bd7b83d3ac648d6"} Jun 02 01:56:09.636999 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:09.636968 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:09.637180 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:09.636964 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:09.637180 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:09.637109 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:56:09.637296 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:09.637174 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrztt" podUID="3b5f8112-ad43-4167-bd59-3d749646ec74" Jun 02 01:56:09.637296 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:09.636964 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:09.637296 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:09.637275 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2lplc" podUID="b96071d2-51c5-47b4-87df-8e1673519e5b" Jun 02 01:56:10.302307 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:10.302270 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:10.302820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:10.302438 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 01:56:10.302820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:10.302455 2560 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 01:56:10.302820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:10.302464 2560 projected.go:194] Error preparing data for projected volume kube-api-access-2vvv2 for pod openshift-network-diagnostics/network-check-target-2lplc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:10.302820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:10.302519 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2 podName:b96071d2-51c5-47b4-87df-8e1673519e5b nodeName:}" failed. No retries permitted until 2026-06-02 01:56:42.302503198 +0000 UTC m=+65.124911870 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2vvv2" (UniqueName: "kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2") pod "network-check-target-2lplc" (UID: "b96071d2-51c5-47b4-87df-8e1673519e5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 01:56:10.403278 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:10.403245 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:10.403440 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:10.403398 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:10.403482 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:10.403458 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:42.40344096 +0000 UTC m=+65.225849660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 01:56:11.537348 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.537320 2560 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-54.ec2.internal" event="NodeReady" Jun 02 01:56:11.537705 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.537438 2560 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 01:56:11.571561 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.571526 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq"] Jun 02 01:56:11.575843 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.575791 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g"] Jun 02 01:56:11.579891 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.579866 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-858f84bc6d-hx7rl"] Jun 02 01:56:11.580020 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.579930 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.580020 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.579959 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.582649 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.582629 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 01:56:11.582786 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.582731 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 01:56:11.583114 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583088 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 01:56:11.583352 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583321 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 01:56:11.583429 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583378 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 01:56:11.583472 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583422 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 01:56:11.583522 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583506 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 01:56:11.583571 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583554 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 01:56:11.583851 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583822 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr"] Jun 02 01:56:11.583955 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.583908 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.586390 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.586192 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 01:56:11.586390 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.586236 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 01:56:11.586390 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.586273 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pc7hn\"" Jun 02 01:56:11.587467 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.587445 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 01:56:11.587745 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.587725 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c"] Jun 02 01:56:11.588022 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.588004 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:11.592496 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.591887 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq"] Jun 02 01:56:11.592496 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.591942 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g"] Jun 02 01:56:11.592496 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.592054 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:11.592496 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.592255 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 01:56:11.592805 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.592547 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 01:56:11.593223 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.593141 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr"] Jun 02 01:56:11.593898 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.593878 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rlfjn\"" Jun 02 01:56:11.594365 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.594346 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c"] Jun 02 01:56:11.594572 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.594551 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kt6w6"] Jun 02 01:56:11.595010 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.594985 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 01:56:11.595363 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.595346 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 01:56:11.598483 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.598465 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:11.598580 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.598552 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t8vpn"] Jun 02 01:56:11.601069 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.601050 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6j559\"" Jun 02 01:56:11.601167 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.601121 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 01:56:11.601300 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.601271 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 01:56:11.601411 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.601317 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 01:56:11.602349 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.602328 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.604600 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.604576 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74htp\"" Jun 02 01:56:11.604870 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.604851 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 01:56:11.604968 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.604890 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 01:56:11.608326 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.608306 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858f84bc6d-hx7rl"] Jun 02 01:56:11.609121 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.609097 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kt6w6"] Jun 02 01:56:11.611584 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.611565 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8vpn"] Jun 02 01:56:11.636962 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.636906 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:11.637084 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.637067 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:11.637475 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.637218 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:11.639501 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.639483 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:56:11.639601 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.639499 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tc66q\"" Jun 02 01:56:11.639796 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.639779 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:56:11.640276 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.640108 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 01:56:11.640276 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.640171 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:56:11.640399 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.640307 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bqdvw\"" Jun 02 01:56:11.711087 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4b0f93ff-4689-45e1-bb67-58fa9e12698e-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.711237 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/751b1df8-fa01-4fca-931a-e1ac3ea78051-ca-trust-extracted\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.711237 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:11.711237 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711201 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30839628-d87d-4bcd-925f-8b4eca9f437c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cbf4f979b-t692c\" (UID: \"30839628-d87d-4bcd-925f-8b4eca9f437c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:11.711237 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711227 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66bb65ba-cde3-46a8-a403-784a9efcfec4-tmp-dir\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711278 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711302 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b0f93ff-4689-45e1-bb67-58fa9e12698e-tmp\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711336 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-trusted-ca\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711359 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tjlp\" (UniqueName: \"kubernetes.io/projected/1c18895b-d62e-4d56-ba81-9a936df42be7-kube-api-access-2tjlp\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-bound-sa-token\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711423 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-hub\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.711456 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlfvl\" (UniqueName: \"kubernetes.io/projected/66bb65ba-cde3-46a8-a403-784a9efcfec4-kube-api-access-qlfvl\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711477 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711502 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711519 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlt4p\" (UniqueName: \"kubernetes.io/projected/30839628-d87d-4bcd-925f-8b4eca9f437c-kube-api-access-rlt4p\") pod \"managed-serviceaccount-addon-agent-5cbf4f979b-t692c\" (UID: \"30839628-d87d-4bcd-925f-8b4eca9f437c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711619 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/26a0da75-0179-4448-863d-1d032b1ab4cd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711648 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzrpv\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-kube-api-access-zzrpv\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66bb65ba-cde3-46a8-a403-784a9efcfec4-config-volume\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-522fw\" (UniqueName: \"kubernetes.io/projected/26a0da75-0179-4448-863d-1d032b1ab4cd-kube-api-access-522fw\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711741 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-installation-pull-secrets\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711844 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-ca\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.711873 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711869 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-certificates\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.712444 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711895 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vjcm\" (UniqueName: \"kubernetes.io/projected/4b0f93ff-4689-45e1-bb67-58fa9e12698e-kube-api-access-8vjcm\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.712444 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.711917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-image-registry-private-configuration\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.812438 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812356 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rlt4p\" (UniqueName: \"kubernetes.io/projected/30839628-d87d-4bcd-925f-8b4eca9f437c-kube-api-access-rlt4p\") pod \"managed-serviceaccount-addon-agent-5cbf4f979b-t692c\" (UID: \"30839628-d87d-4bcd-925f-8b4eca9f437c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:11.812438 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812403 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/26a0da75-0179-4448-863d-1d032b1ab4cd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.812438 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812420 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzrpv\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-kube-api-access-zzrpv\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.812702 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812448 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66bb65ba-cde3-46a8-a403-784a9efcfec4-config-volume\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.812702 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812477 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-522fw\" (UniqueName: \"kubernetes.io/projected/26a0da75-0179-4448-863d-1d032b1ab4cd-kube-api-access-522fw\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.812702 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812499 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-installation-pull-secrets\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.812702 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812527 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:11.812702 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812550 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-ca\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.812995 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.812969 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-certificates\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.813081 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813022 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8vjcm\" (UniqueName: \"kubernetes.io/projected/4b0f93ff-4689-45e1-bb67-58fa9e12698e-kube-api-access-8vjcm\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.813081 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813045 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-image-registry-private-configuration\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.813183 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813085 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/66bb65ba-cde3-46a8-a403-784a9efcfec4-config-volume\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.813183 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813090 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4b0f93ff-4689-45e1-bb67-58fa9e12698e-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.813284 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813181 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/751b1df8-fa01-4fca-931a-e1ac3ea78051-ca-trust-extracted\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.813284 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813221 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:11.813284 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813256 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30839628-d87d-4bcd-925f-8b4eca9f437c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cbf4f979b-t692c\" (UID: \"30839628-d87d-4bcd-925f-8b4eca9f437c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:11.813443 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813296 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66bb65ba-cde3-46a8-a403-784a9efcfec4-tmp-dir\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.813443 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813330 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.813443 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813357 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b0f93ff-4689-45e1-bb67-58fa9e12698e-tmp\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.813443 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813377 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-trusted-ca\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.813443 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813401 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tjlp\" (UniqueName: \"kubernetes.io/projected/1c18895b-d62e-4d56-ba81-9a936df42be7-kube-api-access-2tjlp\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:11.813443 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813425 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-bound-sa-token\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.813443 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813446 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813471 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-hub\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813492 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qlfvl\" (UniqueName: \"kubernetes.io/projected/66bb65ba-cde3-46a8-a403-784a9efcfec4-kube-api-access-qlfvl\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813522 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813546 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813546 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-certificates\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813570 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.813626 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.813680 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.813693 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:12.313672486 +0000 UTC m=+35.136081172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:56:11.813820 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.813735 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:12.313719656 +0000 UTC m=+35.136128331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:56:11.814308 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.814153 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:56:11.814308 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.814195 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:12.314178628 +0000 UTC m=+35.136587303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:56:11.814814 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.813547 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/751b1df8-fa01-4fca-931a-e1ac3ea78051-ca-trust-extracted\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.814814 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.814445 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-trusted-ca\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.814814 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.814537 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:56:11.814814 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.814548 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:56:11.814814 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:11.814592 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:12.314578987 +0000 UTC m=+35.136987666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:56:11.814814 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.814805 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:11.815166 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.815121 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/26a0da75-0179-4448-863d-1d032b1ab4cd-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.815337 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.815275 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66bb65ba-cde3-46a8-a403-784a9efcfec4-tmp-dir\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.815526 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.815502 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b0f93ff-4689-45e1-bb67-58fa9e12698e-tmp\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.817742 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.817718 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.817956 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.817934 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-ca\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.818046 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.817959 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-installation-pull-secrets\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.818046 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.817988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-hub\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.818046 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.817994 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-image-registry-private-configuration\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.818380 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.818359 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4b0f93ff-4689-45e1-bb67-58fa9e12698e-klusterlet-config\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.818551 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.818527 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/30839628-d87d-4bcd-925f-8b4eca9f437c-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5cbf4f979b-t692c\" (UID: \"30839628-d87d-4bcd-925f-8b4eca9f437c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:11.819266 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.819249 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/26a0da75-0179-4448-863d-1d032b1ab4cd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.823507 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.823480 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vjcm\" (UniqueName: \"kubernetes.io/projected/4b0f93ff-4689-45e1-bb67-58fa9e12698e-kube-api-access-8vjcm\") pod \"klusterlet-addon-workmgr-58f4f4944f-4t4sq\" (UID: \"4b0f93ff-4689-45e1-bb67-58fa9e12698e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.823632 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.823609 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlt4p\" (UniqueName: \"kubernetes.io/projected/30839628-d87d-4bcd-925f-8b4eca9f437c-kube-api-access-rlt4p\") pod \"managed-serviceaccount-addon-agent-5cbf4f979b-t692c\" (UID: \"30839628-d87d-4bcd-925f-8b4eca9f437c\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:11.824036 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.824002 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tjlp\" (UniqueName: \"kubernetes.io/projected/1c18895b-d62e-4d56-ba81-9a936df42be7-kube-api-access-2tjlp\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:11.824307 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.824287 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-bound-sa-token\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.824399 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.824377 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-522fw\" (UniqueName: \"kubernetes.io/projected/26a0da75-0179-4448-863d-1d032b1ab4cd-kube-api-access-522fw\") pod \"cluster-proxy-proxy-agent-866f5f559f-xfm7g\" (UID: \"26a0da75-0179-4448-863d-1d032b1ab4cd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.824438 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.824384 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzrpv\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-kube-api-access-zzrpv\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:11.824823 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.824806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlfvl\" (UniqueName: \"kubernetes.io/projected/66bb65ba-cde3-46a8-a403-784a9efcfec4-kube-api-access-qlfvl\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:11.896340 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.896305 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:11.920842 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.920623 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:56:11.947057 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:11.947029 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" Jun 02 01:56:12.067554 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.067429 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq"] Jun 02 01:56:12.071904 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:56:12.071872 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0f93ff_4689_45e1_bb67_58fa9e12698e.slice/crio-34988b25801b08f8f1ec2233d9eba56a78bbb1448e89df6721f310ad8bf3b4a5 WatchSource:0}: Error finding container 34988b25801b08f8f1ec2233d9eba56a78bbb1448e89df6721f310ad8bf3b4a5: Status 404 returned error can't find the container with id 34988b25801b08f8f1ec2233d9eba56a78bbb1448e89df6721f310ad8bf3b4a5 Jun 02 01:56:12.081516 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.081491 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g"] Jun 02 01:56:12.084734 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:56:12.084707 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26a0da75_0179_4448_863d_1d032b1ab4cd.slice/crio-1b3a0a03e2b6c5155cfd803122830d3b5a3bb3d209b29a3a83c99aefd3419d09 WatchSource:0}: Error finding container 1b3a0a03e2b6c5155cfd803122830d3b5a3bb3d209b29a3a83c99aefd3419d09: Status 404 returned error can't find the container with id 1b3a0a03e2b6c5155cfd803122830d3b5a3bb3d209b29a3a83c99aefd3419d09 Jun 02 01:56:12.110388 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.110357 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c"] Jun 02 01:56:12.113837 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:56:12.113806 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30839628_d87d_4bcd_925f_8b4eca9f437c.slice/crio-b88b8e620768df21776e50669fef6a098a11ea23a17dbab31508293433e19d81 WatchSource:0}: Error finding container b88b8e620768df21776e50669fef6a098a11ea23a17dbab31508293433e19d81: Status 404 returned error can't find the container with id b88b8e620768df21776e50669fef6a098a11ea23a17dbab31508293433e19d81 Jun 02 01:56:12.318064 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.317987 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:12.318064 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.318026 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.318091 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.318137 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318152 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318183 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318212 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318234 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318255 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:13.318235386 +0000 UTC m=+36.140644072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:56:12.318264 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318260 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:56:12.318654 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318274 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:13.31826432 +0000 UTC m=+36.140672997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:56:12.318654 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318290 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:13.318281677 +0000 UTC m=+36.140690352 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:56:12.318654 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:12.318304 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:13.31829635 +0000 UTC m=+36.140705028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:56:12.976644 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.976606 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" event={"ID":"4b0f93ff-4689-45e1-bb67-58fa9e12698e","Type":"ContainerStarted","Data":"34988b25801b08f8f1ec2233d9eba56a78bbb1448e89df6721f310ad8bf3b4a5"} Jun 02 01:56:12.977708 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.977679 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" event={"ID":"30839628-d87d-4bcd-925f-8b4eca9f437c","Type":"ContainerStarted","Data":"b88b8e620768df21776e50669fef6a098a11ea23a17dbab31508293433e19d81"} Jun 02 01:56:12.978739 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:12.978717 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" event={"ID":"26a0da75-0179-4448-863d-1d032b1ab4cd","Type":"ContainerStarted","Data":"1b3a0a03e2b6c5155cfd803122830d3b5a3bb3d209b29a3a83c99aefd3419d09"} Jun 02 01:56:13.325983 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:13.325946 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:13.326179 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:13.326018 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:13.326179 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:13.326052 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:13.326179 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:13.326077 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:13.326179 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326112 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326184 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326195 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:15.326172706 +0000 UTC m=+38.148581401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326205 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326218 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326218 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326237 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:15.32622044 +0000 UTC m=+38.148629126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326253 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:15.326242731 +0000 UTC m=+38.148651417 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:56:13.326372 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:13.326268 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:15.326260269 +0000 UTC m=+38.148668944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:56:15.343803 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.343748 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.343881 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.343933 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.343945 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.343969 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344003 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344051 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:19.343997305 +0000 UTC m=+42.166405993 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344079 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344094 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344080 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:19.344069254 +0000 UTC m=+42.166477932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344082 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344153 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:19.344138592 +0000 UTC m=+42.166547269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:56:15.344279 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:15.344204 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:19.34419015 +0000 UTC m=+42.166598833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:56:15.647421 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.647156 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:15.663171 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.663093 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3b5f8112-ad43-4167-bd59-3d749646ec74-original-pull-secret\") pod \"global-pull-secret-syncer-vrztt\" (UID: \"3b5f8112-ad43-4167-bd59-3d749646ec74\") " pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:15.885321 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.885060 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrztt" Jun 02 01:56:15.994556 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.993535 2560 generic.go:358] "Generic (PLEG): container finished" podID="035beb85-018f-4b96-996b-61ec31f45b19" containerID="5cae3839324459dccd902f8384ff2d207252e4adaed23da8f0a29f9f85c8a5b8" exitCode=0 Jun 02 01:56:15.994556 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:15.993579 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerDied","Data":"5cae3839324459dccd902f8384ff2d207252e4adaed23da8f0a29f9f85c8a5b8"} Jun 02 01:56:16.080833 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:16.080777 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrztt"] Jun 02 01:56:16.084453 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:56:16.084421 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b5f8112_ad43_4167_bd59_3d749646ec74.slice/crio-22730600a5466bc10559bb21a2c9732efddb12759d89f2e04b63586115d267e8 WatchSource:0}: Error finding container 22730600a5466bc10559bb21a2c9732efddb12759d89f2e04b63586115d267e8: Status 404 returned error can't find the container with id 22730600a5466bc10559bb21a2c9732efddb12759d89f2e04b63586115d267e8 Jun 02 01:56:16.997229 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:16.997185 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrztt" event={"ID":"3b5f8112-ad43-4167-bd59-3d749646ec74","Type":"ContainerStarted","Data":"22730600a5466bc10559bb21a2c9732efddb12759d89f2e04b63586115d267e8"} Jun 02 01:56:17.001090 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:17.001002 2560 generic.go:358] "Generic (PLEG): container finished" podID="035beb85-018f-4b96-996b-61ec31f45b19" containerID="e9612e197e4fb0237a0aa5cc81bdb3bb98a1b9a76921d7df266c587720b8662e" exitCode=0 Jun 02 01:56:17.001090 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:17.001057 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerDied","Data":"e9612e197e4fb0237a0aa5cc81bdb3bb98a1b9a76921d7df266c587720b8662e"} Jun 02 01:56:19.384684 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:19.384639 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:19.384707 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:19.384734 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.384820 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.384837 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.384852 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:19.384834 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.384897 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:27.384875515 +0000 UTC m=+50.207284204 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.384913 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.384934 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.384984 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:27.38494482 +0000 UTC m=+50.207353495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.385023 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:27.385010192 +0000 UTC m=+50.207418865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:56:19.385288 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:19.385053 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:27.38504277 +0000 UTC m=+50.207451443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:56:23.016440 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:23.016364 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" event={"ID":"035beb85-018f-4b96-996b-61ec31f45b19","Type":"ContainerStarted","Data":"5f60169635862731c82001c922d8340da2f1f12b0ecccdb77fc153c56323974a"} Jun 02 01:56:23.017782 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:23.017714 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" event={"ID":"30839628-d87d-4bcd-925f-8b4eca9f437c","Type":"ContainerStarted","Data":"0c5a3a71641cbdfd210529dc3ab844ca44fbfd33d22c9539bf27813b56595efd"} Jun 02 01:56:23.019151 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:23.019104 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" event={"ID":"26a0da75-0179-4448-863d-1d032b1ab4cd","Type":"ContainerStarted","Data":"429f82f39bcd2e4b67f06036b6f9e2174b6f712e94dfb7c09f4d602373c520dc"} Jun 02 01:56:23.040127 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:23.040069 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mpbn8" podStartSLOduration=8.662029718 podStartE2EDuration="45.040051489s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="2026-06-02 01:55:38.994360232 +0000 UTC m=+1.816768903" lastFinishedPulling="2026-06-02 01:56:15.372381995 +0000 UTC m=+38.194790674" observedRunningTime="2026-06-02 01:56:23.039542259 +0000 UTC m=+45.861950976" watchObservedRunningTime="2026-06-02 01:56:23.040051489 +0000 UTC m=+45.862460184" Jun 02 01:56:23.055101 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:23.055049 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" podStartSLOduration=33.670475042 podStartE2EDuration="44.055038984s" podCreationTimestamp="2026-06-02 01:55:39 +0000 UTC" firstStartedPulling="2026-06-02 01:56:12.115791064 +0000 UTC m=+34.938199745" lastFinishedPulling="2026-06-02 01:56:22.500355001 +0000 UTC m=+45.322763687" observedRunningTime="2026-06-02 01:56:23.054207019 +0000 UTC m=+45.876615717" watchObservedRunningTime="2026-06-02 01:56:23.055038984 +0000 UTC m=+45.877447677" Jun 02 01:56:25.025165 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:25.025129 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" event={"ID":"4b0f93ff-4689-45e1-bb67-58fa9e12698e","Type":"ContainerStarted","Data":"c248ef926ad45bfa8232571f16c6b4d7808ae628b845071dd099934b801eee81"} Jun 02 01:56:25.025637 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:25.025303 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:25.026644 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:25.026614 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrztt" event={"ID":"3b5f8112-ad43-4167-bd59-3d749646ec74","Type":"ContainerStarted","Data":"6f97c22d4779ca1eef4e408e265b9625f0ee6c1a824b186c0cf0d6d9b5ec9c22"} Jun 02 01:56:25.027235 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:25.027214 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:56:25.042994 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:25.042489 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" podStartSLOduration=32.787757548 podStartE2EDuration="45.042473829s" podCreationTimestamp="2026-06-02 01:55:40 +0000 UTC" firstStartedPulling="2026-06-02 01:56:12.074005338 +0000 UTC m=+34.896414026" lastFinishedPulling="2026-06-02 01:56:24.328721608 +0000 UTC m=+47.151130307" observedRunningTime="2026-06-02 01:56:25.042073586 +0000 UTC m=+47.864482279" watchObservedRunningTime="2026-06-02 01:56:25.042473829 +0000 UTC m=+47.864882524" Jun 02 01:56:25.057573 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:25.057530 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vrztt" podStartSLOduration=19.428739538 podStartE2EDuration="26.057516784s" podCreationTimestamp="2026-06-02 01:55:59 +0000 UTC" firstStartedPulling="2026-06-02 01:56:16.087784744 +0000 UTC m=+38.910193430" lastFinishedPulling="2026-06-02 01:56:22.716562 +0000 UTC m=+45.538970676" observedRunningTime="2026-06-02 01:56:25.056623983 +0000 UTC m=+47.879032680" watchObservedRunningTime="2026-06-02 01:56:25.057516784 +0000 UTC m=+47.879925558" Jun 02 01:56:27.032911 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:27.032877 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" event={"ID":"26a0da75-0179-4448-863d-1d032b1ab4cd","Type":"ContainerStarted","Data":"b2bd6d399b868829c11b0f6a7c1c2d6e33e121d93552607c2717011f81c662d8"} Jun 02 01:56:27.032911 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:27.032915 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" event={"ID":"26a0da75-0179-4448-863d-1d032b1ab4cd","Type":"ContainerStarted","Data":"93f89bf7327a055506a2334fdd8dc9f726ee4418f24fcede2580077f8efcd0a2"} Jun 02 01:56:27.052269 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:27.052215 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" podStartSLOduration=32.669744495 podStartE2EDuration="47.052201455s" podCreationTimestamp="2026-06-02 01:55:40 +0000 UTC" firstStartedPulling="2026-06-02 01:56:12.086896475 +0000 UTC m=+34.909305158" lastFinishedPulling="2026-06-02 01:56:26.469353444 +0000 UTC m=+49.291762118" observedRunningTime="2026-06-02 01:56:27.050600415 +0000 UTC m=+49.873009108" watchObservedRunningTime="2026-06-02 01:56:27.052201455 +0000 UTC m=+49.874610148" Jun 02 01:56:27.462929 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:27.462883 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:27.463104 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:27.462942 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:27.463104 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:27.462966 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:27.463104 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:27.462987 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:27.463104 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463038 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:56:27.463104 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463072 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:56:27.463104 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463073 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:56:27.463104 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463098 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:56:27.463321 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463111 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:43.463097961 +0000 UTC m=+66.285506632 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:56:27.463321 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463115 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:56:27.463321 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463132 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:43.463117715 +0000 UTC m=+66.285526386 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:56:27.463321 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463143 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:43.463138093 +0000 UTC m=+66.285546765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:56:27.463321 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:27.463167 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:56:43.463147828 +0000 UTC m=+66.285556499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:56:36.974037 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:36.974008 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7js2s" Jun 02 01:56:42.378922 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.378881 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:42.381885 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.381865 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 01:56:42.392085 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.392064 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 01:56:42.402677 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.402647 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vvv2\" (UniqueName: \"kubernetes.io/projected/b96071d2-51c5-47b4-87df-8e1673519e5b-kube-api-access-2vvv2\") pod \"network-check-target-2lplc\" (UID: \"b96071d2-51c5-47b4-87df-8e1673519e5b\") " pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:42.480051 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.480014 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:56:42.482843 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.482828 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 01:56:42.491013 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:42.490996 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:56:42.491076 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:42.491065 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:46.491048118 +0000 UTC m=+129.313456789 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : secret "metrics-daemon-secret" not found Jun 02 01:56:42.579543 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.579512 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tc66q\"" Jun 02 01:56:42.587474 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.587451 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:42.707342 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:42.707312 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2lplc"] Jun 02 01:56:42.709912 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:56:42.709886 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96071d2_51c5_47b4_87df_8e1673519e5b.slice/crio-89a92b3ba273d312523c85e6731df5271073a41bddcf9e51ce6c7c95bdfc35f9 WatchSource:0}: Error finding container 89a92b3ba273d312523c85e6731df5271073a41bddcf9e51ce6c7c95bdfc35f9: Status 404 returned error can't find the container with id 89a92b3ba273d312523c85e6731df5271073a41bddcf9e51ce6c7c95bdfc35f9 Jun 02 01:56:43.072410 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:43.072372 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2lplc" event={"ID":"b96071d2-51c5-47b4-87df-8e1673519e5b","Type":"ContainerStarted","Data":"89a92b3ba273d312523c85e6731df5271073a41bddcf9e51ce6c7c95bdfc35f9"} Jun 02 01:56:43.487342 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:43.487244 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:56:43.487342 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:43.487309 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:43.487347 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:43.487371 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487445 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487470 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487503 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487530 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:15.487508063 +0000 UTC m=+98.309916753 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487552 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:15.487538746 +0000 UTC m=+98.309947423 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487567 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487570 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:15.487560312 +0000 UTC m=+98.309968987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487577 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:56:43.487826 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:56:43.487611 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:57:15.48759866 +0000 UTC m=+98.310007339 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:56:46.080905 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:46.080869 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2lplc" event={"ID":"b96071d2-51c5-47b4-87df-8e1673519e5b","Type":"ContainerStarted","Data":"7154b60dfd75796bdbcb41d4279cda4bbf4b78fbe7f033d2d5536bffad7458e7"} Jun 02 01:56:46.081334 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:46.080990 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:56:46.097779 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:56:46.097722 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2lplc" podStartSLOduration=66.073488028 podStartE2EDuration="1m9.097711123s" podCreationTimestamp="2026-06-02 01:55:37 +0000 UTC" firstStartedPulling="2026-06-02 01:56:42.71174901 +0000 UTC m=+65.534157682" lastFinishedPulling="2026-06-02 01:56:45.735972101 +0000 UTC m=+68.558380777" observedRunningTime="2026-06-02 01:56:46.097489248 +0000 UTC m=+68.919897923" watchObservedRunningTime="2026-06-02 01:56:46.097711123 +0000 UTC m=+68.920119816" Jun 02 01:57:15.545777 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:15.545735 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:15.545814 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:15.545841 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.545852 2560 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:15.545862 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.545916 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert podName:a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:19.54590055 +0000 UTC m=+162.368309222 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-5ztjr" (UID: "a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1") : secret "networking-console-plugin-cert" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.545966 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.545972 2560 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.545966 2560 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.546009 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls podName:66bb65ba-cde3-46a8-a403-784a9efcfec4 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:19.545997845 +0000 UTC m=+162.368406526 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls") pod "dns-default-t8vpn" (UID: "66bb65ba-cde3-46a8-a403-784a9efcfec4") : secret "dns-default-metrics-tls" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.545995 2560 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-858f84bc6d-hx7rl: secret "image-registry-tls" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.546064 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert podName:1c18895b-d62e-4d56-ba81-9a936df42be7 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:19.546045677 +0000 UTC m=+162.368454356 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert") pod "ingress-canary-kt6w6" (UID: "1c18895b-d62e-4d56-ba81-9a936df42be7") : secret "canary-serving-cert" not found Jun 02 01:57:15.546200 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:15.546125 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls podName:751b1df8-fa01-4fca-931a-e1ac3ea78051 nodeName:}" failed. No retries permitted until 2026-06-02 01:58:19.546109226 +0000 UTC m=+162.368517902 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls") pod "image-registry-858f84bc6d-hx7rl" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051") : secret "image-registry-tls" not found Jun 02 01:57:17.085752 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:17.085719 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2lplc" Jun 02 01:57:46.582639 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:46.582584 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:57:46.583157 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:46.582732 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 01:57:46.583157 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:57:46.582839 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs podName:310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44 nodeName:}" failed. No retries permitted until 2026-06-02 01:59:48.582823526 +0000 UTC m=+251.405232197 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs") pod "network-metrics-daemon-5crbq" (UID: "310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44") : secret "metrics-daemon-secret" not found Jun 02 01:57:56.616904 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:56.616873 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9qpvq_b76b50db-cb13-4227-b38e-0f8d2fcafbae/dns-node-resolver/0.log" Jun 02 01:57:57.622302 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:57:57.622275 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5922_4767abf9-3872-475e-bba4-c76c53504638/node-ca/0.log" Jun 02 01:58:14.628484 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:58:14.628431 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" podUID="751b1df8-fa01-4fca-931a-e1ac3ea78051" Jun 02 01:58:14.639712 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:58:14.639689 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" podUID="a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1" Jun 02 01:58:14.663869 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:58:14.663837 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-kt6w6" podUID="1c18895b-d62e-4d56-ba81-9a936df42be7" Jun 02 01:58:14.670961 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:58:14.670939 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-t8vpn" podUID="66bb65ba-cde3-46a8-a403-784a9efcfec4" Jun 02 01:58:14.691626 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:58:14.691590 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5crbq" podUID="310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44" Jun 02 01:58:15.292029 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:15.291995 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:58:15.292215 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:15.291997 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:58:15.292215 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:15.291996 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:58:15.292301 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:15.292016 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8vpn" Jun 02 01:58:19.546247 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.546195 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:58:19.546247 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.546247 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:58:19.546911 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.546323 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:58:19.546911 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.546367 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:58:19.548666 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.548638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"image-registry-858f84bc6d-hx7rl\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:58:19.548804 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.548639 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/66bb65ba-cde3-46a8-a403-784a9efcfec4-metrics-tls\") pod \"dns-default-t8vpn\" (UID: \"66bb65ba-cde3-46a8-a403-784a9efcfec4\") " pod="openshift-dns/dns-default-t8vpn" Jun 02 01:58:19.549025 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.549006 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c18895b-d62e-4d56-ba81-9a936df42be7-cert\") pod \"ingress-canary-kt6w6\" (UID: \"1c18895b-d62e-4d56-ba81-9a936df42be7\") " pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:58:19.549062 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.549037 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-5ztjr\" (UID: \"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:58:19.796447 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.796362 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rlfjn\"" Jun 02 01:58:19.796447 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.796364 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-74htp\"" Jun 02 01:58:19.796447 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.796364 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pc7hn\"" Jun 02 01:58:19.796447 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.796372 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6j559\"" Jun 02 01:58:19.803620 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.803594 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" Jun 02 01:58:19.803620 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.803612 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:58:19.803813 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.803687 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kt6w6" Jun 02 01:58:19.803813 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.803803 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t8vpn" Jun 02 01:58:19.964027 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:19.964004 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr"] Jun 02 01:58:19.966139 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:58:19.966113 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e7dcbc_9c49_464d_8f1f_f3ffa75403e1.slice/crio-029758ce699c53524ded2c7f0e509c025c0a397becc9cc5454d1a92c5d4cae3a WatchSource:0}: Error finding container 029758ce699c53524ded2c7f0e509c025c0a397becc9cc5454d1a92c5d4cae3a: Status 404 returned error can't find the container with id 029758ce699c53524ded2c7f0e509c025c0a397becc9cc5454d1a92c5d4cae3a Jun 02 01:58:20.189022 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.188951 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kt6w6"] Jun 02 01:58:20.191924 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:58:20.191891 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c18895b_d62e_4d56_ba81_9a936df42be7.slice/crio-731b24f25930f4019f446332068d11be10957083ca06c36aaac55ec64e947674 WatchSource:0}: Error finding container 731b24f25930f4019f446332068d11be10957083ca06c36aaac55ec64e947674: Status 404 returned error can't find the container with id 731b24f25930f4019f446332068d11be10957083ca06c36aaac55ec64e947674 Jun 02 01:58:20.192633 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.192604 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t8vpn"] Jun 02 01:58:20.193483 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.193464 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-858f84bc6d-hx7rl"] Jun 02 01:58:20.196395 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:58:20.196375 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751b1df8_fa01_4fca_931a_e1ac3ea78051.slice/crio-ef501a695bca3889fd3a14e1959c09c072b06723bfff09595c4a3622b6915b30 WatchSource:0}: Error finding container ef501a695bca3889fd3a14e1959c09c072b06723bfff09595c4a3622b6915b30: Status 404 returned error can't find the container with id ef501a695bca3889fd3a14e1959c09c072b06723bfff09595c4a3622b6915b30 Jun 02 01:58:20.197356 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:58:20.197331 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66bb65ba_cde3_46a8_a403_784a9efcfec4.slice/crio-5986c686def7ed5c65228b3f6ce9d38cd874210f8a5c196dcc37ecab964324a4 WatchSource:0}: Error finding container 5986c686def7ed5c65228b3f6ce9d38cd874210f8a5c196dcc37ecab964324a4: Status 404 returned error can't find the container with id 5986c686def7ed5c65228b3f6ce9d38cd874210f8a5c196dcc37ecab964324a4 Jun 02 01:58:20.304968 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.304938 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8vpn" event={"ID":"66bb65ba-cde3-46a8-a403-784a9efcfec4","Type":"ContainerStarted","Data":"5986c686def7ed5c65228b3f6ce9d38cd874210f8a5c196dcc37ecab964324a4"} Jun 02 01:58:20.305860 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.305832 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kt6w6" event={"ID":"1c18895b-d62e-4d56-ba81-9a936df42be7","Type":"ContainerStarted","Data":"731b24f25930f4019f446332068d11be10957083ca06c36aaac55ec64e947674"} Jun 02 01:58:20.306678 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.306660 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" event={"ID":"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1","Type":"ContainerStarted","Data":"029758ce699c53524ded2c7f0e509c025c0a397becc9cc5454d1a92c5d4cae3a"} Jun 02 01:58:20.307804 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.307786 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" event={"ID":"751b1df8-fa01-4fca-931a-e1ac3ea78051","Type":"ContainerStarted","Data":"116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1"} Jun 02 01:58:20.307881 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.307808 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" event={"ID":"751b1df8-fa01-4fca-931a-e1ac3ea78051","Type":"ContainerStarted","Data":"ef501a695bca3889fd3a14e1959c09c072b06723bfff09595c4a3622b6915b30"} Jun 02 01:58:20.307949 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.307931 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:58:20.329417 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.329370 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" podStartSLOduration=162.329358255 podStartE2EDuration="2m42.329358255s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 01:58:20.328576443 +0000 UTC m=+163.150985137" watchObservedRunningTime="2026-06-02 01:58:20.329358255 +0000 UTC m=+163.151766948" Jun 02 01:58:20.880846 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.880206 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wlzst"] Jun 02 01:58:20.885576 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.885547 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:20.892616 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.892101 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 01:58:20.892616 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.892603 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2576q\"" Jun 02 01:58:20.893094 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.892925 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 01:58:20.893094 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.892950 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 01:58:20.893266 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.893174 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 01:58:20.909749 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.909702 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wlzst"] Jun 02 01:58:20.956161 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.956115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5409855-a56a-4812-8bfb-686a8ac56175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:20.956336 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.956219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5409855-a56a-4812-8bfb-686a8ac56175-crio-socket\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:20.956336 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.956263 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5409855-a56a-4812-8bfb-686a8ac56175-data-volume\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:20.956336 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.956293 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssz7\" (UniqueName: \"kubernetes.io/projected/a5409855-a56a-4812-8bfb-686a8ac56175-kube-api-access-mssz7\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:20.956336 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:20.956325 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5409855-a56a-4812-8bfb-686a8ac56175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.057427 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.057388 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5409855-a56a-4812-8bfb-686a8ac56175-crio-socket\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.057597 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.057455 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5409855-a56a-4812-8bfb-686a8ac56175-data-volume\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.057597 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.057490 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mssz7\" (UniqueName: \"kubernetes.io/projected/a5409855-a56a-4812-8bfb-686a8ac56175-kube-api-access-mssz7\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.057597 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.057521 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5409855-a56a-4812-8bfb-686a8ac56175-crio-socket\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.057796 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.057525 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5409855-a56a-4812-8bfb-686a8ac56175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.057894 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.057872 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5409855-a56a-4812-8bfb-686a8ac56175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.057945 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.057895 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5409855-a56a-4812-8bfb-686a8ac56175-data-volume\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.059000 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.058977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5409855-a56a-4812-8bfb-686a8ac56175-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.061353 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.061327 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5409855-a56a-4812-8bfb-686a8ac56175-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.068584 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.068562 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssz7\" (UniqueName: \"kubernetes.io/projected/a5409855-a56a-4812-8bfb-686a8ac56175-kube-api-access-mssz7\") pod \"insights-runtime-extractor-wlzst\" (UID: \"a5409855-a56a-4812-8bfb-686a8ac56175\") " pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.200357 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.200323 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wlzst" Jun 02 01:58:21.312721 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.312671 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" event={"ID":"a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1","Type":"ContainerStarted","Data":"543fee9fa4309e2702044953c63706bcc1f7bca93efa621366876bbe6f35460e"} Jun 02 01:58:21.335290 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:21.334627 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-5ztjr" podStartSLOduration=159.188331336 podStartE2EDuration="2m40.334609118s" podCreationTimestamp="2026-06-02 01:55:41 +0000 UTC" firstStartedPulling="2026-06-02 01:58:19.967853259 +0000 UTC m=+162.790261931" lastFinishedPulling="2026-06-02 01:58:21.114131038 +0000 UTC m=+163.936539713" observedRunningTime="2026-06-02 01:58:21.334486831 +0000 UTC m=+164.156895526" watchObservedRunningTime="2026-06-02 01:58:21.334609118 +0000 UTC m=+164.157017813" Jun 02 01:58:22.208148 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.208105 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wlzst"] Jun 02 01:58:22.219775 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:58:22.219721 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5409855_a56a_4812_8bfb_686a8ac56175.slice/crio-205d24a583631152d132a2b2ee5835300049efaacdf25b0dee8a46be611a7958 WatchSource:0}: Error finding container 205d24a583631152d132a2b2ee5835300049efaacdf25b0dee8a46be611a7958: Status 404 returned error can't find the container with id 205d24a583631152d132a2b2ee5835300049efaacdf25b0dee8a46be611a7958 Jun 02 01:58:22.316977 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.316899 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8vpn" event={"ID":"66bb65ba-cde3-46a8-a403-784a9efcfec4","Type":"ContainerStarted","Data":"25cd08e22c063b18a2fcb3af2678efae973f5e3ed85bab39e765e98cda0ecc13"} Jun 02 01:58:22.316977 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.316937 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t8vpn" event={"ID":"66bb65ba-cde3-46a8-a403-784a9efcfec4","Type":"ContainerStarted","Data":"bf81ac6de876c9af544af0c27bc6f83ed2b5c768a4a589ab11c8c396d26afa66"} Jun 02 01:58:22.317185 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.317026 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t8vpn" Jun 02 01:58:22.318161 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.318135 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kt6w6" event={"ID":"1c18895b-d62e-4d56-ba81-9a936df42be7","Type":"ContainerStarted","Data":"a53dc024709052afde1a053269d1848334e6515f3da39c73d3ea06ab0b4107e6"} Jun 02 01:58:22.319342 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.319322 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlzst" event={"ID":"a5409855-a56a-4812-8bfb-686a8ac56175","Type":"ContainerStarted","Data":"3d9606e0a731d1673853e87fbcfcf733ac5d85b6ea45b36d8458f5ad3198687d"} Jun 02 01:58:22.319342 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.319345 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlzst" event={"ID":"a5409855-a56a-4812-8bfb-686a8ac56175","Type":"ContainerStarted","Data":"205d24a583631152d132a2b2ee5835300049efaacdf25b0dee8a46be611a7958"} Jun 02 01:58:22.358358 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.358305 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-t8vpn" podStartSLOduration=129.509122089 podStartE2EDuration="2m11.358287932s" podCreationTimestamp="2026-06-02 01:56:11 +0000 UTC" firstStartedPulling="2026-06-02 01:58:20.199169273 +0000 UTC m=+163.021577945" lastFinishedPulling="2026-06-02 01:58:22.048335116 +0000 UTC m=+164.870743788" observedRunningTime="2026-06-02 01:58:22.356808151 +0000 UTC m=+165.179216845" watchObservedRunningTime="2026-06-02 01:58:22.358287932 +0000 UTC m=+165.180696625" Jun 02 01:58:22.384074 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:22.384017 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kt6w6" podStartSLOduration=129.524960152 podStartE2EDuration="2m11.384002742s" podCreationTimestamp="2026-06-02 01:56:11 +0000 UTC" firstStartedPulling="2026-06-02 01:58:20.194187615 +0000 UTC m=+163.016596286" lastFinishedPulling="2026-06-02 01:58:22.053230201 +0000 UTC m=+164.875638876" observedRunningTime="2026-06-02 01:58:22.38379089 +0000 UTC m=+165.206199585" watchObservedRunningTime="2026-06-02 01:58:22.384002742 +0000 UTC m=+165.206411436" Jun 02 01:58:23.323947 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:23.323904 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlzst" event={"ID":"a5409855-a56a-4812-8bfb-686a8ac56175","Type":"ContainerStarted","Data":"67c826c3e4da6cb397fad86b4f80197e9456423d299d00994610fb4198abfd6d"} Jun 02 01:58:23.325251 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:23.325225 2560 generic.go:358] "Generic (PLEG): container finished" podID="30839628-d87d-4bcd-925f-8b4eca9f437c" containerID="0c5a3a71641cbdfd210529dc3ab844ca44fbfd33d22c9539bf27813b56595efd" exitCode=255 Jun 02 01:58:23.325384 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:23.325304 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" event={"ID":"30839628-d87d-4bcd-925f-8b4eca9f437c","Type":"ContainerDied","Data":"0c5a3a71641cbdfd210529dc3ab844ca44fbfd33d22c9539bf27813b56595efd"} Jun 02 01:58:23.325909 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:23.325888 2560 scope.go:117] "RemoveContainer" containerID="0c5a3a71641cbdfd210529dc3ab844ca44fbfd33d22c9539bf27813b56595efd" Jun 02 01:58:24.329134 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:24.329097 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wlzst" event={"ID":"a5409855-a56a-4812-8bfb-686a8ac56175","Type":"ContainerStarted","Data":"13326a96efed6a0f864d045d5d8f44a47b149ef85e3c657b22b969d662d5d62e"} Jun 02 01:58:24.330672 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:24.330649 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5cbf4f979b-t692c" event={"ID":"30839628-d87d-4bcd-925f-8b4eca9f437c","Type":"ContainerStarted","Data":"949b61d0b18ebf8cd4c682c768f5e815b7e70c5a4eda4170b1487d86f3b674c6"} Jun 02 01:58:24.346965 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:24.346922 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wlzst" podStartSLOduration=2.422045486 podStartE2EDuration="4.346909406s" podCreationTimestamp="2026-06-02 01:58:20 +0000 UTC" firstStartedPulling="2026-06-02 01:58:22.276709516 +0000 UTC m=+165.099118198" lastFinishedPulling="2026-06-02 01:58:24.201573446 +0000 UTC m=+167.023982118" observedRunningTime="2026-06-02 01:58:24.346433384 +0000 UTC m=+167.168842081" watchObservedRunningTime="2026-06-02 01:58:24.346909406 +0000 UTC m=+167.169318100" Jun 02 01:58:25.025942 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:25.025894 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" podUID="4b0f93ff-4689-45e1-bb67-58fa9e12698e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.6:8000/readyz\": dial tcp 10.132.0.6:8000: connect: connection refused" Jun 02 01:58:25.336054 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:25.335967 2560 generic.go:358] "Generic (PLEG): container finished" podID="4b0f93ff-4689-45e1-bb67-58fa9e12698e" containerID="c248ef926ad45bfa8232571f16c6b4d7808ae628b845071dd099934b801eee81" exitCode=1 Jun 02 01:58:25.336398 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:25.336048 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" event={"ID":"4b0f93ff-4689-45e1-bb67-58fa9e12698e","Type":"ContainerDied","Data":"c248ef926ad45bfa8232571f16c6b4d7808ae628b845071dd099934b801eee81"} Jun 02 01:58:25.336532 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:25.336516 2560 scope.go:117] "RemoveContainer" containerID="c248ef926ad45bfa8232571f16c6b4d7808ae628b845071dd099934b801eee81" Jun 02 01:58:26.340285 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:26.340250 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" event={"ID":"4b0f93ff-4689-45e1-bb67-58fa9e12698e","Type":"ContainerStarted","Data":"1ccf01503298c2f25c112285ebf6636458dae5c53d2a169f13281989bfffb79b"} Jun 02 01:58:26.340669 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:26.340549 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:58:26.341159 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:26.341142 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58f4f4944f-4t4sq" Jun 02 01:58:26.637566 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:26.637485 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:58:32.327460 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:32.327429 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t8vpn" Jun 02 01:58:33.681890 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.681859 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7xj26"] Jun 02 01:58:33.686467 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.686450 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.689198 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.689170 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 01:58:33.689335 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.689241 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 01:58:33.690423 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.690398 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 01:58:33.690423 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.690417 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5rt26\"" Jun 02 01:58:33.690619 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.690445 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 01:58:33.690619 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.690449 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 01:58:33.693645 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.693629 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 01:58:33.752396 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752577 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-root\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752577 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94227962-2520-4620-b1d5-a257be22899d-metrics-client-ca\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752577 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752475 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94227962-2520-4620-b1d5-a257be22899d-node-exporter-textfile\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752694 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94227962-2520-4620-b1d5-a257be22899d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752694 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-node-exporter-wtmp\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752694 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752639 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-tls\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752694 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752669 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-sys\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.752857 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.752757 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxcr\" (UniqueName: \"kubernetes.io/projected/94227962-2520-4620-b1d5-a257be22899d-kube-api-access-2lxcr\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.853746 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.853710 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxcr\" (UniqueName: \"kubernetes.io/projected/94227962-2520-4620-b1d5-a257be22899d-kube-api-access-2lxcr\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.853746 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.853750 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854011 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.853790 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-root\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854011 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.853806 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94227962-2520-4620-b1d5-a257be22899d-metrics-client-ca\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854011 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.853862 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-root\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854011 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.853893 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94227962-2520-4620-b1d5-a257be22899d-node-exporter-textfile\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854011 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.853912 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94227962-2520-4620-b1d5-a257be22899d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854011 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854006 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-node-exporter-wtmp\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854295 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854045 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-tls\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854295 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854077 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-sys\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854295 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:58:33.854170 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 01:58:33.854295 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-node-exporter-wtmp\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854295 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854194 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/94227962-2520-4620-b1d5-a257be22899d-sys\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854295 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:58:33.854242 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-tls podName:94227962-2520-4620-b1d5-a257be22899d nodeName:}" failed. No retries permitted until 2026-06-02 01:58:34.354220654 +0000 UTC m=+177.176629325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-tls") pod "node-exporter-7xj26" (UID: "94227962-2520-4620-b1d5-a257be22899d") : secret "node-exporter-tls" not found Jun 02 01:58:33.854582 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854325 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/94227962-2520-4620-b1d5-a257be22899d-node-exporter-textfile\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854582 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854475 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/94227962-2520-4620-b1d5-a257be22899d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.854582 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.854499 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94227962-2520-4620-b1d5-a257be22899d-metrics-client-ca\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.856160 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.856137 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:33.865642 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:33.865620 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxcr\" (UniqueName: \"kubernetes.io/projected/94227962-2520-4620-b1d5-a257be22899d-kube-api-access-2lxcr\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:34.358098 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:34.358063 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-tls\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:34.360435 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:34.360412 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/94227962-2520-4620-b1d5-a257be22899d-node-exporter-tls\") pod \"node-exporter-7xj26\" (UID: \"94227962-2520-4620-b1d5-a257be22899d\") " pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:34.596053 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:34.596013 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7xj26" Jun 02 01:58:34.604000 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:58:34.603970 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94227962_2520_4620_b1d5_a257be22899d.slice/crio-cacde8b3900faedcf0002e62fd3988f7677b1d948544605476b6a9793b36657a WatchSource:0}: Error finding container cacde8b3900faedcf0002e62fd3988f7677b1d948544605476b6a9793b36657a: Status 404 returned error can't find the container with id cacde8b3900faedcf0002e62fd3988f7677b1d948544605476b6a9793b36657a Jun 02 01:58:35.363147 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:35.363102 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7xj26" event={"ID":"94227962-2520-4620-b1d5-a257be22899d","Type":"ContainerStarted","Data":"cacde8b3900faedcf0002e62fd3988f7677b1d948544605476b6a9793b36657a"} Jun 02 01:58:36.366587 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:36.366554 2560 generic.go:358] "Generic (PLEG): container finished" podID="94227962-2520-4620-b1d5-a257be22899d" containerID="da1c37861ee807456c328bea152624338de153ac08acba67511073a7a00c1905" exitCode=0 Jun 02 01:58:36.366996 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:36.366626 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7xj26" event={"ID":"94227962-2520-4620-b1d5-a257be22899d","Type":"ContainerDied","Data":"da1c37861ee807456c328bea152624338de153ac08acba67511073a7a00c1905"} Jun 02 01:58:37.370696 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:37.370659 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7xj26" event={"ID":"94227962-2520-4620-b1d5-a257be22899d","Type":"ContainerStarted","Data":"3853bbf3363d289960b2b1cf710920ef75848f38488d72f3e28569810153a662"} Jun 02 01:58:37.370696 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:37.370699 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7xj26" event={"ID":"94227962-2520-4620-b1d5-a257be22899d","Type":"ContainerStarted","Data":"5572636985d244aa3601a2711812362174e9d563643b9702e2b2222c90c2112a"} Jun 02 01:58:37.391885 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:37.391838 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7xj26" podStartSLOduration=3.492283204 podStartE2EDuration="4.391825212s" podCreationTimestamp="2026-06-02 01:58:33 +0000 UTC" firstStartedPulling="2026-06-02 01:58:34.605473719 +0000 UTC m=+177.427882395" lastFinishedPulling="2026-06-02 01:58:35.505015729 +0000 UTC m=+178.327424403" observedRunningTime="2026-06-02 01:58:37.390717885 +0000 UTC m=+180.213126578" watchObservedRunningTime="2026-06-02 01:58:37.391825212 +0000 UTC m=+180.214233897" Jun 02 01:58:41.316801 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:41.316774 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:58:43.169896 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:43.169863 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858f84bc6d-hx7rl"] Jun 02 01:58:51.922106 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:58:51.922065 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" podUID="26a0da75-0179-4448-863d-1d032b1ab4cd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:59:01.922150 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:01.922108 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" podUID="26a0da75-0179-4448-863d-1d032b1ab4cd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:59:08.189511 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.189444 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" podUID="751b1df8-fa01-4fca-931a-e1ac3ea78051" containerName="registry" containerID="cri-o://116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1" gracePeriod=30 Jun 02 01:59:08.427715 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.427692 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:59:08.452062 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.451983 2560 generic.go:358] "Generic (PLEG): container finished" podID="751b1df8-fa01-4fca-931a-e1ac3ea78051" containerID="116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1" exitCode=0 Jun 02 01:59:08.452062 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.452040 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" Jun 02 01:59:08.452062 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.452049 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" event={"ID":"751b1df8-fa01-4fca-931a-e1ac3ea78051","Type":"ContainerDied","Data":"116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1"} Jun 02 01:59:08.452305 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.452082 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-858f84bc6d-hx7rl" event={"ID":"751b1df8-fa01-4fca-931a-e1ac3ea78051","Type":"ContainerDied","Data":"ef501a695bca3889fd3a14e1959c09c072b06723bfff09595c4a3622b6915b30"} Jun 02 01:59:08.452305 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.452100 2560 scope.go:117] "RemoveContainer" containerID="116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1" Jun 02 01:59:08.460673 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.460652 2560 scope.go:117] "RemoveContainer" containerID="116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1" Jun 02 01:59:08.460974 ip-10-0-134-54 kubenswrapper[2560]: E0602 01:59:08.460952 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1\": container with ID starting with 116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1 not found: ID does not exist" containerID="116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1" Jun 02 01:59:08.461045 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.460986 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1"} err="failed to get container status \"116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1\": rpc error: code = NotFound desc = could not find container \"116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1\": container with ID starting with 116533d89576fcb9ae44139e3479208b9dcbf8c59cda840f532db092263793d1 not found: ID does not exist" Jun 02 01:59:08.527385 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527340 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527385 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527389 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-certificates\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527624 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527419 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-trusted-ca\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527624 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527449 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/751b1df8-fa01-4fca-931a-e1ac3ea78051-ca-trust-extracted\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527624 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527468 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-installation-pull-secrets\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527624 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527488 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzrpv\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-kube-api-access-zzrpv\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527624 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527541 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-image-registry-private-configuration\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527624 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527570 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-bound-sa-token\") pod \"751b1df8-fa01-4fca-931a-e1ac3ea78051\" (UID: \"751b1df8-fa01-4fca-931a-e1ac3ea78051\") " Jun 02 01:59:08.527977 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.527948 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:59:08.528237 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.528165 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 01:59:08.530410 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.530380 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:08.530523 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.530429 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:08.530523 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.530464 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:08.530523 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.530482 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 01:59:08.530679 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.530547 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-kube-api-access-zzrpv" (OuterVolumeSpecName: "kube-api-access-zzrpv") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "kube-api-access-zzrpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 01:59:08.536243 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.536214 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751b1df8-fa01-4fca-931a-e1ac3ea78051-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "751b1df8-fa01-4fca-931a-e1ac3ea78051" (UID: "751b1df8-fa01-4fca-931a-e1ac3ea78051"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 01:59:08.628944 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628907 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-image-registry-private-configuration\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.628944 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628938 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-bound-sa-token\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.628944 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628953 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-tls\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.629168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628961 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-registry-certificates\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.629168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628970 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/751b1df8-fa01-4fca-931a-e1ac3ea78051-trusted-ca\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.629168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628979 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/751b1df8-fa01-4fca-931a-e1ac3ea78051-ca-trust-extracted\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.629168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628989 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/751b1df8-fa01-4fca-931a-e1ac3ea78051-installation-pull-secrets\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.629168 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.628997 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzrpv\" (UniqueName: \"kubernetes.io/projected/751b1df8-fa01-4fca-931a-e1ac3ea78051-kube-api-access-zzrpv\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 01:59:08.773496 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.773464 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-858f84bc6d-hx7rl"] Jun 02 01:59:08.777084 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:08.777061 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-858f84bc6d-hx7rl"] Jun 02 01:59:09.641249 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:09.641215 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751b1df8-fa01-4fca-931a-e1ac3ea78051" path="/var/lib/kubelet/pods/751b1df8-fa01-4fca-931a-e1ac3ea78051/volumes" Jun 02 01:59:11.922017 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:11.921975 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" podUID="26a0da75-0179-4448-863d-1d032b1ab4cd" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 01:59:11.922379 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:11.922058 2560 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" Jun 02 01:59:11.922508 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:11.922491 2560 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b2bd6d399b868829c11b0f6a7c1c2d6e33e121d93552607c2717011f81c662d8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 01:59:11.922549 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:11.922527 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" podUID="26a0da75-0179-4448-863d-1d032b1ab4cd" containerName="service-proxy" containerID="cri-o://b2bd6d399b868829c11b0f6a7c1c2d6e33e121d93552607c2717011f81c662d8" gracePeriod=30 Jun 02 01:59:12.463816 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:12.463783 2560 generic.go:358] "Generic (PLEG): container finished" podID="26a0da75-0179-4448-863d-1d032b1ab4cd" containerID="b2bd6d399b868829c11b0f6a7c1c2d6e33e121d93552607c2717011f81c662d8" exitCode=2 Jun 02 01:59:12.463980 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:12.463852 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" event={"ID":"26a0da75-0179-4448-863d-1d032b1ab4cd","Type":"ContainerDied","Data":"b2bd6d399b868829c11b0f6a7c1c2d6e33e121d93552607c2717011f81c662d8"} Jun 02 01:59:12.463980 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:12.463888 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-866f5f559f-xfm7g" event={"ID":"26a0da75-0179-4448-863d-1d032b1ab4cd","Type":"ContainerStarted","Data":"924a29f141bd1af140acca246d43912ed05333b7d4e20f493e8e8e832622242f"} Jun 02 01:59:48.617358 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:48.617322 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:59:48.619563 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:48.619545 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44-metrics-certs\") pod \"network-metrics-daemon-5crbq\" (UID: \"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44\") " pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:59:48.840945 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:48.840913 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bqdvw\"" Jun 02 01:59:48.848924 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:48.848904 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5crbq" Jun 02 01:59:48.971055 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:48.971024 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5crbq"] Jun 02 01:59:48.974318 ip-10-0-134-54 kubenswrapper[2560]: W0602 01:59:48.974287 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310b5ea6_fe8c_4364_adc3_ba7b4eeb3e44.slice/crio-5253c39ff1aa38feeaf664fc0d1af3c2c86138a0fe4b46f4f29b35e28d6a2e92 WatchSource:0}: Error finding container 5253c39ff1aa38feeaf664fc0d1af3c2c86138a0fe4b46f4f29b35e28d6a2e92: Status 404 returned error can't find the container with id 5253c39ff1aa38feeaf664fc0d1af3c2c86138a0fe4b46f4f29b35e28d6a2e92 Jun 02 01:59:49.562367 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:49.562318 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5crbq" event={"ID":"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44","Type":"ContainerStarted","Data":"5253c39ff1aa38feeaf664fc0d1af3c2c86138a0fe4b46f4f29b35e28d6a2e92"} Jun 02 01:59:50.566628 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:50.566590 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5crbq" event={"ID":"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44","Type":"ContainerStarted","Data":"b7de581f0b28d6dd36bf49e8d1403c838bd8c8dd16661155971cdc71045cdaa5"} Jun 02 01:59:50.566628 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:50.566630 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5crbq" event={"ID":"310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44","Type":"ContainerStarted","Data":"f5d16691787c676626e93f63abd23df0c5c660aa262575e686ae0d96e4a5df97"} Jun 02 01:59:50.584780 ip-10-0-134-54 kubenswrapper[2560]: I0602 01:59:50.584717 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5crbq" podStartSLOduration=251.555630893 podStartE2EDuration="4m12.584703735s" podCreationTimestamp="2026-06-02 01:55:38 +0000 UTC" firstStartedPulling="2026-06-02 01:59:48.976114857 +0000 UTC m=+251.798523528" lastFinishedPulling="2026-06-02 01:59:50.005187698 +0000 UTC m=+252.827596370" observedRunningTime="2026-06-02 01:59:50.583413648 +0000 UTC m=+253.405822333" watchObservedRunningTime="2026-06-02 01:59:50.584703735 +0000 UTC m=+253.407112429" Jun 02 02:00:37.555843 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:00:37.555807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:00:37.557094 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:00:37.557065 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:00:37.560602 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:00:37.560582 2560 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 02:01:44.331608 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.331524 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp"] Jun 02 02:01:44.332179 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.331867 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751b1df8-fa01-4fca-931a-e1ac3ea78051" containerName="registry" Jun 02 02:01:44.332179 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.331887 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="751b1df8-fa01-4fca-931a-e1ac3ea78051" containerName="registry" Jun 02 02:01:44.332179 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.331957 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="751b1df8-fa01-4fca-931a-e1ac3ea78051" containerName="registry" Jun 02 02:01:44.334994 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.334971 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.337432 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.337413 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:01:44.337532 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.337442 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:01:44.338388 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.338372 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vbpkd\"" Jun 02 02:01:44.342118 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.342095 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp"] Jun 02 02:01:44.410048 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.410016 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.410048 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.410053 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.410253 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.410071 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx92q\" (UniqueName: \"kubernetes.io/projected/57462a68-c7d7-47ac-bc24-4d93a70c92e9-kube-api-access-hx92q\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.511223 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.511170 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.511223 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.511230 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.511414 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.511256 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hx92q\" (UniqueName: \"kubernetes.io/projected/57462a68-c7d7-47ac-bc24-4d93a70c92e9-kube-api-access-hx92q\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.511624 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.511602 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.511683 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.511666 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.520086 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.520066 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx92q\" (UniqueName: \"kubernetes.io/projected/57462a68-c7d7-47ac-bc24-4d93a70c92e9-kube-api-access-hx92q\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.645048 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.644962 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:01:44.775497 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.775468 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp"] Jun 02 02:01:44.778104 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:01:44.778077 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57462a68_c7d7_47ac_bc24_4d93a70c92e9.slice/crio-c65772cac36d6d4417b34ea21d21e32bb806577b9079483d9ef3e7f2d3a7cb16 WatchSource:0}: Error finding container c65772cac36d6d4417b34ea21d21e32bb806577b9079483d9ef3e7f2d3a7cb16: Status 404 returned error can't find the container with id c65772cac36d6d4417b34ea21d21e32bb806577b9079483d9ef3e7f2d3a7cb16 Jun 02 02:01:44.779942 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.779921 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:01:44.850555 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:44.850519 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" event={"ID":"57462a68-c7d7-47ac-bc24-4d93a70c92e9","Type":"ContainerStarted","Data":"c65772cac36d6d4417b34ea21d21e32bb806577b9079483d9ef3e7f2d3a7cb16"} Jun 02 02:01:50.867862 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:50.867827 2560 generic.go:358] "Generic (PLEG): container finished" podID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerID="bf0e3599445b1cceabba368e5edfafeb7e467c0bd8991cf41b2ae1d6027024fd" exitCode=0 Jun 02 02:01:50.868305 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:50.867898 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" event={"ID":"57462a68-c7d7-47ac-bc24-4d93a70c92e9","Type":"ContainerDied","Data":"bf0e3599445b1cceabba368e5edfafeb7e467c0bd8991cf41b2ae1d6027024fd"} Jun 02 02:01:51.871833 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:51.871798 2560 generic.go:358] "Generic (PLEG): container finished" podID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerID="b89ed7ea1668fb12b59ee94190cd358fdce3348180eebfcbf86f56b983a1470c" exitCode=0 Jun 02 02:01:51.872204 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:01:51.871860 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" event={"ID":"57462a68-c7d7-47ac-bc24-4d93a70c92e9","Type":"ContainerDied","Data":"b89ed7ea1668fb12b59ee94190cd358fdce3348180eebfcbf86f56b983a1470c"} Jun 02 02:02:00.897069 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:00.897035 2560 generic.go:358] "Generic (PLEG): container finished" podID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerID="8cb19c1e8711fe69ef3e498a4e004e62dd2135f003e91223347c65b9b074846f" exitCode=0 Jun 02 02:02:00.897483 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:00.897126 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" event={"ID":"57462a68-c7d7-47ac-bc24-4d93a70c92e9","Type":"ContainerDied","Data":"8cb19c1e8711fe69ef3e498a4e004e62dd2135f003e91223347c65b9b074846f"} Jun 02 02:02:02.026618 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.026597 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:02:02.125931 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.125897 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-bundle\") pod \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " Jun 02 02:02:02.125931 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.125948 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx92q\" (UniqueName: \"kubernetes.io/projected/57462a68-c7d7-47ac-bc24-4d93a70c92e9-kube-api-access-hx92q\") pod \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " Jun 02 02:02:02.126164 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.125989 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-util\") pod \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\" (UID: \"57462a68-c7d7-47ac-bc24-4d93a70c92e9\") " Jun 02 02:02:02.126880 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.126857 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-bundle" (OuterVolumeSpecName: "bundle") pod "57462a68-c7d7-47ac-bc24-4d93a70c92e9" (UID: "57462a68-c7d7-47ac-bc24-4d93a70c92e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:02.128281 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.128259 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57462a68-c7d7-47ac-bc24-4d93a70c92e9-kube-api-access-hx92q" (OuterVolumeSpecName: "kube-api-access-hx92q") pod "57462a68-c7d7-47ac-bc24-4d93a70c92e9" (UID: "57462a68-c7d7-47ac-bc24-4d93a70c92e9"). InnerVolumeSpecName "kube-api-access-hx92q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:02:02.130631 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.130609 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-util" (OuterVolumeSpecName: "util") pod "57462a68-c7d7-47ac-bc24-4d93a70c92e9" (UID: "57462a68-c7d7-47ac-bc24-4d93a70c92e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:02.226657 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.226569 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:02.226657 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.226601 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57462a68-c7d7-47ac-bc24-4d93a70c92e9-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:02.226657 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.226610 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx92q\" (UniqueName: \"kubernetes.io/projected/57462a68-c7d7-47ac-bc24-4d93a70c92e9-kube-api-access-hx92q\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:02.903002 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.902966 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" event={"ID":"57462a68-c7d7-47ac-bc24-4d93a70c92e9","Type":"ContainerDied","Data":"c65772cac36d6d4417b34ea21d21e32bb806577b9079483d9ef3e7f2d3a7cb16"} Jun 02 02:02:02.903002 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.902999 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c65772cac36d6d4417b34ea21d21e32bb806577b9079483d9ef3e7f2d3a7cb16" Jun 02 02:02:02.903263 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:02.903065 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d677jp" Jun 02 02:02:13.580355 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580311 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r"] Jun 02 02:02:13.581015 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580629 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerName="util" Jun 02 02:02:13.581015 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580648 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerName="util" Jun 02 02:02:13.581015 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580666 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerName="pull" Jun 02 02:02:13.581015 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580675 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerName="pull" Jun 02 02:02:13.581015 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580685 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerName="extract" Jun 02 02:02:13.581015 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580693 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerName="extract" Jun 02 02:02:13.581015 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.580749 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="57462a68-c7d7-47ac-bc24-4d93a70c92e9" containerName="extract" Jun 02 02:02:13.584340 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.584316 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.586978 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.586957 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:02:13.587106 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.587025 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vbpkd\"" Jun 02 02:02:13.587849 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.587833 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:02:13.592255 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.592232 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r"] Jun 02 02:02:13.609369 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.609343 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.609498 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.609391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggb47\" (UniqueName: \"kubernetes.io/projected/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-kube-api-access-ggb47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.609498 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.609462 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.710546 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.710509 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ggb47\" (UniqueName: \"kubernetes.io/projected/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-kube-api-access-ggb47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.710726 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.710560 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.710726 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.710693 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.710963 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.710942 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.711069 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.711052 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.719203 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.719180 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggb47\" (UniqueName: \"kubernetes.io/projected/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-kube-api-access-ggb47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:13.894208 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:13.894109 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:14.018281 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:14.018203 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r"] Jun 02 02:02:14.021078 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:02:14.021049 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78b7036_bfd8_4308_89b0_45e7ab72f5bb.slice/crio-da7c199c2742fe23b2b86a4244a733c7d11dfde2f2f2adcc7e2af71ed93ef96b WatchSource:0}: Error finding container da7c199c2742fe23b2b86a4244a733c7d11dfde2f2f2adcc7e2af71ed93ef96b: Status 404 returned error can't find the container with id da7c199c2742fe23b2b86a4244a733c7d11dfde2f2f2adcc7e2af71ed93ef96b Jun 02 02:02:14.937089 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:14.937054 2560 generic.go:358] "Generic (PLEG): container finished" podID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerID="d35eb776f1ba49bbbfe5bb42a730545a1e6ff019b6f2d60ae526254d29732162" exitCode=0 Jun 02 02:02:14.937089 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:14.937092 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" event={"ID":"f78b7036-bfd8-4308-89b0-45e7ab72f5bb","Type":"ContainerDied","Data":"d35eb776f1ba49bbbfe5bb42a730545a1e6ff019b6f2d60ae526254d29732162"} Jun 02 02:02:14.937607 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:14.937116 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" event={"ID":"f78b7036-bfd8-4308-89b0-45e7ab72f5bb","Type":"ContainerStarted","Data":"da7c199c2742fe23b2b86a4244a733c7d11dfde2f2f2adcc7e2af71ed93ef96b"} Jun 02 02:02:17.947278 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:17.947233 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" event={"ID":"f78b7036-bfd8-4308-89b0-45e7ab72f5bb","Type":"ContainerStarted","Data":"b245b0d3942510674372d1ecd639edd066c5b07249d7e41005364cf3dae71b62"} Jun 02 02:02:18.951709 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:18.951669 2560 generic.go:358] "Generic (PLEG): container finished" podID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerID="b245b0d3942510674372d1ecd639edd066c5b07249d7e41005364cf3dae71b62" exitCode=0 Jun 02 02:02:18.952168 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:18.951773 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" event={"ID":"f78b7036-bfd8-4308-89b0-45e7ab72f5bb","Type":"ContainerDied","Data":"b245b0d3942510674372d1ecd639edd066c5b07249d7e41005364cf3dae71b62"} Jun 02 02:02:19.956356 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:19.956320 2560 generic.go:358] "Generic (PLEG): container finished" podID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerID="036e877d95821e2d3da323c251e371a7514a98c06ecf3627162fcf283e1bed4a" exitCode=0 Jun 02 02:02:19.956718 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:19.956408 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" event={"ID":"f78b7036-bfd8-4308-89b0-45e7ab72f5bb","Type":"ContainerDied","Data":"036e877d95821e2d3da323c251e371a7514a98c06ecf3627162fcf283e1bed4a"} Jun 02 02:02:21.087340 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.087315 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:21.164416 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.164387 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-bundle\") pod \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " Jun 02 02:02:21.164553 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.164458 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggb47\" (UniqueName: \"kubernetes.io/projected/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-kube-api-access-ggb47\") pod \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " Jun 02 02:02:21.164553 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.164498 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-util\") pod \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\" (UID: \"f78b7036-bfd8-4308-89b0-45e7ab72f5bb\") " Jun 02 02:02:21.164865 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.164833 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-bundle" (OuterVolumeSpecName: "bundle") pod "f78b7036-bfd8-4308-89b0-45e7ab72f5bb" (UID: "f78b7036-bfd8-4308-89b0-45e7ab72f5bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:21.166521 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.166497 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-kube-api-access-ggb47" (OuterVolumeSpecName: "kube-api-access-ggb47") pod "f78b7036-bfd8-4308-89b0-45e7ab72f5bb" (UID: "f78b7036-bfd8-4308-89b0-45e7ab72f5bb"). InnerVolumeSpecName "kube-api-access-ggb47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:02:21.168876 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.168856 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-util" (OuterVolumeSpecName: "util") pod "f78b7036-bfd8-4308-89b0-45e7ab72f5bb" (UID: "f78b7036-bfd8-4308-89b0-45e7ab72f5bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:21.265361 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.265334 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:21.265361 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.265362 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:21.265538 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.265375 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggb47\" (UniqueName: \"kubernetes.io/projected/f78b7036-bfd8-4308-89b0-45e7ab72f5bb-kube-api-access-ggb47\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:21.963203 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.963121 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" event={"ID":"f78b7036-bfd8-4308-89b0-45e7ab72f5bb","Type":"ContainerDied","Data":"da7c199c2742fe23b2b86a4244a733c7d11dfde2f2f2adcc7e2af71ed93ef96b"} Jun 02 02:02:21.963203 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.963151 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da7c199c2742fe23b2b86a4244a733c7d11dfde2f2f2adcc7e2af71ed93ef96b" Jun 02 02:02:21.963203 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:21.963183 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fntf7r" Jun 02 02:02:27.503717 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.503679 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4"] Jun 02 02:02:27.504189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.503916 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerName="extract" Jun 02 02:02:27.504189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.503927 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerName="extract" Jun 02 02:02:27.504189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.503938 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerName="util" Jun 02 02:02:27.504189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.503944 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerName="util" Jun 02 02:02:27.504189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.503951 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerName="pull" Jun 02 02:02:27.504189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.503957 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerName="pull" Jun 02 02:02:27.504189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.504029 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="f78b7036-bfd8-4308-89b0-45e7ab72f5bb" containerName="extract" Jun 02 02:02:27.507049 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.507031 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.509774 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.509738 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 02:02:27.510616 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.510597 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 02:02:27.510714 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.510599 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-l79cz\"" Jun 02 02:02:27.522736 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.522712 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4"] Jun 02 02:02:27.609390 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.609358 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kh5j\" (UniqueName: \"kubernetes.io/projected/4690e2ec-52aa-4735-bfe8-0e41397138a3-kube-api-access-4kh5j\") pod \"openshift-lws-operator-bfc7f696d-mmwx4\" (UID: \"4690e2ec-52aa-4735-bfe8-0e41397138a3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.609544 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.609399 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4690e2ec-52aa-4735-bfe8-0e41397138a3-tmp\") pod \"openshift-lws-operator-bfc7f696d-mmwx4\" (UID: \"4690e2ec-52aa-4735-bfe8-0e41397138a3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.709891 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.709852 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4690e2ec-52aa-4735-bfe8-0e41397138a3-tmp\") pod \"openshift-lws-operator-bfc7f696d-mmwx4\" (UID: \"4690e2ec-52aa-4735-bfe8-0e41397138a3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.710150 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.710126 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4kh5j\" (UniqueName: \"kubernetes.io/projected/4690e2ec-52aa-4735-bfe8-0e41397138a3-kube-api-access-4kh5j\") pod \"openshift-lws-operator-bfc7f696d-mmwx4\" (UID: \"4690e2ec-52aa-4735-bfe8-0e41397138a3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.710300 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.710278 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4690e2ec-52aa-4735-bfe8-0e41397138a3-tmp\") pod \"openshift-lws-operator-bfc7f696d-mmwx4\" (UID: \"4690e2ec-52aa-4735-bfe8-0e41397138a3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.717779 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.717740 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kh5j\" (UniqueName: \"kubernetes.io/projected/4690e2ec-52aa-4735-bfe8-0e41397138a3-kube-api-access-4kh5j\") pod \"openshift-lws-operator-bfc7f696d-mmwx4\" (UID: \"4690e2ec-52aa-4735-bfe8-0e41397138a3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.815002 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.814973 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" Jun 02 02:02:27.937093 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.937061 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4"] Jun 02 02:02:27.939947 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:02:27.939922 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4690e2ec_52aa_4735_bfe8_0e41397138a3.slice/crio-b1be6f8d1beaf84d9407522aee38589fe30b5ddaad24f3897d6e7739f00ceba9 WatchSource:0}: Error finding container b1be6f8d1beaf84d9407522aee38589fe30b5ddaad24f3897d6e7739f00ceba9: Status 404 returned error can't find the container with id b1be6f8d1beaf84d9407522aee38589fe30b5ddaad24f3897d6e7739f00ceba9 Jun 02 02:02:27.983065 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:27.983036 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" event={"ID":"4690e2ec-52aa-4735-bfe8-0e41397138a3","Type":"ContainerStarted","Data":"b1be6f8d1beaf84d9407522aee38589fe30b5ddaad24f3897d6e7739f00ceba9"} Jun 02 02:02:30.992343 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:30.992255 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" event={"ID":"4690e2ec-52aa-4735-bfe8-0e41397138a3","Type":"ContainerStarted","Data":"2b59d9194baabb6e283cace46d5bbb85db40030033f1d91ac4f970e34266abe9"} Jun 02 02:02:31.009775 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:31.009711 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-mmwx4" podStartSLOduration=1.37818683 podStartE2EDuration="4.009696813s" podCreationTimestamp="2026-06-02 02:02:27 +0000 UTC" firstStartedPulling="2026-06-02 02:02:27.941341196 +0000 UTC m=+410.763749868" lastFinishedPulling="2026-06-02 02:02:30.572851163 +0000 UTC m=+413.395259851" observedRunningTime="2026-06-02 02:02:31.008647389 +0000 UTC m=+413.831056136" watchObservedRunningTime="2026-06-02 02:02:31.009696813 +0000 UTC m=+413.832105506" Jun 02 02:02:33.743293 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.743256 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7"] Jun 02 02:02:33.746433 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.746417 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.749288 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.749268 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:02:33.750266 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.750242 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:02:33.750478 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.750462 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vbpkd\"" Jun 02 02:02:33.756813 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.756792 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7"] Jun 02 02:02:33.852907 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.852865 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.852907 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.852915 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.853124 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.852932 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wz5f\" (UniqueName: \"kubernetes.io/projected/74387326-5b92-43ad-9b55-568013776717-kube-api-access-4wz5f\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.953881 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.953844 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.953881 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.953883 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4wz5f\" (UniqueName: \"kubernetes.io/projected/74387326-5b92-43ad-9b55-568013776717-kube-api-access-4wz5f\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.954074 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.954046 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.954289 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.954272 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.954350 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.954336 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:33.962459 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:33.962431 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wz5f\" (UniqueName: \"kubernetes.io/projected/74387326-5b92-43ad-9b55-568013776717-kube-api-access-4wz5f\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:34.055459 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:34.055427 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:34.178233 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:34.178192 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7"] Jun 02 02:02:34.181175 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:02:34.181145 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74387326_5b92_43ad_9b55_568013776717.slice/crio-fbad68e36956b4995942b7e1f8666c450617d29831a1e3c737bce28d89b5e632 WatchSource:0}: Error finding container fbad68e36956b4995942b7e1f8666c450617d29831a1e3c737bce28d89b5e632: Status 404 returned error can't find the container with id fbad68e36956b4995942b7e1f8666c450617d29831a1e3c737bce28d89b5e632 Jun 02 02:02:35.003928 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:35.003891 2560 generic.go:358] "Generic (PLEG): container finished" podID="74387326-5b92-43ad-9b55-568013776717" containerID="7d9f520052bbae48b5408d6fe19e8e456c461c794f2a3f1c5b7faa2d0b6c8291" exitCode=0 Jun 02 02:02:35.004319 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:35.003981 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" event={"ID":"74387326-5b92-43ad-9b55-568013776717","Type":"ContainerDied","Data":"7d9f520052bbae48b5408d6fe19e8e456c461c794f2a3f1c5b7faa2d0b6c8291"} Jun 02 02:02:35.004319 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:35.004016 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" event={"ID":"74387326-5b92-43ad-9b55-568013776717","Type":"ContainerStarted","Data":"fbad68e36956b4995942b7e1f8666c450617d29831a1e3c737bce28d89b5e632"} Jun 02 02:02:36.007693 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:36.007601 2560 generic.go:358] "Generic (PLEG): container finished" podID="74387326-5b92-43ad-9b55-568013776717" containerID="0d7c6b593bbaffc25ab163d396bfb77e00243962b96d90850b423eefd0dc1bda" exitCode=0 Jun 02 02:02:36.007693 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:36.007670 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" event={"ID":"74387326-5b92-43ad-9b55-568013776717","Type":"ContainerDied","Data":"0d7c6b593bbaffc25ab163d396bfb77e00243962b96d90850b423eefd0dc1bda"} Jun 02 02:02:37.012564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:37.012530 2560 generic.go:358] "Generic (PLEG): container finished" podID="74387326-5b92-43ad-9b55-568013776717" containerID="4f549ceae308c8892b11ea7e4f76abd65158b763194e7c102474f89f35d42b69" exitCode=0 Jun 02 02:02:37.012971 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:37.012594 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" event={"ID":"74387326-5b92-43ad-9b55-568013776717","Type":"ContainerDied","Data":"4f549ceae308c8892b11ea7e4f76abd65158b763194e7c102474f89f35d42b69"} Jun 02 02:02:38.133332 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.133301 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:38.183502 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.183471 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wz5f\" (UniqueName: \"kubernetes.io/projected/74387326-5b92-43ad-9b55-568013776717-kube-api-access-4wz5f\") pod \"74387326-5b92-43ad-9b55-568013776717\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " Jun 02 02:02:38.183653 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.183533 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-util\") pod \"74387326-5b92-43ad-9b55-568013776717\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " Jun 02 02:02:38.183653 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.183605 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-bundle\") pod \"74387326-5b92-43ad-9b55-568013776717\" (UID: \"74387326-5b92-43ad-9b55-568013776717\") " Jun 02 02:02:38.184281 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.184249 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-bundle" (OuterVolumeSpecName: "bundle") pod "74387326-5b92-43ad-9b55-568013776717" (UID: "74387326-5b92-43ad-9b55-568013776717"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:38.185670 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.185642 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74387326-5b92-43ad-9b55-568013776717-kube-api-access-4wz5f" (OuterVolumeSpecName: "kube-api-access-4wz5f") pod "74387326-5b92-43ad-9b55-568013776717" (UID: "74387326-5b92-43ad-9b55-568013776717"). InnerVolumeSpecName "kube-api-access-4wz5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:02:38.188809 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.188756 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-util" (OuterVolumeSpecName: "util") pod "74387326-5b92-43ad-9b55-568013776717" (UID: "74387326-5b92-43ad-9b55-568013776717"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:02:38.284224 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.284127 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wz5f\" (UniqueName: \"kubernetes.io/projected/74387326-5b92-43ad-9b55-568013776717-kube-api-access-4wz5f\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:38.284224 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.284173 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:38.284224 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:38.284184 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74387326-5b92-43ad-9b55-568013776717-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:02:39.020222 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:39.020189 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" event={"ID":"74387326-5b92-43ad-9b55-568013776717","Type":"ContainerDied","Data":"fbad68e36956b4995942b7e1f8666c450617d29831a1e3c737bce28d89b5e632"} Jun 02 02:02:39.020222 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:39.020215 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2vqf7" Jun 02 02:02:39.020430 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:39.020220 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbad68e36956b4995942b7e1f8666c450617d29831a1e3c737bce28d89b5e632" Jun 02 02:02:49.861466 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861383 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk"] Jun 02 02:02:49.861990 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861616 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74387326-5b92-43ad-9b55-568013776717" containerName="extract" Jun 02 02:02:49.861990 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861627 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74387326-5b92-43ad-9b55-568013776717" containerName="extract" Jun 02 02:02:49.861990 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861638 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74387326-5b92-43ad-9b55-568013776717" containerName="util" Jun 02 02:02:49.861990 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861646 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74387326-5b92-43ad-9b55-568013776717" containerName="util" Jun 02 02:02:49.861990 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861670 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74387326-5b92-43ad-9b55-568013776717" containerName="pull" Jun 02 02:02:49.861990 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861679 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="74387326-5b92-43ad-9b55-568013776717" containerName="pull" Jun 02 02:02:49.861990 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.861720 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="74387326-5b92-43ad-9b55-568013776717" containerName="extract" Jun 02 02:02:49.864532 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.864517 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:49.868123 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.868100 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 02:02:49.868316 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.868302 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 02:02:49.868393 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.868337 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5mdh7\"" Jun 02 02:02:49.869094 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.869078 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 02:02:49.870306 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.870287 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 02:02:49.883288 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.883266 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk"] Jun 02 02:02:49.968742 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.968706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-tmp\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:49.968934 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.968750 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:49.968934 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.968801 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-manifests\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:49.968934 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.968822 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:49.968934 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:49.968839 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95f6m\" (UniqueName: \"kubernetes.io/projected/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-kube-api-access-95f6m\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.069193 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.069161 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-tmp\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.069372 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.069207 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.069372 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.069255 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-manifests\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.069372 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.069280 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.069372 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.069307 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95f6m\" (UniqueName: \"kubernetes.io/projected/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-kube-api-access-95f6m\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.069709 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.069681 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-manifests\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.071605 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.071579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-tmp\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.071838 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.071817 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.071887 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.071820 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.096350 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.096328 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95f6m\" (UniqueName: \"kubernetes.io/projected/eb117e1b-dcfe-4c0b-980c-86a4c2394a87-kube-api-access-95f6m\") pod \"opendatahub-operator-controller-manager-5d47575757-fhpnk\" (UID: \"eb117e1b-dcfe-4c0b-980c-86a4c2394a87\") " pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.174691 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.174616 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:50.324909 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:50.324879 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk"] Jun 02 02:02:50.327874 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:02:50.327840 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb117e1b_dcfe_4c0b_980c_86a4c2394a87.slice/crio-63cd62dc61fce7333547ee97e46d082415e9e0b16accd35d22d599935baba731 WatchSource:0}: Error finding container 63cd62dc61fce7333547ee97e46d082415e9e0b16accd35d22d599935baba731: Status 404 returned error can't find the container with id 63cd62dc61fce7333547ee97e46d082415e9e0b16accd35d22d599935baba731 Jun 02 02:02:51.056309 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:51.056247 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" event={"ID":"eb117e1b-dcfe-4c0b-980c-86a4c2394a87","Type":"ContainerStarted","Data":"63cd62dc61fce7333547ee97e46d082415e9e0b16accd35d22d599935baba731"} Jun 02 02:02:54.068056 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:54.068026 2560 generic.go:358] "Generic (PLEG): container finished" podID="eb117e1b-dcfe-4c0b-980c-86a4c2394a87" containerID="670373542a9f88d6d1712b25d386952f39bf9b450d3144b6f2da6cdd6a65b64f" exitCode=0 Jun 02 02:02:54.068386 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:54.068108 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" event={"ID":"eb117e1b-dcfe-4c0b-980c-86a4c2394a87","Type":"ContainerDied","Data":"670373542a9f88d6d1712b25d386952f39bf9b450d3144b6f2da6cdd6a65b64f"} Jun 02 02:02:55.075214 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:55.075179 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" event={"ID":"eb117e1b-dcfe-4c0b-980c-86a4c2394a87","Type":"ContainerStarted","Data":"93fb5bde71ecfd9352e7788b2ead98efe1e133f9aad169bea2c26c0c3354a9e0"} Jun 02 02:02:55.075646 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:55.075320 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:02:55.099583 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:02:55.099535 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" podStartSLOduration=2.008022019 podStartE2EDuration="6.099522209s" podCreationTimestamp="2026-06-02 02:02:49 +0000 UTC" firstStartedPulling="2026-06-02 02:02:50.329570207 +0000 UTC m=+433.151978879" lastFinishedPulling="2026-06-02 02:02:54.421070368 +0000 UTC m=+437.243479069" observedRunningTime="2026-06-02 02:02:55.097643441 +0000 UTC m=+437.920052135" watchObservedRunningTime="2026-06-02 02:02:55.099522209 +0000 UTC m=+437.921930903" Jun 02 02:03:06.081258 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:06.081229 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d47575757-fhpnk" Jun 02 02:03:09.398665 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.398620 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-vt6vk"] Jun 02 02:03:09.409187 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.409153 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:09.412215 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.412185 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 02:03:09.412349 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.412233 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tvgmd\"" Jun 02 02:03:09.428465 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.428437 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-vt6vk"] Jun 02 02:03:09.515175 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.515138 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnzxs\" (UniqueName: \"kubernetes.io/projected/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-kube-api-access-mnzxs\") pod \"odh-model-controller-76588b95-vt6vk\" (UID: \"a494c7e3-de4d-402a-8d8d-0f5d3a04f607\") " pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:09.515365 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.515198 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-cert\") pod \"odh-model-controller-76588b95-vt6vk\" (UID: \"a494c7e3-de4d-402a-8d8d-0f5d3a04f607\") " pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:09.616304 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.616267 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-cert\") pod \"odh-model-controller-76588b95-vt6vk\" (UID: \"a494c7e3-de4d-402a-8d8d-0f5d3a04f607\") " pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:09.616474 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.616337 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnzxs\" (UniqueName: \"kubernetes.io/projected/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-kube-api-access-mnzxs\") pod \"odh-model-controller-76588b95-vt6vk\" (UID: \"a494c7e3-de4d-402a-8d8d-0f5d3a04f607\") " pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:09.616474 ip-10-0-134-54 kubenswrapper[2560]: E0602 02:03:09.616431 2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 02:03:09.616544 ip-10-0-134-54 kubenswrapper[2560]: E0602 02:03:09.616514 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-cert podName:a494c7e3-de4d-402a-8d8d-0f5d3a04f607 nodeName:}" failed. No retries permitted until 2026-06-02 02:03:10.11649231 +0000 UTC m=+452.938900992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-cert") pod "odh-model-controller-76588b95-vt6vk" (UID: "a494c7e3-de4d-402a-8d8d-0f5d3a04f607") : secret "odh-model-controller-webhook-cert" not found Jun 02 02:03:09.629083 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:09.629045 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnzxs\" (UniqueName: \"kubernetes.io/projected/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-kube-api-access-mnzxs\") pod \"odh-model-controller-76588b95-vt6vk\" (UID: \"a494c7e3-de4d-402a-8d8d-0f5d3a04f607\") " pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:10.120153 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:10.120125 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-cert\") pod \"odh-model-controller-76588b95-vt6vk\" (UID: \"a494c7e3-de4d-402a-8d8d-0f5d3a04f607\") " pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:10.122720 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:10.122693 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a494c7e3-de4d-402a-8d8d-0f5d3a04f607-cert\") pod \"odh-model-controller-76588b95-vt6vk\" (UID: \"a494c7e3-de4d-402a-8d8d-0f5d3a04f607\") " pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:10.319456 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:10.319425 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:10.444132 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:10.444102 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-vt6vk"] Jun 02 02:03:10.446674 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:10.446638 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda494c7e3_de4d_402a_8d8d_0f5d3a04f607.slice/crio-a58c7005e41265dcff6cae130fdac6190f64c360724f3ca809b28bb6316f7302 WatchSource:0}: Error finding container a58c7005e41265dcff6cae130fdac6190f64c360724f3ca809b28bb6316f7302: Status 404 returned error can't find the container with id a58c7005e41265dcff6cae130fdac6190f64c360724f3ca809b28bb6316f7302 Jun 02 02:03:11.127277 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:11.127227 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-vt6vk" event={"ID":"a494c7e3-de4d-402a-8d8d-0f5d3a04f607","Type":"ContainerStarted","Data":"a58c7005e41265dcff6cae130fdac6190f64c360724f3ca809b28bb6316f7302"} Jun 02 02:03:14.140470 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:14.140425 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-vt6vk" event={"ID":"a494c7e3-de4d-402a-8d8d-0f5d3a04f607","Type":"ContainerStarted","Data":"eecacb7cfca195772bd5ddcd5be384b542adc899186cfb5f3958142b4e73bbfc"} Jun 02 02:03:14.140927 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:14.140573 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:14.158356 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:14.158299 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-vt6vk" podStartSLOduration=2.484707846 podStartE2EDuration="5.158282676s" podCreationTimestamp="2026-06-02 02:03:09 +0000 UTC" firstStartedPulling="2026-06-02 02:03:10.447942381 +0000 UTC m=+453.270351053" lastFinishedPulling="2026-06-02 02:03:13.121517195 +0000 UTC m=+455.943925883" observedRunningTime="2026-06-02 02:03:14.157036391 +0000 UTC m=+456.979445084" watchObservedRunningTime="2026-06-02 02:03:14.158282676 +0000 UTC m=+456.980691372" Jun 02 02:03:20.033247 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.033210 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5797d968-7h49l"] Jun 02 02:03:20.036205 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.036181 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.040873 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.040852 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 02:03:20.041976 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.041951 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 02:03:20.041976 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.041969 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nf7tj\"" Jun 02 02:03:20.042154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.042001 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 02:03:20.042154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.042004 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 02:03:20.059024 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.059001 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b"] Jun 02 02:03:20.061973 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.061950 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w"] Jun 02 02:03:20.062120 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.062104 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.065108 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.065089 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.070060 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.070036 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5797d968-7h49l"] Jun 02 02:03:20.075217 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.075195 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-j56rq\"" Jun 02 02:03:20.075478 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.075462 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 02:03:20.075619 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.075606 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 02:03:20.079403 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.079385 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jwd5w\"" Jun 02 02:03:20.112500 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.112466 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b"] Jun 02 02:03:20.114924 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.114905 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w"] Jun 02 02:03:20.197678 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.197649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12ac4e63-2315-411c-89d3-f9c9edc0627a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-lm57b\" (UID: \"12ac4e63-2315-411c-89d3-f9c9edc0627a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.197873 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.197696 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t667q\" (UniqueName: \"kubernetes.io/projected/c598cd7b-eb7e-47cc-b88c-292bf84644a2-kube-api-access-t667q\") pod \"kserve-controller-manager-7c99ffcdcd-gcc5w\" (UID: \"c598cd7b-eb7e-47cc-b88c-292bf84644a2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.197873 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.197781 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxzb4\" (UniqueName: \"kubernetes.io/projected/12ac4e63-2315-411c-89d3-f9c9edc0627a-kube-api-access-kxzb4\") pod \"llmisvc-controller-manager-c6b9847d7-lm57b\" (UID: \"12ac4e63-2315-411c-89d3-f9c9edc0627a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.197873 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.197837 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnzpm\" (UniqueName: \"kubernetes.io/projected/d989de2e-1a74-49e7-a8a6-feb573251cce-kube-api-access-dnzpm\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.197873 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.197867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d989de2e-1a74-49e7-a8a6-feb573251cce-tls-certs\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.198054 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.197931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d989de2e-1a74-49e7-a8a6-feb573251cce-tmp\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.198054 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.197993 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c598cd7b-eb7e-47cc-b88c-292bf84644a2-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gcc5w\" (UID: \"c598cd7b-eb7e-47cc-b88c-292bf84644a2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.242358 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.242326 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g"] Jun 02 02:03:20.245640 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.245618 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.250985 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.250966 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:03:20.251080 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.250973 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vbpkd\"" Jun 02 02:03:20.251080 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.251034 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:03:20.265619 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.265581 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g"] Jun 02 02:03:20.298582 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.298495 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c598cd7b-eb7e-47cc-b88c-292bf84644a2-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gcc5w\" (UID: \"c598cd7b-eb7e-47cc-b88c-292bf84644a2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.298582 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.298541 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12ac4e63-2315-411c-89d3-f9c9edc0627a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-lm57b\" (UID: \"12ac4e63-2315-411c-89d3-f9c9edc0627a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.298825 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.298582 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t667q\" (UniqueName: \"kubernetes.io/projected/c598cd7b-eb7e-47cc-b88c-292bf84644a2-kube-api-access-t667q\") pod \"kserve-controller-manager-7c99ffcdcd-gcc5w\" (UID: \"c598cd7b-eb7e-47cc-b88c-292bf84644a2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.298825 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.298615 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxzb4\" (UniqueName: \"kubernetes.io/projected/12ac4e63-2315-411c-89d3-f9c9edc0627a-kube-api-access-kxzb4\") pod \"llmisvc-controller-manager-c6b9847d7-lm57b\" (UID: \"12ac4e63-2315-411c-89d3-f9c9edc0627a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.298825 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.298648 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnzpm\" (UniqueName: \"kubernetes.io/projected/d989de2e-1a74-49e7-a8a6-feb573251cce-kube-api-access-dnzpm\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.298994 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.298851 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d989de2e-1a74-49e7-a8a6-feb573251cce-tls-certs\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.298994 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.298886 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d989de2e-1a74-49e7-a8a6-feb573251cce-tmp\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.301334 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.301304 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c598cd7b-eb7e-47cc-b88c-292bf84644a2-cert\") pod \"kserve-controller-manager-7c99ffcdcd-gcc5w\" (UID: \"c598cd7b-eb7e-47cc-b88c-292bf84644a2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.301477 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.301357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d989de2e-1a74-49e7-a8a6-feb573251cce-tls-certs\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.301477 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.301365 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12ac4e63-2315-411c-89d3-f9c9edc0627a-cert\") pod \"llmisvc-controller-manager-c6b9847d7-lm57b\" (UID: \"12ac4e63-2315-411c-89d3-f9c9edc0627a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.301594 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.301569 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d989de2e-1a74-49e7-a8a6-feb573251cce-tmp\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.314326 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.314298 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnzpm\" (UniqueName: \"kubernetes.io/projected/d989de2e-1a74-49e7-a8a6-feb573251cce-kube-api-access-dnzpm\") pod \"kube-auth-proxy-5f5797d968-7h49l\" (UID: \"d989de2e-1a74-49e7-a8a6-feb573251cce\") " pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.320138 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.320112 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxzb4\" (UniqueName: \"kubernetes.io/projected/12ac4e63-2315-411c-89d3-f9c9edc0627a-kube-api-access-kxzb4\") pod \"llmisvc-controller-manager-c6b9847d7-lm57b\" (UID: \"12ac4e63-2315-411c-89d3-f9c9edc0627a\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.325289 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.325269 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t667q\" (UniqueName: \"kubernetes.io/projected/c598cd7b-eb7e-47cc-b88c-292bf84644a2-kube-api-access-t667q\") pod \"kserve-controller-manager-7c99ffcdcd-gcc5w\" (UID: \"c598cd7b-eb7e-47cc-b88c-292bf84644a2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.345731 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.345693 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" Jun 02 02:03:20.374174 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.374141 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:20.380589 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.380551 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:20.401078 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.400446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.401078 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.400507 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4t9m\" (UniqueName: \"kubernetes.io/projected/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-kube-api-access-r4t9m\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.401078 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.400649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.501843 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.501308 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.501843 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.501398 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.501843 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.501440 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r4t9m\" (UniqueName: \"kubernetes.io/projected/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-kube-api-access-r4t9m\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.501843 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.501793 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.501843 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.501793 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.513139 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.512917 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f5797d968-7h49l"] Jun 02 02:03:20.515749 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:20.515713 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd989de2e_1a74_49e7_a8a6_feb573251cce.slice/crio-457948da74f0cd12ad3c6f0b8abee2ef313b78de1840f62f3796307c6a75ccee WatchSource:0}: Error finding container 457948da74f0cd12ad3c6f0b8abee2ef313b78de1840f62f3796307c6a75ccee: Status 404 returned error can't find the container with id 457948da74f0cd12ad3c6f0b8abee2ef313b78de1840f62f3796307c6a75ccee Jun 02 02:03:20.515894 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.515837 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4t9m\" (UniqueName: \"kubernetes.io/projected/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-kube-api-access-r4t9m\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.532554 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.532527 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b"] Jun 02 02:03:20.534390 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:20.534362 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod12ac4e63_2315_411c_89d3_f9c9edc0627a.slice/crio-d4533ef43f0cd3899469580d0d6e954d4db2bc0f48e769a5bf85551d853e999e WatchSource:0}: Error finding container d4533ef43f0cd3899469580d0d6e954d4db2bc0f48e769a5bf85551d853e999e: Status 404 returned error can't find the container with id d4533ef43f0cd3899469580d0d6e954d4db2bc0f48e769a5bf85551d853e999e Jun 02 02:03:20.552313 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.552284 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w"] Jun 02 02:03:20.553942 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:20.553914 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc598cd7b_eb7e_47cc_b88c_292bf84644a2.slice/crio-5bc6fbe14bd5bac28aa66a72e880c776b3ff0d860e102b11fd23cb7efa3809f4 WatchSource:0}: Error finding container 5bc6fbe14bd5bac28aa66a72e880c776b3ff0d860e102b11fd23cb7efa3809f4: Status 404 returned error can't find the container with id 5bc6fbe14bd5bac28aa66a72e880c776b3ff0d860e102b11fd23cb7efa3809f4 Jun 02 02:03:20.556561 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.556542 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:20.696342 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:20.696309 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g"] Jun 02 02:03:20.699921 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:20.699882 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba49fd08_85cd_47d8_891a_d6c9cabc1c1d.slice/crio-a3834f0ae012bd954760c7c5fe090d8fee1cddb7fd811f083cacada10e441938 WatchSource:0}: Error finding container a3834f0ae012bd954760c7c5fe090d8fee1cddb7fd811f083cacada10e441938: Status 404 returned error can't find the container with id a3834f0ae012bd954760c7c5fe090d8fee1cddb7fd811f083cacada10e441938 Jun 02 02:03:21.171263 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:21.171214 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" event={"ID":"c598cd7b-eb7e-47cc-b88c-292bf84644a2","Type":"ContainerStarted","Data":"5bc6fbe14bd5bac28aa66a72e880c776b3ff0d860e102b11fd23cb7efa3809f4"} Jun 02 02:03:21.174347 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:21.174315 2560 generic.go:358] "Generic (PLEG): container finished" podID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerID="86a722d19e62d1cfe124907a0530bfb8adf843f3efd8dc557ab70dc45d467505" exitCode=0 Jun 02 02:03:21.174534 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:21.174514 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" event={"ID":"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d","Type":"ContainerDied","Data":"86a722d19e62d1cfe124907a0530bfb8adf843f3efd8dc557ab70dc45d467505"} Jun 02 02:03:21.174637 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:21.174547 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" event={"ID":"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d","Type":"ContainerStarted","Data":"a3834f0ae012bd954760c7c5fe090d8fee1cddb7fd811f083cacada10e441938"} Jun 02 02:03:21.177543 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:21.177517 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" event={"ID":"12ac4e63-2315-411c-89d3-f9c9edc0627a","Type":"ContainerStarted","Data":"d4533ef43f0cd3899469580d0d6e954d4db2bc0f48e769a5bf85551d853e999e"} Jun 02 02:03:21.179133 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:21.179075 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" event={"ID":"d989de2e-1a74-49e7-a8a6-feb573251cce","Type":"ContainerStarted","Data":"457948da74f0cd12ad3c6f0b8abee2ef313b78de1840f62f3796307c6a75ccee"} Jun 02 02:03:25.146564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.146540 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-vt6vk" Jun 02 02:03:25.200343 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.200286 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" event={"ID":"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d","Type":"ContainerStarted","Data":"90751358acc0db396f14692e58d7cab4f21e22a898c6ac6d532e7089c05daed1"} Jun 02 02:03:25.202016 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.201983 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" event={"ID":"12ac4e63-2315-411c-89d3-f9c9edc0627a","Type":"ContainerStarted","Data":"354ff5f3a72963925141257f7fd8483033700ab4e6d4611c685b8143f590f6f0"} Jun 02 02:03:25.202499 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.202470 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:03:25.204452 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.204300 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" event={"ID":"d989de2e-1a74-49e7-a8a6-feb573251cce","Type":"ContainerStarted","Data":"dbf1bb5529168e698fb2fd17c79166f2173272506323d2127bf04924c8f40c2f"} Jun 02 02:03:25.206325 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.206244 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" event={"ID":"c598cd7b-eb7e-47cc-b88c-292bf84644a2","Type":"ContainerStarted","Data":"7eeeed66b4d5de6b83f65fbcb86abcf8613adafe18cc4838ecbc864125c63c95"} Jun 02 02:03:25.206539 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.206517 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:25.239619 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.239558 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" podStartSLOduration=1.786409814 podStartE2EDuration="6.239539263s" podCreationTimestamp="2026-06-02 02:03:19 +0000 UTC" firstStartedPulling="2026-06-02 02:03:20.535980278 +0000 UTC m=+463.358388949" lastFinishedPulling="2026-06-02 02:03:24.989109726 +0000 UTC m=+467.811518398" observedRunningTime="2026-06-02 02:03:25.238096831 +0000 UTC m=+468.060505524" watchObservedRunningTime="2026-06-02 02:03:25.239539263 +0000 UTC m=+468.061947960" Jun 02 02:03:25.256057 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:25.256002 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f5797d968-7h49l" podStartSLOduration=1.793003399 podStartE2EDuration="6.255985409s" podCreationTimestamp="2026-06-02 02:03:19 +0000 UTC" firstStartedPulling="2026-06-02 02:03:20.517709584 +0000 UTC m=+463.340118259" lastFinishedPulling="2026-06-02 02:03:24.980691585 +0000 UTC m=+467.803100269" observedRunningTime="2026-06-02 02:03:25.254229251 +0000 UTC m=+468.076637957" watchObservedRunningTime="2026-06-02 02:03:25.255985409 +0000 UTC m=+468.078394102" Jun 02 02:03:26.211037 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:26.211002 2560 generic.go:358] "Generic (PLEG): container finished" podID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerID="90751358acc0db396f14692e58d7cab4f21e22a898c6ac6d532e7089c05daed1" exitCode=0 Jun 02 02:03:26.211432 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:26.211104 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" event={"ID":"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d","Type":"ContainerDied","Data":"90751358acc0db396f14692e58d7cab4f21e22a898c6ac6d532e7089c05daed1"} Jun 02 02:03:26.232123 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:26.232072 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" podStartSLOduration=2.797608125 podStartE2EDuration="7.23203812s" podCreationTimestamp="2026-06-02 02:03:19 +0000 UTC" firstStartedPulling="2026-06-02 02:03:20.555168308 +0000 UTC m=+463.377576980" lastFinishedPulling="2026-06-02 02:03:24.98959829 +0000 UTC m=+467.812006975" observedRunningTime="2026-06-02 02:03:25.272304113 +0000 UTC m=+468.094712810" watchObservedRunningTime="2026-06-02 02:03:26.23203812 +0000 UTC m=+469.054446813" Jun 02 02:03:27.218618 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:27.218581 2560 generic.go:358] "Generic (PLEG): container finished" podID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerID="7bc02b372b079812ba902e161500894e31cb8843ad27e62b3ce725dcc55632e1" exitCode=0 Jun 02 02:03:27.219090 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:27.218668 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" event={"ID":"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d","Type":"ContainerDied","Data":"7bc02b372b079812ba902e161500894e31cb8843ad27e62b3ce725dcc55632e1"} Jun 02 02:03:28.352916 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.352893 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:28.377821 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.377787 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4t9m\" (UniqueName: \"kubernetes.io/projected/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-kube-api-access-r4t9m\") pod \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " Jun 02 02:03:28.377971 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.377837 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-util\") pod \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " Jun 02 02:03:28.377971 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.377872 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-bundle\") pod \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\" (UID: \"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d\") " Jun 02 02:03:28.378949 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.378915 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-bundle" (OuterVolumeSpecName: "bundle") pod "ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" (UID: "ba49fd08-85cd-47d8-891a-d6c9cabc1c1d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:03:28.380010 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.379981 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-kube-api-access-r4t9m" (OuterVolumeSpecName: "kube-api-access-r4t9m") pod "ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" (UID: "ba49fd08-85cd-47d8-891a-d6c9cabc1c1d"). InnerVolumeSpecName "kube-api-access-r4t9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:03:28.382664 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.382643 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-util" (OuterVolumeSpecName: "util") pod "ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" (UID: "ba49fd08-85cd-47d8-891a-d6c9cabc1c1d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:03:28.479360 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.479275 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4t9m\" (UniqueName: \"kubernetes.io/projected/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-kube-api-access-r4t9m\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:03:28.479360 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.479316 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:03:28.479360 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:28.479332 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba49fd08-85cd-47d8-891a-d6c9cabc1c1d-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:03:29.226911 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:29.226873 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" event={"ID":"ba49fd08-85cd-47d8-891a-d6c9cabc1c1d","Type":"ContainerDied","Data":"a3834f0ae012bd954760c7c5fe090d8fee1cddb7fd811f083cacada10e441938"} Jun 02 02:03:29.226911 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:29.226912 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3834f0ae012bd954760c7c5fe090d8fee1cddb7fd811f083cacada10e441938" Jun 02 02:03:29.227162 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:29.226979 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835dvw6g" Jun 02 02:03:34.933674 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.933633 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2"] Jun 02 02:03:34.934073 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.933939 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerName="util" Jun 02 02:03:34.934073 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.933954 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerName="util" Jun 02 02:03:34.934073 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.933970 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerName="pull" Jun 02 02:03:34.934073 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.933976 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerName="pull" Jun 02 02:03:34.934073 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.933983 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerName="extract" Jun 02 02:03:34.934073 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.933988 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerName="extract" Jun 02 02:03:34.934073 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.934040 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ba49fd08-85cd-47d8-891a-d6c9cabc1c1d" containerName="extract" Jun 02 02:03:34.938184 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.938162 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:34.941518 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.941491 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vbpkd\"" Jun 02 02:03:34.942192 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.942175 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:03:34.945027 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.944997 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:03:34.960781 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:34.960714 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2"] Jun 02 02:03:35.028704 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.028673 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glgg4\" (UniqueName: \"kubernetes.io/projected/462ae664-79fe-4c32-85cc-1d064a7c20c5-kube-api-access-glgg4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.028704 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.028715 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.028926 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.028863 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.130003 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.129960 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.130174 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.130028 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-glgg4\" (UniqueName: \"kubernetes.io/projected/462ae664-79fe-4c32-85cc-1d064a7c20c5-kube-api-access-glgg4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.130174 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.130058 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.130445 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.130422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.130510 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.130422 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.139171 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.139142 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glgg4\" (UniqueName: \"kubernetes.io/projected/462ae664-79fe-4c32-85cc-1d064a7c20c5-kube-api-access-glgg4\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.247981 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.247878 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:35.385395 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.385369 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2"] Jun 02 02:03:35.387541 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:35.387514 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462ae664_79fe_4c32_85cc_1d064a7c20c5.slice/crio-33cdfe88aaa315a964eb2d2322557c70174f3bf2a9df142ef9740f4f694c3901 WatchSource:0}: Error finding container 33cdfe88aaa315a964eb2d2322557c70174f3bf2a9df142ef9740f4f694c3901: Status 404 returned error can't find the container with id 33cdfe88aaa315a964eb2d2322557c70174f3bf2a9df142ef9740f4f694c3901 Jun 02 02:03:35.696917 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.696885 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-765cfc44cf-cm5tb"] Jun 02 02:03:35.700507 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.700484 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:35.705004 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.704964 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ppnnh\"" Jun 02 02:03:35.705144 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.705079 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 02:03:35.712981 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.712942 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-765cfc44cf-cm5tb"] Jun 02 02:03:35.735099 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.735062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5b32ed88-66c2-4fd0-8ba4-9a6e181af401-redirect-config\") pod \"dashboard-redirect-765cfc44cf-cm5tb\" (UID: \"5b32ed88-66c2-4fd0-8ba4-9a6e181af401\") " pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:35.735237 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.735142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27kp2\" (UniqueName: \"kubernetes.io/projected/5b32ed88-66c2-4fd0-8ba4-9a6e181af401-kube-api-access-27kp2\") pod \"dashboard-redirect-765cfc44cf-cm5tb\" (UID: \"5b32ed88-66c2-4fd0-8ba4-9a6e181af401\") " pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:35.835986 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.835933 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5b32ed88-66c2-4fd0-8ba4-9a6e181af401-redirect-config\") pod \"dashboard-redirect-765cfc44cf-cm5tb\" (UID: \"5b32ed88-66c2-4fd0-8ba4-9a6e181af401\") " pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:35.836137 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.836000 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27kp2\" (UniqueName: \"kubernetes.io/projected/5b32ed88-66c2-4fd0-8ba4-9a6e181af401-kube-api-access-27kp2\") pod \"dashboard-redirect-765cfc44cf-cm5tb\" (UID: \"5b32ed88-66c2-4fd0-8ba4-9a6e181af401\") " pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:35.836631 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.836612 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5b32ed88-66c2-4fd0-8ba4-9a6e181af401-redirect-config\") pod \"dashboard-redirect-765cfc44cf-cm5tb\" (UID: \"5b32ed88-66c2-4fd0-8ba4-9a6e181af401\") " pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:35.854106 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:35.854074 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27kp2\" (UniqueName: \"kubernetes.io/projected/5b32ed88-66c2-4fd0-8ba4-9a6e181af401-kube-api-access-27kp2\") pod \"dashboard-redirect-765cfc44cf-cm5tb\" (UID: \"5b32ed88-66c2-4fd0-8ba4-9a6e181af401\") " pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:36.013638 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.013553 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" Jun 02 02:03:36.028124 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.028086 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf"] Jun 02 02:03:36.032550 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.032524 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.036839 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.036778 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 02:03:36.036982 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.036881 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-2hdm2\"" Jun 02 02:03:36.037223 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.037200 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 02:03:36.046268 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.046243 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf"] Jun 02 02:03:36.137202 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.137175 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/60f7feca-4a8d-468e-b8c0-ebe9b48c651a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lpcdf\" (UID: \"60f7feca-4a8d-468e-b8c0-ebe9b48c651a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.137356 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.137208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr294\" (UniqueName: \"kubernetes.io/projected/60f7feca-4a8d-468e-b8c0-ebe9b48c651a-kube-api-access-rr294\") pod \"servicemesh-operator3-55f49c5f94-lpcdf\" (UID: \"60f7feca-4a8d-468e-b8c0-ebe9b48c651a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.148557 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.148533 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-765cfc44cf-cm5tb"] Jun 02 02:03:36.151095 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:36.151064 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b32ed88_66c2_4fd0_8ba4_9a6e181af401.slice/crio-26302141475cdfa32ab7a5666f1a7490c610e533f1fca3c21267a583b62e1ff1 WatchSource:0}: Error finding container 26302141475cdfa32ab7a5666f1a7490c610e533f1fca3c21267a583b62e1ff1: Status 404 returned error can't find the container with id 26302141475cdfa32ab7a5666f1a7490c610e533f1fca3c21267a583b62e1ff1 Jun 02 02:03:36.237963 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.237927 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/60f7feca-4a8d-468e-b8c0-ebe9b48c651a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lpcdf\" (UID: \"60f7feca-4a8d-468e-b8c0-ebe9b48c651a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.237963 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.237964 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rr294\" (UniqueName: \"kubernetes.io/projected/60f7feca-4a8d-468e-b8c0-ebe9b48c651a-kube-api-access-rr294\") pod \"servicemesh-operator3-55f49c5f94-lpcdf\" (UID: \"60f7feca-4a8d-468e-b8c0-ebe9b48c651a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.240620 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.240590 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/60f7feca-4a8d-468e-b8c0-ebe9b48c651a-operator-config\") pod \"servicemesh-operator3-55f49c5f94-lpcdf\" (UID: \"60f7feca-4a8d-468e-b8c0-ebe9b48c651a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.248075 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.248054 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr294\" (UniqueName: \"kubernetes.io/projected/60f7feca-4a8d-468e-b8c0-ebe9b48c651a-kube-api-access-rr294\") pod \"servicemesh-operator3-55f49c5f94-lpcdf\" (UID: \"60f7feca-4a8d-468e-b8c0-ebe9b48c651a\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.255888 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.255860 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" event={"ID":"5b32ed88-66c2-4fd0-8ba4-9a6e181af401","Type":"ContainerStarted","Data":"26302141475cdfa32ab7a5666f1a7490c610e533f1fca3c21267a583b62e1ff1"} Jun 02 02:03:36.257406 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.257377 2560 generic.go:358] "Generic (PLEG): container finished" podID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerID="217587d507b9f04139a4491ceec0397eb0544bb090fa8333cc8a2126029e528c" exitCode=0 Jun 02 02:03:36.257512 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.257445 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" event={"ID":"462ae664-79fe-4c32-85cc-1d064a7c20c5","Type":"ContainerDied","Data":"217587d507b9f04139a4491ceec0397eb0544bb090fa8333cc8a2126029e528c"} Jun 02 02:03:36.257512 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.257470 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" event={"ID":"462ae664-79fe-4c32-85cc-1d064a7c20c5","Type":"ContainerStarted","Data":"33cdfe88aaa315a964eb2d2322557c70174f3bf2a9df142ef9740f4f694c3901"} Jun 02 02:03:36.342789 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.342745 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:36.496810 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:36.496783 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf"] Jun 02 02:03:36.499062 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:36.499029 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f7feca_4a8d_468e_b8c0_ebe9b48c651a.slice/crio-6243bf59cb669ed212327c34b97bf644c102852663eef75dae8f363d6e2cb2ab WatchSource:0}: Error finding container 6243bf59cb669ed212327c34b97bf644c102852663eef75dae8f363d6e2cb2ab: Status 404 returned error can't find the container with id 6243bf59cb669ed212327c34b97bf644c102852663eef75dae8f363d6e2cb2ab Jun 02 02:03:37.263427 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:37.263378 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" event={"ID":"60f7feca-4a8d-468e-b8c0-ebe9b48c651a","Type":"ContainerStarted","Data":"6243bf59cb669ed212327c34b97bf644c102852663eef75dae8f363d6e2cb2ab"} Jun 02 02:03:38.272462 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:38.272421 2560 generic.go:358] "Generic (PLEG): container finished" podID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerID="b7e71029a4b97e8b859932bb5d509fe51352456a9fbb3403983d5876001c195d" exitCode=0 Jun 02 02:03:38.272864 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:38.272532 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" event={"ID":"462ae664-79fe-4c32-85cc-1d064a7c20c5","Type":"ContainerDied","Data":"b7e71029a4b97e8b859932bb5d509fe51352456a9fbb3403983d5876001c195d"} Jun 02 02:03:40.281146 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:40.281103 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" event={"ID":"5b32ed88-66c2-4fd0-8ba4-9a6e181af401","Type":"ContainerStarted","Data":"3b5b0e0b43f3fe7c7aa4d2cde8d80936878f50e1583dee5f5d1a648e8902726e"} Jun 02 02:03:40.284174 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:40.284145 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" event={"ID":"462ae664-79fe-4c32-85cc-1d064a7c20c5","Type":"ContainerStarted","Data":"72828aeee378c4483337525e784c51d888e4030edaf5187475a3b17855840c74"} Jun 02 02:03:40.286802 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:40.286752 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" event={"ID":"60f7feca-4a8d-468e-b8c0-ebe9b48c651a","Type":"ContainerStarted","Data":"4dffd09fd14a5a12b1054923bdde57c20169086b1adcfead6f8a73c29aac5aad"} Jun 02 02:03:40.286926 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:40.286905 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:40.299005 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:40.298953 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-765cfc44cf-cm5tb" podStartSLOduration=1.286048987 podStartE2EDuration="5.29893813s" podCreationTimestamp="2026-06-02 02:03:35 +0000 UTC" firstStartedPulling="2026-06-02 02:03:36.152616676 +0000 UTC m=+478.975025352" lastFinishedPulling="2026-06-02 02:03:40.165505817 +0000 UTC m=+482.987914495" observedRunningTime="2026-06-02 02:03:40.297086612 +0000 UTC m=+483.119495298" watchObservedRunningTime="2026-06-02 02:03:40.29893813 +0000 UTC m=+483.121346845" Jun 02 02:03:40.316981 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:40.316722 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" podStartSLOduration=0.650356827 podStartE2EDuration="4.316705985s" podCreationTimestamp="2026-06-02 02:03:36 +0000 UTC" firstStartedPulling="2026-06-02 02:03:36.501622075 +0000 UTC m=+479.324030747" lastFinishedPulling="2026-06-02 02:03:40.167971229 +0000 UTC m=+482.990379905" observedRunningTime="2026-06-02 02:03:40.315717511 +0000 UTC m=+483.138126206" watchObservedRunningTime="2026-06-02 02:03:40.316705985 +0000 UTC m=+483.139114680" Jun 02 02:03:40.335389 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:40.335019 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" podStartSLOduration=4.692095389 podStartE2EDuration="6.334999391s" podCreationTimestamp="2026-06-02 02:03:34 +0000 UTC" firstStartedPulling="2026-06-02 02:03:36.258983868 +0000 UTC m=+479.081392543" lastFinishedPulling="2026-06-02 02:03:37.901887873 +0000 UTC m=+480.724296545" observedRunningTime="2026-06-02 02:03:40.334234042 +0000 UTC m=+483.156642738" watchObservedRunningTime="2026-06-02 02:03:40.334999391 +0000 UTC m=+483.157408086" Jun 02 02:03:41.291524 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:41.291493 2560 generic.go:358] "Generic (PLEG): container finished" podID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerID="72828aeee378c4483337525e784c51d888e4030edaf5187475a3b17855840c74" exitCode=0 Jun 02 02:03:41.291960 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:41.291574 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" event={"ID":"462ae664-79fe-4c32-85cc-1d064a7c20c5","Type":"ContainerDied","Data":"72828aeee378c4483337525e784c51d888e4030edaf5187475a3b17855840c74"} Jun 02 02:03:42.414351 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.414328 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:42.487607 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.487577 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glgg4\" (UniqueName: \"kubernetes.io/projected/462ae664-79fe-4c32-85cc-1d064a7c20c5-kube-api-access-glgg4\") pod \"462ae664-79fe-4c32-85cc-1d064a7c20c5\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " Jun 02 02:03:42.487607 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.487620 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-bundle\") pod \"462ae664-79fe-4c32-85cc-1d064a7c20c5\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " Jun 02 02:03:42.487883 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.487686 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-util\") pod \"462ae664-79fe-4c32-85cc-1d064a7c20c5\" (UID: \"462ae664-79fe-4c32-85cc-1d064a7c20c5\") " Jun 02 02:03:42.488821 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.488794 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-bundle" (OuterVolumeSpecName: "bundle") pod "462ae664-79fe-4c32-85cc-1d064a7c20c5" (UID: "462ae664-79fe-4c32-85cc-1d064a7c20c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:03:42.489787 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.489749 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/462ae664-79fe-4c32-85cc-1d064a7c20c5-kube-api-access-glgg4" (OuterVolumeSpecName: "kube-api-access-glgg4") pod "462ae664-79fe-4c32-85cc-1d064a7c20c5" (UID: "462ae664-79fe-4c32-85cc-1d064a7c20c5"). InnerVolumeSpecName "kube-api-access-glgg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:03:42.492773 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.492725 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-util" (OuterVolumeSpecName: "util") pod "462ae664-79fe-4c32-85cc-1d064a7c20c5" (UID: "462ae664-79fe-4c32-85cc-1d064a7c20c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:03:42.588625 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.588542 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glgg4\" (UniqueName: \"kubernetes.io/projected/462ae664-79fe-4c32-85cc-1d064a7c20c5-kube-api-access-glgg4\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:03:42.588625 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.588572 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:03:42.588625 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:42.588583 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462ae664-79fe-4c32-85cc-1d064a7c20c5-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:03:43.299384 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:43.299354 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" event={"ID":"462ae664-79fe-4c32-85cc-1d064a7c20c5","Type":"ContainerDied","Data":"33cdfe88aaa315a964eb2d2322557c70174f3bf2a9df142ef9740f4f694c3901"} Jun 02 02:03:43.299384 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:43.299387 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33cdfe88aaa315a964eb2d2322557c70174f3bf2a9df142ef9740f4f694c3901" Jun 02 02:03:43.299664 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:43.299400 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762azxbw2" Jun 02 02:03:46.427585 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427540 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw"] Jun 02 02:03:46.428072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427889 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerName="util" Jun 02 02:03:46.428072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427903 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerName="util" Jun 02 02:03:46.428072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427912 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerName="pull" Jun 02 02:03:46.428072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427917 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerName="pull" Jun 02 02:03:46.428072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427924 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerName="extract" Jun 02 02:03:46.428072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427930 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerName="extract" Jun 02 02:03:46.428072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.427980 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="462ae664-79fe-4c32-85cc-1d064a7c20c5" containerName="extract" Jun 02 02:03:46.432669 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.432647 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.435215 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.435189 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 02:03:46.435379 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.435210 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 02:03:46.435379 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.435202 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 02:03:46.435379 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.435219 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2znmf\"" Jun 02 02:03:46.435540 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.435412 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 02:03:46.441830 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.441676 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw"] Jun 02 02:03:46.516499 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.516461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-token\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.516668 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.516509 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.516668 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.516613 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwbjw\" (UniqueName: \"kubernetes.io/projected/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-kube-api-access-gwbjw\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.516668 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.516641 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-local-certs\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.516668 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.516659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.516830 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.516718 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.516830 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.516753 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-cacerts\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.617554 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.617515 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.617745 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.617575 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-cacerts\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.617745 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.617601 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-token\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.617745 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.617625 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.617745 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.617692 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbjw\" (UniqueName: \"kubernetes.io/projected/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-kube-api-access-gwbjw\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.617745 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.617719 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-local-certs\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.617745 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.617741 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.618415 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.618391 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.620140 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.620105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-cacerts\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.620428 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.620410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-local-certs\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.620485 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.620473 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.620809 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.620789 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.625604 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.625579 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-istio-token\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.625721 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.625702 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwbjw\" (UniqueName: \"kubernetes.io/projected/5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990-kube-api-access-gwbjw\") pod \"istiod-openshift-gateway-798958bb55-c7plw\" (UID: \"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.744559 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.744476 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:46.883114 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:46.883089 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw"] Jun 02 02:03:46.885567 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:03:46.885534 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7f7663_2b7e_4cdf_98bb_27fa3e5f1990.slice/crio-c10f4d88853c3c581635af81b2ba67d028126c046eb8589374426bfc83e111f4 WatchSource:0}: Error finding container c10f4d88853c3c581635af81b2ba67d028126c046eb8589374426bfc83e111f4: Status 404 returned error can't find the container with id c10f4d88853c3c581635af81b2ba67d028126c046eb8589374426bfc83e111f4 Jun 02 02:03:47.320481 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:47.320441 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" event={"ID":"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990","Type":"ContainerStarted","Data":"c10f4d88853c3c581635af81b2ba67d028126c046eb8589374426bfc83e111f4"} Jun 02 02:03:50.307896 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:50.307831 2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 02:03:50.307896 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:50.307895 2560 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 02 02:03:51.294739 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:51.294657 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-lpcdf" Jun 02 02:03:51.338571 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:51.338534 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" event={"ID":"5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990","Type":"ContainerStarted","Data":"c4dfc424a727d53f92edeb98fcb8fcf7aa7fdc2e23e6ca43c694b7eb1512401a"} Jun 02 02:03:51.339106 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:51.338801 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:51.340748 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:51.340711 2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-c7plw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 02 02:03:51.341009 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:51.340969 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" podUID="5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 02:03:51.378730 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:51.378666 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" podStartSLOduration=1.958696911 podStartE2EDuration="5.378646482s" podCreationTimestamp="2026-06-02 02:03:46 +0000 UTC" firstStartedPulling="2026-06-02 02:03:46.887639186 +0000 UTC m=+489.710047858" lastFinishedPulling="2026-06-02 02:03:50.307588753 +0000 UTC m=+493.129997429" observedRunningTime="2026-06-02 02:03:51.378409431 +0000 UTC m=+494.200818135" watchObservedRunningTime="2026-06-02 02:03:51.378646482 +0000 UTC m=+494.201055189" Jun 02 02:03:52.343391 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:52.343363 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-c7plw" Jun 02 02:03:56.216567 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:56.216535 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-gcc5w" Jun 02 02:03:57.221057 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:03:57.221026 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-lm57b" Jun 02 02:04:25.701224 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.701142 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg"] Jun 02 02:04:25.704626 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.704609 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.707157 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.707140 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 02:04:25.707238 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.707160 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 02:04:25.708094 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.708079 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-glzsz\"" Jun 02 02:04:25.715848 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.715823 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg"] Jun 02 02:04:25.751808 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.751755 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.751943 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.751823 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.751943 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.751877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nrb4\" (UniqueName: \"kubernetes.io/projected/5f2534ae-be21-4085-ab14-ba264e0e6fad-kube-api-access-7nrb4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.852482 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.852445 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nrb4\" (UniqueName: \"kubernetes.io/projected/5f2534ae-be21-4085-ab14-ba264e0e6fad-kube-api-access-7nrb4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.852660 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.852487 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.852660 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.852616 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.852832 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.852814 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.852944 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.852927 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:25.862993 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:25.862967 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nrb4\" (UniqueName: \"kubernetes.io/projected/5f2534ae-be21-4085-ab14-ba264e0e6fad-kube-api-access-7nrb4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:26.013493 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.013394 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:26.137577 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.137548 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg"] Jun 02 02:04:26.141199 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:04:26.141169 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2534ae_be21_4085_ab14_ba264e0e6fad.slice/crio-464f33d0a79c34768a4987396ebc06e39d8729dc581dca458cf2e6e5c6fe0995 WatchSource:0}: Error finding container 464f33d0a79c34768a4987396ebc06e39d8729dc581dca458cf2e6e5c6fe0995: Status 404 returned error can't find the container with id 464f33d0a79c34768a4987396ebc06e39d8729dc581dca458cf2e6e5c6fe0995 Jun 02 02:04:26.457699 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.457666 2560 generic.go:358] "Generic (PLEG): container finished" podID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerID="340bab4e0c30988b9ca886c181a64a27ae1d201950adc57662a789f342344ab1" exitCode=0 Jun 02 02:04:26.457898 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.457745 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" event={"ID":"5f2534ae-be21-4085-ab14-ba264e0e6fad","Type":"ContainerDied","Data":"340bab4e0c30988b9ca886c181a64a27ae1d201950adc57662a789f342344ab1"} Jun 02 02:04:26.457898 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.457794 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" event={"ID":"5f2534ae-be21-4085-ab14-ba264e0e6fad","Type":"ContainerStarted","Data":"464f33d0a79c34768a4987396ebc06e39d8729dc581dca458cf2e6e5c6fe0995"} Jun 02 02:04:26.496069 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.496038 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9"] Jun 02 02:04:26.499273 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.499256 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.507824 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.507798 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9"] Jun 02 02:04:26.557658 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.557625 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.557843 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.557679 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj9vb\" (UniqueName: \"kubernetes.io/projected/ff08c9ad-c99a-40cb-8165-3019927e7c05-kube-api-access-lj9vb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.557896 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.557843 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.658454 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.658411 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lj9vb\" (UniqueName: \"kubernetes.io/projected/ff08c9ad-c99a-40cb-8165-3019927e7c05-kube-api-access-lj9vb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.658600 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.658499 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.658600 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.658521 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.658887 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.658870 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.658943 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.658924 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.667199 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.667171 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj9vb\" (UniqueName: \"kubernetes.io/projected/ff08c9ad-c99a-40cb-8165-3019927e7c05-kube-api-access-lj9vb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.808901 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.808865 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:26.938341 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:26.938189 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9"] Jun 02 02:04:26.940806 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:04:26.940780 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff08c9ad_c99a_40cb_8165_3019927e7c05.slice/crio-885e56bbc5df9688c0acdb0c49a9b451589f2257b97630f916d55d5a1672fcff WatchSource:0}: Error finding container 885e56bbc5df9688c0acdb0c49a9b451589f2257b97630f916d55d5a1672fcff: Status 404 returned error can't find the container with id 885e56bbc5df9688c0acdb0c49a9b451589f2257b97630f916d55d5a1672fcff Jun 02 02:04:27.101131 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.101060 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch"] Jun 02 02:04:27.104849 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.104830 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.112628 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.112606 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch"] Jun 02 02:04:27.162269 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.162244 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.162360 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.162278 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2klx\" (UniqueName: \"kubernetes.io/projected/3afab1ea-8bda-4453-9361-3835115b7e3e-kube-api-access-x2klx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.162360 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.162306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.263483 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.263448 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.263483 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.263486 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2klx\" (UniqueName: \"kubernetes.io/projected/3afab1ea-8bda-4453-9361-3835115b7e3e-kube-api-access-x2klx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.263696 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.263530 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.263883 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.263862 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.263883 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.263880 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.272664 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.272637 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2klx\" (UniqueName: \"kubernetes.io/projected/3afab1ea-8bda-4453-9361-3835115b7e3e-kube-api-access-x2klx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.415803 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.415698 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:27.464676 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.464240 2560 generic.go:358] "Generic (PLEG): container finished" podID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerID="eb577405848a299813b06f21b96a1d99251a582465fbd2cfa02d3050147fb27a" exitCode=0 Jun 02 02:04:27.464676 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.464399 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" event={"ID":"ff08c9ad-c99a-40cb-8165-3019927e7c05","Type":"ContainerDied","Data":"eb577405848a299813b06f21b96a1d99251a582465fbd2cfa02d3050147fb27a"} Jun 02 02:04:27.464676 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.464434 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" event={"ID":"ff08c9ad-c99a-40cb-8165-3019927e7c05","Type":"ContainerStarted","Data":"885e56bbc5df9688c0acdb0c49a9b451589f2257b97630f916d55d5a1672fcff"} Jun 02 02:04:27.467342 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.467277 2560 generic.go:358] "Generic (PLEG): container finished" podID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerID="76f27a1f921d8c9aa9be1a1e59a41b46a926075e11851aa844324b0a31fb04ba" exitCode=0 Jun 02 02:04:27.467342 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.467329 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" event={"ID":"5f2534ae-be21-4085-ab14-ba264e0e6fad","Type":"ContainerDied","Data":"76f27a1f921d8c9aa9be1a1e59a41b46a926075e11851aa844324b0a31fb04ba"} Jun 02 02:04:27.504579 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.504040 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq"] Jun 02 02:04:27.510897 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.510875 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.514829 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.514806 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq"] Jun 02 02:04:27.555315 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.555288 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch"] Jun 02 02:04:27.557067 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:04:27.557037 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afab1ea_8bda_4453_9361_3835115b7e3e.slice/crio-fdbf1a50ae55317e9fd4df05444673026f20b0516f8eeb33c5f78c8a21e11955 WatchSource:0}: Error finding container fdbf1a50ae55317e9fd4df05444673026f20b0516f8eeb33c5f78c8a21e11955: Status 404 returned error can't find the container with id fdbf1a50ae55317e9fd4df05444673026f20b0516f8eeb33c5f78c8a21e11955 Jun 02 02:04:27.566523 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.566496 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r546d\" (UniqueName: \"kubernetes.io/projected/eafb467a-7a13-4ac6-86d7-52006d587241-kube-api-access-r546d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.566629 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.566611 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.566691 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.566678 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.667751 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.667320 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.667751 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.667466 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r546d\" (UniqueName: \"kubernetes.io/projected/eafb467a-7a13-4ac6-86d7-52006d587241-kube-api-access-r546d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.667751 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.667528 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.668105 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.668070 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.668282 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.668257 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.678314 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.678287 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r546d\" (UniqueName: \"kubernetes.io/projected/eafb467a-7a13-4ac6-86d7-52006d587241-kube-api-access-r546d\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.828185 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.828148 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:27.959049 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:27.958149 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq"] Jun 02 02:04:27.961812 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:04:27.961781 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeafb467a_7a13_4ac6_86d7_52006d587241.slice/crio-1eb182822754f632de9e335f87cffc22ae0b6af7d125e8fbc9c658d3178f641c WatchSource:0}: Error finding container 1eb182822754f632de9e335f87cffc22ae0b6af7d125e8fbc9c658d3178f641c: Status 404 returned error can't find the container with id 1eb182822754f632de9e335f87cffc22ae0b6af7d125e8fbc9c658d3178f641c Jun 02 02:04:28.471772 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.471723 2560 generic.go:358] "Generic (PLEG): container finished" podID="eafb467a-7a13-4ac6-86d7-52006d587241" containerID="7af08fb78a6e26d69102084463ea81266364a11ec45fbeff41e34b4e2f590b1f" exitCode=0 Jun 02 02:04:28.471927 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.471818 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" event={"ID":"eafb467a-7a13-4ac6-86d7-52006d587241","Type":"ContainerDied","Data":"7af08fb78a6e26d69102084463ea81266364a11ec45fbeff41e34b4e2f590b1f"} Jun 02 02:04:28.471927 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.471860 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" event={"ID":"eafb467a-7a13-4ac6-86d7-52006d587241","Type":"ContainerStarted","Data":"1eb182822754f632de9e335f87cffc22ae0b6af7d125e8fbc9c658d3178f641c"} Jun 02 02:04:28.473702 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.473679 2560 generic.go:358] "Generic (PLEG): container finished" podID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerID="4ae823aed6d3b5fd21a0470c4432d620ee3bd4496c9db1c455d202b4fd320d31" exitCode=0 Jun 02 02:04:28.473822 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.473752 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" event={"ID":"ff08c9ad-c99a-40cb-8165-3019927e7c05","Type":"ContainerDied","Data":"4ae823aed6d3b5fd21a0470c4432d620ee3bd4496c9db1c455d202b4fd320d31"} Jun 02 02:04:28.475138 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.475112 2560 generic.go:358] "Generic (PLEG): container finished" podID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerID="808cae0e5e1e7155c2be43f35681b0bd8401228dfc523c27d2e108f7ec67c597" exitCode=0 Jun 02 02:04:28.475263 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.475188 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" event={"ID":"3afab1ea-8bda-4453-9361-3835115b7e3e","Type":"ContainerDied","Data":"808cae0e5e1e7155c2be43f35681b0bd8401228dfc523c27d2e108f7ec67c597"} Jun 02 02:04:28.475263 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.475231 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" event={"ID":"3afab1ea-8bda-4453-9361-3835115b7e3e","Type":"ContainerStarted","Data":"fdbf1a50ae55317e9fd4df05444673026f20b0516f8eeb33c5f78c8a21e11955"} Jun 02 02:04:28.477566 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.477544 2560 generic.go:358] "Generic (PLEG): container finished" podID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerID="c419a31d721d201743e63a439d38e8a700fb76d6e5af71f4da168be8716d52d0" exitCode=0 Jun 02 02:04:28.477663 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:28.477582 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" event={"ID":"5f2534ae-be21-4085-ab14-ba264e0e6fad","Type":"ContainerDied","Data":"c419a31d721d201743e63a439d38e8a700fb76d6e5af71f4da168be8716d52d0"} Jun 02 02:04:29.482124 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.482095 2560 generic.go:358] "Generic (PLEG): container finished" podID="eafb467a-7a13-4ac6-86d7-52006d587241" containerID="641f7d1ad19eb95f3d57e25c94b18d3a0ec11661311ee4a1f678e5205088accd" exitCode=0 Jun 02 02:04:29.482523 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.482164 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" event={"ID":"eafb467a-7a13-4ac6-86d7-52006d587241","Type":"ContainerDied","Data":"641f7d1ad19eb95f3d57e25c94b18d3a0ec11661311ee4a1f678e5205088accd"} Jun 02 02:04:29.484072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.484020 2560 generic.go:358] "Generic (PLEG): container finished" podID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerID="96a0375aebe7eab1f767da60a9ac87212a964d14771565850444b5b011d74386" exitCode=0 Jun 02 02:04:29.484126 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.484079 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" event={"ID":"ff08c9ad-c99a-40cb-8165-3019927e7c05","Type":"ContainerDied","Data":"96a0375aebe7eab1f767da60a9ac87212a964d14771565850444b5b011d74386"} Jun 02 02:04:29.485705 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.485651 2560 generic.go:358] "Generic (PLEG): container finished" podID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerID="20de84a56fca3aaf7a0fe9d3748d2b5351755d0a3ff2bdcbc324249a8709aefe" exitCode=0 Jun 02 02:04:29.485812 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.485696 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" event={"ID":"3afab1ea-8bda-4453-9361-3835115b7e3e","Type":"ContainerDied","Data":"20de84a56fca3aaf7a0fe9d3748d2b5351755d0a3ff2bdcbc324249a8709aefe"} Jun 02 02:04:29.615249 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.615220 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:29.684655 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.684629 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-bundle\") pod \"5f2534ae-be21-4085-ab14-ba264e0e6fad\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " Jun 02 02:04:29.684786 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.684692 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-util\") pod \"5f2534ae-be21-4085-ab14-ba264e0e6fad\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " Jun 02 02:04:29.684786 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.684726 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nrb4\" (UniqueName: \"kubernetes.io/projected/5f2534ae-be21-4085-ab14-ba264e0e6fad-kube-api-access-7nrb4\") pod \"5f2534ae-be21-4085-ab14-ba264e0e6fad\" (UID: \"5f2534ae-be21-4085-ab14-ba264e0e6fad\") " Jun 02 02:04:29.685298 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.685271 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-bundle" (OuterVolumeSpecName: "bundle") pod "5f2534ae-be21-4085-ab14-ba264e0e6fad" (UID: "5f2534ae-be21-4085-ab14-ba264e0e6fad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:29.687021 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.686999 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2534ae-be21-4085-ab14-ba264e0e6fad-kube-api-access-7nrb4" (OuterVolumeSpecName: "kube-api-access-7nrb4") pod "5f2534ae-be21-4085-ab14-ba264e0e6fad" (UID: "5f2534ae-be21-4085-ab14-ba264e0e6fad"). InnerVolumeSpecName "kube-api-access-7nrb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:04:29.690225 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.690201 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-util" (OuterVolumeSpecName: "util") pod "5f2534ae-be21-4085-ab14-ba264e0e6fad" (UID: "5f2534ae-be21-4085-ab14-ba264e0e6fad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:29.785751 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.785720 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:29.785751 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.785750 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nrb4\" (UniqueName: \"kubernetes.io/projected/5f2534ae-be21-4085-ab14-ba264e0e6fad-kube-api-access-7nrb4\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:29.785945 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:29.785779 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f2534ae-be21-4085-ab14-ba264e0e6fad-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:30.491455 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.491427 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" Jun 02 02:04:30.491880 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.491426 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg" event={"ID":"5f2534ae-be21-4085-ab14-ba264e0e6fad","Type":"ContainerDied","Data":"464f33d0a79c34768a4987396ebc06e39d8729dc581dca458cf2e6e5c6fe0995"} Jun 02 02:04:30.491880 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.491545 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="464f33d0a79c34768a4987396ebc06e39d8729dc581dca458cf2e6e5c6fe0995" Jun 02 02:04:30.493332 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.493309 2560 generic.go:358] "Generic (PLEG): container finished" podID="eafb467a-7a13-4ac6-86d7-52006d587241" containerID="ef9c4244453463260aff6ee445a442d1263934f2a979a9be13cc6b6b35d9d60b" exitCode=0 Jun 02 02:04:30.493477 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.493385 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" event={"ID":"eafb467a-7a13-4ac6-86d7-52006d587241","Type":"ContainerDied","Data":"ef9c4244453463260aff6ee445a442d1263934f2a979a9be13cc6b6b35d9d60b"} Jun 02 02:04:30.501247 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.501218 2560 generic.go:358] "Generic (PLEG): container finished" podID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerID="a465d25511d4184b2930a6d5d392b8344dc8ff7cc5cdc2279ada6d1ec2ad7f15" exitCode=0 Jun 02 02:04:30.501385 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.501327 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" event={"ID":"3afab1ea-8bda-4453-9361-3835115b7e3e","Type":"ContainerDied","Data":"a465d25511d4184b2930a6d5d392b8344dc8ff7cc5cdc2279ada6d1ec2ad7f15"} Jun 02 02:04:30.633138 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.633115 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:30.692411 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.692378 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-util\") pod \"ff08c9ad-c99a-40cb-8165-3019927e7c05\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " Jun 02 02:04:30.692583 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.692466 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-bundle\") pod \"ff08c9ad-c99a-40cb-8165-3019927e7c05\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " Jun 02 02:04:30.692583 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.692490 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj9vb\" (UniqueName: \"kubernetes.io/projected/ff08c9ad-c99a-40cb-8165-3019927e7c05-kube-api-access-lj9vb\") pod \"ff08c9ad-c99a-40cb-8165-3019927e7c05\" (UID: \"ff08c9ad-c99a-40cb-8165-3019927e7c05\") " Jun 02 02:04:30.692952 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.692923 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-bundle" (OuterVolumeSpecName: "bundle") pod "ff08c9ad-c99a-40cb-8165-3019927e7c05" (UID: "ff08c9ad-c99a-40cb-8165-3019927e7c05"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:30.694651 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.694623 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff08c9ad-c99a-40cb-8165-3019927e7c05-kube-api-access-lj9vb" (OuterVolumeSpecName: "kube-api-access-lj9vb") pod "ff08c9ad-c99a-40cb-8165-3019927e7c05" (UID: "ff08c9ad-c99a-40cb-8165-3019927e7c05"). InnerVolumeSpecName "kube-api-access-lj9vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:04:30.697359 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.697317 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-util" (OuterVolumeSpecName: "util") pod "ff08c9ad-c99a-40cb-8165-3019927e7c05" (UID: "ff08c9ad-c99a-40cb-8165-3019927e7c05"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:30.793251 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.793215 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:30.793251 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.793250 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff08c9ad-c99a-40cb-8165-3019927e7c05-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:30.793439 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:30.793260 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj9vb\" (UniqueName: \"kubernetes.io/projected/ff08c9ad-c99a-40cb-8165-3019927e7c05-kube-api-access-lj9vb\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:31.506194 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.506162 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" Jun 02 02:04:31.506194 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.506177 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9" event={"ID":"ff08c9ad-c99a-40cb-8165-3019927e7c05","Type":"ContainerDied","Data":"885e56bbc5df9688c0acdb0c49a9b451589f2257b97630f916d55d5a1672fcff"} Jun 02 02:04:31.506715 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.506211 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="885e56bbc5df9688c0acdb0c49a9b451589f2257b97630f916d55d5a1672fcff" Jun 02 02:04:31.659676 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.659654 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:31.663202 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.663179 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:31.701648 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.701610 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-util\") pod \"3afab1ea-8bda-4453-9361-3835115b7e3e\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " Jun 02 02:04:31.701833 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.701659 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-util\") pod \"eafb467a-7a13-4ac6-86d7-52006d587241\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " Jun 02 02:04:31.701833 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.701714 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-bundle\") pod \"eafb467a-7a13-4ac6-86d7-52006d587241\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " Jun 02 02:04:31.702003 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.701977 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-bundle\") pod \"3afab1ea-8bda-4453-9361-3835115b7e3e\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " Jun 02 02:04:31.702084 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.702039 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r546d\" (UniqueName: \"kubernetes.io/projected/eafb467a-7a13-4ac6-86d7-52006d587241-kube-api-access-r546d\") pod \"eafb467a-7a13-4ac6-86d7-52006d587241\" (UID: \"eafb467a-7a13-4ac6-86d7-52006d587241\") " Jun 02 02:04:31.702140 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.702085 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2klx\" (UniqueName: \"kubernetes.io/projected/3afab1ea-8bda-4453-9361-3835115b7e3e-kube-api-access-x2klx\") pod \"3afab1ea-8bda-4453-9361-3835115b7e3e\" (UID: \"3afab1ea-8bda-4453-9361-3835115b7e3e\") " Jun 02 02:04:31.702928 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.702276 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-bundle" (OuterVolumeSpecName: "bundle") pod "eafb467a-7a13-4ac6-86d7-52006d587241" (UID: "eafb467a-7a13-4ac6-86d7-52006d587241"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:31.702928 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.702382 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:31.703134 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.703047 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-bundle" (OuterVolumeSpecName: "bundle") pod "3afab1ea-8bda-4453-9361-3835115b7e3e" (UID: "3afab1ea-8bda-4453-9361-3835115b7e3e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:31.704969 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.704942 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eafb467a-7a13-4ac6-86d7-52006d587241-kube-api-access-r546d" (OuterVolumeSpecName: "kube-api-access-r546d") pod "eafb467a-7a13-4ac6-86d7-52006d587241" (UID: "eafb467a-7a13-4ac6-86d7-52006d587241"). InnerVolumeSpecName "kube-api-access-r546d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:04:31.705268 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.705235 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3afab1ea-8bda-4453-9361-3835115b7e3e-kube-api-access-x2klx" (OuterVolumeSpecName: "kube-api-access-x2klx") pod "3afab1ea-8bda-4453-9361-3835115b7e3e" (UID: "3afab1ea-8bda-4453-9361-3835115b7e3e"). InnerVolumeSpecName "kube-api-access-x2klx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:04:31.708095 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.708068 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-util" (OuterVolumeSpecName: "util") pod "eafb467a-7a13-4ac6-86d7-52006d587241" (UID: "eafb467a-7a13-4ac6-86d7-52006d587241"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:31.709275 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.709251 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-util" (OuterVolumeSpecName: "util") pod "3afab1ea-8bda-4453-9361-3835115b7e3e" (UID: "3afab1ea-8bda-4453-9361-3835115b7e3e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:04:31.802930 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.802888 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:31.802930 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.802927 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eafb467a-7a13-4ac6-86d7-52006d587241-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:31.802930 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.802936 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3afab1ea-8bda-4453-9361-3835115b7e3e-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:31.802930 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.802945 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r546d\" (UniqueName: \"kubernetes.io/projected/eafb467a-7a13-4ac6-86d7-52006d587241-kube-api-access-r546d\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:31.803190 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:31.802957 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2klx\" (UniqueName: \"kubernetes.io/projected/3afab1ea-8bda-4453-9361-3835115b7e3e-kube-api-access-x2klx\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:04:32.511198 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:32.511165 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" Jun 02 02:04:32.511660 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:32.511165 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq" event={"ID":"eafb467a-7a13-4ac6-86d7-52006d587241","Type":"ContainerDied","Data":"1eb182822754f632de9e335f87cffc22ae0b6af7d125e8fbc9c658d3178f641c"} Jun 02 02:04:32.511660 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:32.511274 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1eb182822754f632de9e335f87cffc22ae0b6af7d125e8fbc9c658d3178f641c" Jun 02 02:04:32.512820 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:32.512792 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" event={"ID":"3afab1ea-8bda-4453-9361-3835115b7e3e","Type":"ContainerDied","Data":"fdbf1a50ae55317e9fd4df05444673026f20b0516f8eeb33c5f78c8a21e11955"} Jun 02 02:04:32.512820 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:32.512821 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdbf1a50ae55317e9fd4df05444673026f20b0516f8eeb33c5f78c8a21e11955" Jun 02 02:04:32.512967 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:32.512828 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch" Jun 02 02:04:40.534189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534152 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b"] Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534443 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerName="extract" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534454 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerName="extract" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534466 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerName="pull" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534471 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerName="pull" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534481 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534487 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534493 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534499 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534510 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerName="extract" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534515 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerName="extract" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534524 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerName="pull" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534530 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerName="pull" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534536 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafb467a-7a13-4ac6-86d7-52006d587241" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534541 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafb467a-7a13-4ac6-86d7-52006d587241" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534548 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534553 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerName="util" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534558 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerName="pull" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534562 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerName="pull" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534569 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerName="extract" Jun 02 02:04:40.534564 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534574 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerName="extract" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534580 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafb467a-7a13-4ac6-86d7-52006d587241" containerName="pull" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534585 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafb467a-7a13-4ac6-86d7-52006d587241" containerName="pull" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534590 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafb467a-7a13-4ac6-86d7-52006d587241" containerName="extract" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534594 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafb467a-7a13-4ac6-86d7-52006d587241" containerName="extract" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534639 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="3afab1ea-8bda-4453-9361-3835115b7e3e" containerName="extract" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534648 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="5f2534ae-be21-4085-ab14-ba264e0e6fad" containerName="extract" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534654 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="ff08c9ad-c99a-40cb-8165-3019927e7c05" containerName="extract" Jun 02 02:04:40.535154 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.534662 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="eafb467a-7a13-4ac6-86d7-52006d587241" containerName="extract" Jun 02 02:04:40.539071 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.539044 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" Jun 02 02:04:40.541931 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.541905 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 02:04:40.542921 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.542898 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xvrn8\"" Jun 02 02:04:40.543101 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.542933 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 02 02:04:40.543189 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.542948 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 02:04:40.546005 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.545979 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b"] Jun 02 02:04:40.567788 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.567729 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwss\" (UniqueName: \"kubernetes.io/projected/9c4ea94a-788a-42b0-8d62-ca4001489ccd-kube-api-access-lnwss\") pod \"dns-operator-controller-manager-648d5c98bc-dtx2b\" (UID: \"9c4ea94a-788a-42b0-8d62-ca4001489ccd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" Jun 02 02:04:40.668170 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.668131 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwss\" (UniqueName: \"kubernetes.io/projected/9c4ea94a-788a-42b0-8d62-ca4001489ccd-kube-api-access-lnwss\") pod \"dns-operator-controller-manager-648d5c98bc-dtx2b\" (UID: \"9c4ea94a-788a-42b0-8d62-ca4001489ccd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" Jun 02 02:04:40.678693 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.678658 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwss\" (UniqueName: \"kubernetes.io/projected/9c4ea94a-788a-42b0-8d62-ca4001489ccd-kube-api-access-lnwss\") pod \"dns-operator-controller-manager-648d5c98bc-dtx2b\" (UID: \"9c4ea94a-788a-42b0-8d62-ca4001489ccd\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" Jun 02 02:04:40.850435 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:40.850342 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" Jun 02 02:04:41.005954 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:41.005928 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b"] Jun 02 02:04:41.007507 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:04:41.007475 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4ea94a_788a_42b0_8d62_ca4001489ccd.slice/crio-b6fef1ec177df8a13452b98d4ffdeaa33406f64176c767abc6912c94be8d7c14 WatchSource:0}: Error finding container b6fef1ec177df8a13452b98d4ffdeaa33406f64176c767abc6912c94be8d7c14: Status 404 returned error can't find the container with id b6fef1ec177df8a13452b98d4ffdeaa33406f64176c767abc6912c94be8d7c14 Jun 02 02:04:41.547309 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:41.547265 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" event={"ID":"9c4ea94a-788a-42b0-8d62-ca4001489ccd","Type":"ContainerStarted","Data":"b6fef1ec177df8a13452b98d4ffdeaa33406f64176c767abc6912c94be8d7c14"} Jun 02 02:04:43.555957 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:43.555924 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" event={"ID":"9c4ea94a-788a-42b0-8d62-ca4001489ccd","Type":"ContainerStarted","Data":"c269cb68a85fe9d6312c67f34263da62aa0f7ae06d1c87f757dac289ba113812"} Jun 02 02:04:43.556324 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:43.555981 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" Jun 02 02:04:43.573690 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:43.573635 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" podStartSLOduration=1.203591508 podStartE2EDuration="3.573617884s" podCreationTimestamp="2026-06-02 02:04:40 +0000 UTC" firstStartedPulling="2026-06-02 02:04:41.009466953 +0000 UTC m=+543.831875625" lastFinishedPulling="2026-06-02 02:04:43.379493327 +0000 UTC m=+546.201902001" observedRunningTime="2026-06-02 02:04:43.572454265 +0000 UTC m=+546.394862958" watchObservedRunningTime="2026-06-02 02:04:43.573617884 +0000 UTC m=+546.396026579" Jun 02 02:04:44.582416 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.582373 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw"] Jun 02 02:04:44.585670 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.585652 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:44.588163 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.588140 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-d65p2\"" Jun 02 02:04:44.596970 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.596945 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw"] Jun 02 02:04:44.599379 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.599348 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:44.599480 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.599431 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vnzm\" (UniqueName: \"kubernetes.io/projected/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-kube-api-access-9vnzm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:44.699802 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.699754 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:44.699980 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.699828 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vnzm\" (UniqueName: \"kubernetes.io/projected/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-kube-api-access-9vnzm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:44.700201 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.700176 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:44.709070 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.709042 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vnzm\" (UniqueName: \"kubernetes.io/projected/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-kube-api-access-9vnzm\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:44.896476 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:44.896376 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:45.031952 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:45.031916 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw"] Jun 02 02:04:45.035282 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:04:45.035241 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef2424c_ddde_4bba_b55a_ba883a41c1f4.slice/crio-b98330074e92099d2434280dcb62c274e74ae6e71586be9e11f988a3d9e55d0a WatchSource:0}: Error finding container b98330074e92099d2434280dcb62c274e74ae6e71586be9e11f988a3d9e55d0a: Status 404 returned error can't find the container with id b98330074e92099d2434280dcb62c274e74ae6e71586be9e11f988a3d9e55d0a Jun 02 02:04:45.569136 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:45.569099 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" event={"ID":"7ef2424c-ddde-4bba-b55a-ba883a41c1f4","Type":"ContainerStarted","Data":"b98330074e92099d2434280dcb62c274e74ae6e71586be9e11f988a3d9e55d0a"} Jun 02 02:04:50.590034 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:50.589995 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" event={"ID":"7ef2424c-ddde-4bba-b55a-ba883a41c1f4","Type":"ContainerStarted","Data":"7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947"} Jun 02 02:04:50.590457 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:50.590169 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:04:50.610416 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:50.610365 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" podStartSLOduration=1.8733394209999998 podStartE2EDuration="6.610348704s" podCreationTimestamp="2026-06-02 02:04:44 +0000 UTC" firstStartedPulling="2026-06-02 02:04:45.037717985 +0000 UTC m=+547.860126656" lastFinishedPulling="2026-06-02 02:04:49.774727264 +0000 UTC m=+552.597135939" observedRunningTime="2026-06-02 02:04:50.6075375 +0000 UTC m=+553.429946194" watchObservedRunningTime="2026-06-02 02:04:50.610348704 +0000 UTC m=+553.432757399" Jun 02 02:04:54.561910 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:04:54.561877 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-dtx2b" Jun 02 02:05:01.596895 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:01.596865 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:05:02.716328 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.716286 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48"] Jun 02 02:05:02.721534 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.721509 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:02.733912 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.733885 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48"] Jun 02 02:05:02.834989 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.834956 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48"] Jun 02 02:05:02.835204 ip-10-0-134-54 kubenswrapper[2560]: E0602 02:05:02.835184 2560 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-g9k4w], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" podUID="cb6d337d-5645-4484-90e5-b0dc5b991f3b" Jun 02 02:05:02.858913 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.858878 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6d337d-5645-4484-90e5-b0dc5b991f3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7fs48\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:02.859087 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.859062 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9k4w\" (UniqueName: \"kubernetes.io/projected/cb6d337d-5645-4484-90e5-b0dc5b991f3b-kube-api-access-g9k4w\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7fs48\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:02.960167 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.960122 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6d337d-5645-4484-90e5-b0dc5b991f3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7fs48\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:02.960341 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.960182 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g9k4w\" (UniqueName: \"kubernetes.io/projected/cb6d337d-5645-4484-90e5-b0dc5b991f3b-kube-api-access-g9k4w\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7fs48\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:02.960504 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.960485 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6d337d-5645-4484-90e5-b0dc5b991f3b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7fs48\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:02.969236 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:02.969170 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9k4w\" (UniqueName: \"kubernetes.io/projected/cb6d337d-5645-4484-90e5-b0dc5b991f3b-kube-api-access-g9k4w\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7fs48\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:03.312404 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.312369 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw"] Jun 02 02:05:03.312643 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.312614 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" containerName="manager" containerID="cri-o://7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947" gracePeriod=2 Jun 02 02:05:03.314880 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.314856 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw"] Jun 02 02:05:03.315001 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.314969 2560 status_manager.go:895] "Failed to get status for pod" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" is forbidden: User \"system:node:ip-10-0-134-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-54.ec2.internal' and this object" Jun 02 02:05:03.324059 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.324035 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48"] Jun 02 02:05:03.331987 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.331959 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2"] Jun 02 02:05:03.332469 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.332451 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" containerName="manager" Jun 02 02:05:03.332512 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.332473 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" containerName="manager" Jun 02 02:05:03.332570 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.332560 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" containerName="manager" Jun 02 02:05:03.337174 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.336690 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.337575 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.337551 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48"] Jun 02 02:05:03.339976 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.339948 2560 status_manager.go:895] "Failed to get status for pod" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" is forbidden: User \"system:node:ip-10-0-134-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-54.ec2.internal' and this object" Jun 02 02:05:03.346557 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.346530 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2"] Jun 02 02:05:03.381499 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.381465 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx"] Jun 02 02:05:03.385067 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.385044 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.387594 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.387562 2560 status_manager.go:895] "Failed to get status for pod" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" is forbidden: User \"system:node:ip-10-0-134-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-54.ec2.internal' and this object" Jun 02 02:05:03.401703 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.401678 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx"] Jun 02 02:05:03.465495 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.465459 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68577651-a02f-4566-bae4-78ea32cb021a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-khcv2\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.465495 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.465497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03dd9292-39cc-4cbe-bf93-7577355387fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-cdsmx\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.465744 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.465520 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpdmw\" (UniqueName: \"kubernetes.io/projected/68577651-a02f-4566-bae4-78ea32cb021a-kube-api-access-xpdmw\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-khcv2\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.465744 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.465584 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsmxj\" (UniqueName: \"kubernetes.io/projected/03dd9292-39cc-4cbe-bf93-7577355387fe-kube-api-access-lsmxj\") pod \"kuadrant-operator-controller-manager-84b657d985-cdsmx\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.554045 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.554022 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:05:03.556328 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.556302 2560 status_manager.go:895] "Failed to get status for pod" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" is forbidden: User \"system:node:ip-10-0-134-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-54.ec2.internal' and this object" Jun 02 02:05:03.566711 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.566647 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68577651-a02f-4566-bae4-78ea32cb021a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-khcv2\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.566711 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.566687 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03dd9292-39cc-4cbe-bf93-7577355387fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-cdsmx\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.566887 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.566715 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdmw\" (UniqueName: \"kubernetes.io/projected/68577651-a02f-4566-bae4-78ea32cb021a-kube-api-access-xpdmw\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-khcv2\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.566887 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.566807 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsmxj\" (UniqueName: \"kubernetes.io/projected/03dd9292-39cc-4cbe-bf93-7577355387fe-kube-api-access-lsmxj\") pod \"kuadrant-operator-controller-manager-84b657d985-cdsmx\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.567165 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.567143 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03dd9292-39cc-4cbe-bf93-7577355387fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-84b657d985-cdsmx\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.567224 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.567143 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68577651-a02f-4566-bae4-78ea32cb021a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-khcv2\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.582023 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.581995 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsmxj\" (UniqueName: \"kubernetes.io/projected/03dd9292-39cc-4cbe-bf93-7577355387fe-kube-api-access-lsmxj\") pod \"kuadrant-operator-controller-manager-84b657d985-cdsmx\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.582023 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.582015 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpdmw\" (UniqueName: \"kubernetes.io/projected/68577651-a02f-4566-bae4-78ea32cb021a-kube-api-access-xpdmw\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-khcv2\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.639822 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.639758 2560 generic.go:358] "Generic (PLEG): container finished" podID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" containerID="7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947" exitCode=0 Jun 02 02:05:03.639999 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.639835 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" Jun 02 02:05:03.639999 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.639964 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:03.642350 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.642323 2560 status_manager.go:895] "Failed to get status for pod" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-tqvhw" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-tqvhw\" is forbidden: User \"system:node:ip-10-0-134-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-54.ec2.internal' and this object" Jun 02 02:05:03.643330 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.643315 2560 scope.go:117] "RemoveContainer" containerID="7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947" Jun 02 02:05:03.645354 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.645333 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:03.651697 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.651682 2560 scope.go:117] "RemoveContainer" containerID="7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947" Jun 02 02:05:03.651979 ip-10-0-134-54 kubenswrapper[2560]: E0602 02:05:03.651960 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947\": container with ID starting with 7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947 not found: ID does not exist" containerID="7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947" Jun 02 02:05:03.652045 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.651993 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947"} err="failed to get container status \"7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947\": rpc error: code = NotFound desc = could not find container \"7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947\": container with ID starting with 7e9eda5810a505ba147510ccd80662fd91efe1c965a223214040875c6645f947 not found: ID does not exist" Jun 02 02:05:03.667320 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.667296 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-extensions-socket-volume\") pod \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " Jun 02 02:05:03.667402 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.667341 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vnzm\" (UniqueName: \"kubernetes.io/projected/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-kube-api-access-9vnzm\") pod \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\" (UID: \"7ef2424c-ddde-4bba-b55a-ba883a41c1f4\") " Jun 02 02:05:03.667729 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.667708 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7ef2424c-ddde-4bba-b55a-ba883a41c1f4" (UID: "7ef2424c-ddde-4bba-b55a-ba883a41c1f4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:05:03.669245 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.669224 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-kube-api-access-9vnzm" (OuterVolumeSpecName: "kube-api-access-9vnzm") pod "7ef2424c-ddde-4bba-b55a-ba883a41c1f4" (UID: "7ef2424c-ddde-4bba-b55a-ba883a41c1f4"). InnerVolumeSpecName "kube-api-access-9vnzm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:05:03.694112 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.694085 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:03.701855 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.701837 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:03.768690 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.768658 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9k4w\" (UniqueName: \"kubernetes.io/projected/cb6d337d-5645-4484-90e5-b0dc5b991f3b-kube-api-access-g9k4w\") pod \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " Jun 02 02:05:03.769041 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.768732 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6d337d-5645-4484-90e5-b0dc5b991f3b-extensions-socket-volume\") pod \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\" (UID: \"cb6d337d-5645-4484-90e5-b0dc5b991f3b\") " Jun 02 02:05:03.769041 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.768877 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-extensions-socket-volume\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:03.769041 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.768890 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vnzm\" (UniqueName: \"kubernetes.io/projected/7ef2424c-ddde-4bba-b55a-ba883a41c1f4-kube-api-access-9vnzm\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:03.769145 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.769055 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb6d337d-5645-4484-90e5-b0dc5b991f3b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cb6d337d-5645-4484-90e5-b0dc5b991f3b" (UID: "cb6d337d-5645-4484-90e5-b0dc5b991f3b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:05:03.771314 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.771290 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6d337d-5645-4484-90e5-b0dc5b991f3b-kube-api-access-g9k4w" (OuterVolumeSpecName: "kube-api-access-g9k4w") pod "cb6d337d-5645-4484-90e5-b0dc5b991f3b" (UID: "cb6d337d-5645-4484-90e5-b0dc5b991f3b"). InnerVolumeSpecName "kube-api-access-g9k4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:05:03.842834 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.842801 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2"] Jun 02 02:05:03.845070 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:05:03.845040 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68577651_a02f_4566_bae4_78ea32cb021a.slice/crio-fae628d5c8e7032951176098aed4ab72e5e7d64440f9892866a2a89988f0c3d7 WatchSource:0}: Error finding container fae628d5c8e7032951176098aed4ab72e5e7d64440f9892866a2a89988f0c3d7: Status 404 returned error can't find the container with id fae628d5c8e7032951176098aed4ab72e5e7d64440f9892866a2a89988f0c3d7 Jun 02 02:05:03.867981 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.867958 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx"] Jun 02 02:05:03.869613 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.869590 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9k4w\" (UniqueName: \"kubernetes.io/projected/cb6d337d-5645-4484-90e5-b0dc5b991f3b-kube-api-access-g9k4w\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:03.869692 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:03.869621 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb6d337d-5645-4484-90e5-b0dc5b991f3b-extensions-socket-volume\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:03.869692 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:05:03.869626 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03dd9292_39cc_4cbe_bf93_7577355387fe.slice/crio-14a48174b18346b16b9913028f6f456e2b0bc12504609bc1bc826671efcf9d26 WatchSource:0}: Error finding container 14a48174b18346b16b9913028f6f456e2b0bc12504609bc1bc826671efcf9d26: Status 404 returned error can't find the container with id 14a48174b18346b16b9913028f6f456e2b0bc12504609bc1bc826671efcf9d26 Jun 02 02:05:04.646688 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.646651 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" event={"ID":"03dd9292-39cc-4cbe-bf93-7577355387fe","Type":"ContainerStarted","Data":"32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972"} Jun 02 02:05:04.646688 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.646691 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" event={"ID":"03dd9292-39cc-4cbe-bf93-7577355387fe","Type":"ContainerStarted","Data":"14a48174b18346b16b9913028f6f456e2b0bc12504609bc1bc826671efcf9d26"} Jun 02 02:05:04.646981 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.646725 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:04.651788 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.651752 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" event={"ID":"68577651-a02f-4566-bae4-78ea32cb021a","Type":"ContainerStarted","Data":"3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822"} Jun 02 02:05:04.651914 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.651795 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" event={"ID":"68577651-a02f-4566-bae4-78ea32cb021a","Type":"ContainerStarted","Data":"fae628d5c8e7032951176098aed4ab72e5e7d64440f9892866a2a89988f0c3d7"} Jun 02 02:05:04.651914 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.651863 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" Jun 02 02:05:04.652026 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.652013 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:04.674231 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.674185 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" podStartSLOduration=1.67417301 podStartE2EDuration="1.67417301s" podCreationTimestamp="2026-06-02 02:05:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:05:04.672361583 +0000 UTC m=+567.494770276" watchObservedRunningTime="2026-06-02 02:05:04.67417301 +0000 UTC m=+567.496581703" Jun 02 02:05:04.674541 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.674520 2560 status_manager.go:895] "Failed to get status for pod" podUID="cb6d337d-5645-4484-90e5-b0dc5b991f3b" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7fs48" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-7fs48\" is forbidden: User \"system:node:ip-10-0-134-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-54.ec2.internal' and this object" Jun 02 02:05:04.699260 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:04.699214 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" podStartSLOduration=1.699198768 podStartE2EDuration="1.699198768s" podCreationTimestamp="2026-06-02 02:05:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:05:04.697895415 +0000 UTC m=+567.520304108" watchObservedRunningTime="2026-06-02 02:05:04.699198768 +0000 UTC m=+567.521607463" Jun 02 02:05:05.641648 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:05.641612 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ef2424c-ddde-4bba-b55a-ba883a41c1f4" path="/var/lib/kubelet/pods/7ef2424c-ddde-4bba-b55a-ba883a41c1f4/volumes" Jun 02 02:05:05.642051 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:05.641988 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb6d337d-5645-4484-90e5-b0dc5b991f3b" path="/var/lib/kubelet/pods/cb6d337d-5645-4484-90e5-b0dc5b991f3b/volumes" Jun 02 02:05:15.656709 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:15.656677 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:15.657138 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:15.656737 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:15.733979 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:15.733937 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2"] Jun 02 02:05:15.734334 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:15.734297 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" podUID="68577651-a02f-4566-bae4-78ea32cb021a" containerName="manager" containerID="cri-o://3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822" gracePeriod=10 Jun 02 02:05:15.986633 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:15.986612 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:16.017788 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.017737 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9"] Jun 02 02:05:16.018128 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.018106 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68577651-a02f-4566-bae4-78ea32cb021a" containerName="manager" Jun 02 02:05:16.018128 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.018127 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="68577651-a02f-4566-bae4-78ea32cb021a" containerName="manager" Jun 02 02:05:16.018286 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.018185 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="68577651-a02f-4566-bae4-78ea32cb021a" containerName="manager" Jun 02 02:05:16.023368 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.023348 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.042076 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.042046 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9"] Jun 02 02:05:16.173384 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.173347 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpdmw\" (UniqueName: \"kubernetes.io/projected/68577651-a02f-4566-bae4-78ea32cb021a-kube-api-access-xpdmw\") pod \"68577651-a02f-4566-bae4-78ea32cb021a\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " Jun 02 02:05:16.173586 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.173447 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68577651-a02f-4566-bae4-78ea32cb021a-extensions-socket-volume\") pod \"68577651-a02f-4566-bae4-78ea32cb021a\" (UID: \"68577651-a02f-4566-bae4-78ea32cb021a\") " Jun 02 02:05:16.173586 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.173557 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kk48\" (UniqueName: \"kubernetes.io/projected/a124786e-43a6-477d-bd58-75684044f2a9-kube-api-access-5kk48\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jgmr9\" (UID: \"a124786e-43a6-477d-bd58-75684044f2a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.173692 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.173599 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a124786e-43a6-477d-bd58-75684044f2a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jgmr9\" (UID: \"a124786e-43a6-477d-bd58-75684044f2a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.173853 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.173823 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68577651-a02f-4566-bae4-78ea32cb021a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "68577651-a02f-4566-bae4-78ea32cb021a" (UID: "68577651-a02f-4566-bae4-78ea32cb021a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:05:16.175502 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.175480 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68577651-a02f-4566-bae4-78ea32cb021a-kube-api-access-xpdmw" (OuterVolumeSpecName: "kube-api-access-xpdmw") pod "68577651-a02f-4566-bae4-78ea32cb021a" (UID: "68577651-a02f-4566-bae4-78ea32cb021a"). InnerVolumeSpecName "kube-api-access-xpdmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:05:16.274658 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.274619 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5kk48\" (UniqueName: \"kubernetes.io/projected/a124786e-43a6-477d-bd58-75684044f2a9-kube-api-access-5kk48\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jgmr9\" (UID: \"a124786e-43a6-477d-bd58-75684044f2a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.274847 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.274667 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a124786e-43a6-477d-bd58-75684044f2a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jgmr9\" (UID: \"a124786e-43a6-477d-bd58-75684044f2a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.274847 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.274705 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/68577651-a02f-4566-bae4-78ea32cb021a-extensions-socket-volume\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:16.274847 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.274716 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpdmw\" (UniqueName: \"kubernetes.io/projected/68577651-a02f-4566-bae4-78ea32cb021a-kube-api-access-xpdmw\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:16.275072 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.275054 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a124786e-43a6-477d-bd58-75684044f2a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jgmr9\" (UID: \"a124786e-43a6-477d-bd58-75684044f2a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.287338 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.287309 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kk48\" (UniqueName: \"kubernetes.io/projected/a124786e-43a6-477d-bd58-75684044f2a9-kube-api-access-5kk48\") pod \"kuadrant-operator-controller-manager-55c7f4c975-jgmr9\" (UID: \"a124786e-43a6-477d-bd58-75684044f2a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.335224 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.335188 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.468862 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.468835 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9"] Jun 02 02:05:16.471447 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:05:16.471422 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda124786e_43a6_477d_bd58_75684044f2a9.slice/crio-51cb080bf004733e76d219cc1200e1d1d0b34505659f3086dc4bb19b64f9f048 WatchSource:0}: Error finding container 51cb080bf004733e76d219cc1200e1d1d0b34505659f3086dc4bb19b64f9f048: Status 404 returned error can't find the container with id 51cb080bf004733e76d219cc1200e1d1d0b34505659f3086dc4bb19b64f9f048 Jun 02 02:05:16.693936 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.693840 2560 generic.go:358] "Generic (PLEG): container finished" podID="68577651-a02f-4566-bae4-78ea32cb021a" containerID="3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822" exitCode=0 Jun 02 02:05:16.693936 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.693874 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" event={"ID":"68577651-a02f-4566-bae4-78ea32cb021a","Type":"ContainerDied","Data":"3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822"} Jun 02 02:05:16.693936 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.693910 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" event={"ID":"68577651-a02f-4566-bae4-78ea32cb021a","Type":"ContainerDied","Data":"fae628d5c8e7032951176098aed4ab72e5e7d64440f9892866a2a89988f0c3d7"} Jun 02 02:05:16.693936 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.693925 2560 scope.go:117] "RemoveContainer" containerID="3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822" Jun 02 02:05:16.694468 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.693939 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2" Jun 02 02:05:16.695636 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.695607 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" event={"ID":"a124786e-43a6-477d-bd58-75684044f2a9","Type":"ContainerStarted","Data":"8bcf7b5dd4343cb8bb4621320b0a237a396b25ae72cc7fcfc5c12c81f37d7072"} Jun 02 02:05:16.695636 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.695635 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" event={"ID":"a124786e-43a6-477d-bd58-75684044f2a9","Type":"ContainerStarted","Data":"51cb080bf004733e76d219cc1200e1d1d0b34505659f3086dc4bb19b64f9f048"} Jun 02 02:05:16.695801 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.695692 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:16.703363 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.703345 2560 scope.go:117] "RemoveContainer" containerID="3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822" Jun 02 02:05:16.703596 ip-10-0-134-54 kubenswrapper[2560]: E0602 02:05:16.703578 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822\": container with ID starting with 3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822 not found: ID does not exist" containerID="3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822" Jun 02 02:05:16.703633 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.703607 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822"} err="failed to get container status \"3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822\": rpc error: code = NotFound desc = could not find container \"3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822\": container with ID starting with 3eba7525be43ece8b7728761ff9b5951ddc0f28453a068a370707bf4aa4c9822 not found: ID does not exist" Jun 02 02:05:16.758369 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.758321 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" podStartSLOduration=1.7583059859999999 podStartE2EDuration="1.758305986s" podCreationTimestamp="2026-06-02 02:05:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:05:16.756369637 +0000 UTC m=+579.578778330" watchObservedRunningTime="2026-06-02 02:05:16.758305986 +0000 UTC m=+579.580714679" Jun 02 02:05:16.779186 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.779149 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2"] Jun 02 02:05:16.782481 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:16.782453 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-khcv2"] Jun 02 02:05:17.641716 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:17.641682 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68577651-a02f-4566-bae4-78ea32cb021a" path="/var/lib/kubelet/pods/68577651-a02f-4566-bae4-78ea32cb021a/volumes" Jun 02 02:05:27.702658 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:27.702621 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-jgmr9" Jun 02 02:05:27.753613 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:27.753573 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx"] Jun 02 02:05:27.754221 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:27.754000 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" podUID="03dd9292-39cc-4cbe-bf93-7577355387fe" containerName="manager" containerID="cri-o://32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972" gracePeriod=10 Jun 02 02:05:27.995074 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:27.995050 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:28.061818 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.061781 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsmxj\" (UniqueName: \"kubernetes.io/projected/03dd9292-39cc-4cbe-bf93-7577355387fe-kube-api-access-lsmxj\") pod \"03dd9292-39cc-4cbe-bf93-7577355387fe\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " Jun 02 02:05:28.063825 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.063804 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03dd9292-39cc-4cbe-bf93-7577355387fe-kube-api-access-lsmxj" (OuterVolumeSpecName: "kube-api-access-lsmxj") pod "03dd9292-39cc-4cbe-bf93-7577355387fe" (UID: "03dd9292-39cc-4cbe-bf93-7577355387fe"). InnerVolumeSpecName "kube-api-access-lsmxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:05:28.162420 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.162365 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03dd9292-39cc-4cbe-bf93-7577355387fe-extensions-socket-volume\") pod \"03dd9292-39cc-4cbe-bf93-7577355387fe\" (UID: \"03dd9292-39cc-4cbe-bf93-7577355387fe\") " Jun 02 02:05:28.162581 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.162527 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsmxj\" (UniqueName: \"kubernetes.io/projected/03dd9292-39cc-4cbe-bf93-7577355387fe-kube-api-access-lsmxj\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:28.162748 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.162723 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03dd9292-39cc-4cbe-bf93-7577355387fe-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "03dd9292-39cc-4cbe-bf93-7577355387fe" (UID: "03dd9292-39cc-4cbe-bf93-7577355387fe"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:05:28.266516 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.266491 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03dd9292-39cc-4cbe-bf93-7577355387fe-extensions-socket-volume\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:05:28.739877 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.739787 2560 generic.go:358] "Generic (PLEG): container finished" podID="03dd9292-39cc-4cbe-bf93-7577355387fe" containerID="32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972" exitCode=0 Jun 02 02:05:28.739877 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.739869 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" Jun 02 02:05:28.740326 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.739876 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" event={"ID":"03dd9292-39cc-4cbe-bf93-7577355387fe","Type":"ContainerDied","Data":"32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972"} Jun 02 02:05:28.740326 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.739917 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx" event={"ID":"03dd9292-39cc-4cbe-bf93-7577355387fe","Type":"ContainerDied","Data":"14a48174b18346b16b9913028f6f456e2b0bc12504609bc1bc826671efcf9d26"} Jun 02 02:05:28.740326 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.739936 2560 scope.go:117] "RemoveContainer" containerID="32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972" Jun 02 02:05:28.748365 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.748348 2560 scope.go:117] "RemoveContainer" containerID="32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972" Jun 02 02:05:28.748614 ip-10-0-134-54 kubenswrapper[2560]: E0602 02:05:28.748594 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972\": container with ID starting with 32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972 not found: ID does not exist" containerID="32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972" Jun 02 02:05:28.748656 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.748622 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972"} err="failed to get container status \"32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972\": rpc error: code = NotFound desc = could not find container \"32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972\": container with ID starting with 32893d471751c33ae9d9ecdd4dc746da5489154a9fcfdf1fde63147ff3afc972 not found: ID does not exist" Jun 02 02:05:28.762495 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.762468 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx"] Jun 02 02:05:28.766790 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:28.766753 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-84b657d985-cdsmx"] Jun 02 02:05:29.641480 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:29.641447 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03dd9292-39cc-4cbe-bf93-7577355387fe" path="/var/lib/kubelet/pods/03dd9292-39cc-4cbe-bf93-7577355387fe/volumes" Jun 02 02:05:37.586562 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:37.586537 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:05:37.588862 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:37.588841 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:05:44.548888 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.548849 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-442r8"] Jun 02 02:05:44.549361 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.549296 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03dd9292-39cc-4cbe-bf93-7577355387fe" containerName="manager" Jun 02 02:05:44.549361 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.549314 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="03dd9292-39cc-4cbe-bf93-7577355387fe" containerName="manager" Jun 02 02:05:44.549478 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.549404 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="03dd9292-39cc-4cbe-bf93-7577355387fe" containerName="manager" Jun 02 02:05:44.553710 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.553687 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:44.556208 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.556185 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 02 02:05:44.556312 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.556284 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-glzsz\"" Jun 02 02:05:44.559926 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.559901 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-442r8"] Jun 02 02:05:44.586577 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.586547 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5716b56-4398-429d-b96d-5be539393a05-config-file\") pod \"limitador-limitador-7d549b5b-442r8\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:44.586701 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.586612 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rp2l\" (UniqueName: \"kubernetes.io/projected/b5716b56-4398-429d-b96d-5be539393a05-kube-api-access-5rp2l\") pod \"limitador-limitador-7d549b5b-442r8\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:44.651084 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.651040 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-442r8"] Jun 02 02:05:44.686983 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.686953 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5716b56-4398-429d-b96d-5be539393a05-config-file\") pod \"limitador-limitador-7d549b5b-442r8\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:44.687132 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.687025 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5rp2l\" (UniqueName: \"kubernetes.io/projected/b5716b56-4398-429d-b96d-5be539393a05-kube-api-access-5rp2l\") pod \"limitador-limitador-7d549b5b-442r8\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:44.687818 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.687791 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5716b56-4398-429d-b96d-5be539393a05-config-file\") pod \"limitador-limitador-7d549b5b-442r8\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:44.701565 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.701535 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rp2l\" (UniqueName: \"kubernetes.io/projected/b5716b56-4398-429d-b96d-5be539393a05-kube-api-access-5rp2l\") pod \"limitador-limitador-7d549b5b-442r8\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:44.865217 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:44.865123 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:45.009225 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:45.009200 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-442r8"] Jun 02 02:05:45.011637 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:05:45.011604 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5716b56_4398_429d_b96d_5be539393a05.slice/crio-5f3b6a2f16f029a0c52fc41638d64a9e7045d02ed36fc1d8bc5890840eed06e4 WatchSource:0}: Error finding container 5f3b6a2f16f029a0c52fc41638d64a9e7045d02ed36fc1d8bc5890840eed06e4: Status 404 returned error can't find the container with id 5f3b6a2f16f029a0c52fc41638d64a9e7045d02ed36fc1d8bc5890840eed06e4 Jun 02 02:05:45.806589 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:45.806547 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" event={"ID":"b5716b56-4398-429d-b96d-5be539393a05","Type":"ContainerStarted","Data":"5f3b6a2f16f029a0c52fc41638d64a9e7045d02ed36fc1d8bc5890840eed06e4"} Jun 02 02:05:47.820809 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:47.820756 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" event={"ID":"b5716b56-4398-429d-b96d-5be539393a05","Type":"ContainerStarted","Data":"a3475093ba3bbb803d4146ceeb11a23068f7c81b0d876e0b6c743814ebe26723"} Jun 02 02:05:47.821203 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:47.820944 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:47.841809 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:47.841701 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" podStartSLOduration=1.271105182 podStartE2EDuration="3.841685214s" podCreationTimestamp="2026-06-02 02:05:44 +0000 UTC" firstStartedPulling="2026-06-02 02:05:45.013678274 +0000 UTC m=+607.836086945" lastFinishedPulling="2026-06-02 02:05:47.584258305 +0000 UTC m=+610.406666977" observedRunningTime="2026-06-02 02:05:47.839273157 +0000 UTC m=+610.661681848" watchObservedRunningTime="2026-06-02 02:05:47.841685214 +0000 UTC m=+610.664093909" Jun 02 02:05:58.826031 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:58.825949 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:05:59.146171 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:59.146051 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-442r8"] Jun 02 02:05:59.146495 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:59.146460 2560 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" podUID="b5716b56-4398-429d-b96d-5be539393a05" containerName="limitador" containerID="cri-o://a3475093ba3bbb803d4146ceeb11a23068f7c81b0d876e0b6c743814ebe26723" gracePeriod=30 Jun 02 02:05:59.866126 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:59.866090 2560 generic.go:358] "Generic (PLEG): container finished" podID="b5716b56-4398-429d-b96d-5be539393a05" containerID="a3475093ba3bbb803d4146ceeb11a23068f7c81b0d876e0b6c743814ebe26723" exitCode=0 Jun 02 02:05:59.866506 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:05:59.866163 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" event={"ID":"b5716b56-4398-429d-b96d-5be539393a05","Type":"ContainerDied","Data":"a3475093ba3bbb803d4146ceeb11a23068f7c81b0d876e0b6c743814ebe26723"} Jun 02 02:06:00.091049 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.091024 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:06:00.230115 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.230020 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5716b56-4398-429d-b96d-5be539393a05-config-file\") pod \"b5716b56-4398-429d-b96d-5be539393a05\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " Jun 02 02:06:00.230115 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.230109 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rp2l\" (UniqueName: \"kubernetes.io/projected/b5716b56-4398-429d-b96d-5be539393a05-kube-api-access-5rp2l\") pod \"b5716b56-4398-429d-b96d-5be539393a05\" (UID: \"b5716b56-4398-429d-b96d-5be539393a05\") " Jun 02 02:06:00.230496 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.230458 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5716b56-4398-429d-b96d-5be539393a05-config-file" (OuterVolumeSpecName: "config-file") pod "b5716b56-4398-429d-b96d-5be539393a05" (UID: "b5716b56-4398-429d-b96d-5be539393a05"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 02:06:00.232294 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.232269 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5716b56-4398-429d-b96d-5be539393a05-kube-api-access-5rp2l" (OuterVolumeSpecName: "kube-api-access-5rp2l") pod "b5716b56-4398-429d-b96d-5be539393a05" (UID: "b5716b56-4398-429d-b96d-5be539393a05"). InnerVolumeSpecName "kube-api-access-5rp2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:06:00.331631 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.331587 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rp2l\" (UniqueName: \"kubernetes.io/projected/b5716b56-4398-429d-b96d-5be539393a05-kube-api-access-5rp2l\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:06:00.331631 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.331622 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b5716b56-4398-429d-b96d-5be539393a05-config-file\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:06:00.871020 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.870987 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" Jun 02 02:06:00.871020 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.870997 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-442r8" event={"ID":"b5716b56-4398-429d-b96d-5be539393a05","Type":"ContainerDied","Data":"5f3b6a2f16f029a0c52fc41638d64a9e7045d02ed36fc1d8bc5890840eed06e4"} Jun 02 02:06:00.871545 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.871048 2560 scope.go:117] "RemoveContainer" containerID="a3475093ba3bbb803d4146ceeb11a23068f7c81b0d876e0b6c743814ebe26723" Jun 02 02:06:00.894908 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.894877 2560 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-442r8"] Jun 02 02:06:00.903035 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:00.903012 2560 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-442r8"] Jun 02 02:06:01.642671 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:01.642633 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5716b56-4398-429d-b96d-5be539393a05" path="/var/lib/kubelet/pods/b5716b56-4398-429d-b96d-5be539393a05/volumes" Jun 02 02:06:02.261143 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.261108 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6gxs5"] Jun 02 02:06:02.261634 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.261413 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5716b56-4398-429d-b96d-5be539393a05" containerName="limitador" Jun 02 02:06:02.261634 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.261425 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5716b56-4398-429d-b96d-5be539393a05" containerName="limitador" Jun 02 02:06:02.261634 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.261471 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="b5716b56-4398-429d-b96d-5be539393a05" containerName="limitador" Jun 02 02:06:02.266130 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.266104 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.268592 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.268571 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 02 02:06:02.272890 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.272866 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6gxs5"] Jun 02 02:06:02.347488 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.347451 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjpk7\" (UniqueName: \"kubernetes.io/projected/5d7bbd50-55fc-4868-8b19-6de519acb692-kube-api-access-wjpk7\") pod \"postgres-68c4fbbd6f-6gxs5\" (UID: \"5d7bbd50-55fc-4868-8b19-6de519acb692\") " pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.347488 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.347497 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5d7bbd50-55fc-4868-8b19-6de519acb692-data\") pod \"postgres-68c4fbbd6f-6gxs5\" (UID: \"5d7bbd50-55fc-4868-8b19-6de519acb692\") " pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.448262 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.448218 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjpk7\" (UniqueName: \"kubernetes.io/projected/5d7bbd50-55fc-4868-8b19-6de519acb692-kube-api-access-wjpk7\") pod \"postgres-68c4fbbd6f-6gxs5\" (UID: \"5d7bbd50-55fc-4868-8b19-6de519acb692\") " pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.448459 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.448271 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5d7bbd50-55fc-4868-8b19-6de519acb692-data\") pod \"postgres-68c4fbbd6f-6gxs5\" (UID: \"5d7bbd50-55fc-4868-8b19-6de519acb692\") " pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.448674 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.448650 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5d7bbd50-55fc-4868-8b19-6de519acb692-data\") pod \"postgres-68c4fbbd6f-6gxs5\" (UID: \"5d7bbd50-55fc-4868-8b19-6de519acb692\") " pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.457484 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.457449 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjpk7\" (UniqueName: \"kubernetes.io/projected/5d7bbd50-55fc-4868-8b19-6de519acb692-kube-api-access-wjpk7\") pod \"postgres-68c4fbbd6f-6gxs5\" (UID: \"5d7bbd50-55fc-4868-8b19-6de519acb692\") " pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.578551 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.578511 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:02.710095 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.710060 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-6gxs5"] Jun 02 02:06:02.711622 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:06:02.711588 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7bbd50_55fc_4868_8b19_6de519acb692.slice/crio-95707926f14a2cb21fc32b3e4701faf15f7eb61f704716804b56108be5e9baf6 WatchSource:0}: Error finding container 95707926f14a2cb21fc32b3e4701faf15f7eb61f704716804b56108be5e9baf6: Status 404 returned error can't find the container with id 95707926f14a2cb21fc32b3e4701faf15f7eb61f704716804b56108be5e9baf6 Jun 02 02:06:02.886668 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:02.886578 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6gxs5" event={"ID":"5d7bbd50-55fc-4868-8b19-6de519acb692","Type":"ContainerStarted","Data":"95707926f14a2cb21fc32b3e4701faf15f7eb61f704716804b56108be5e9baf6"} Jun 02 02:06:05.899259 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:05.899218 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-6gxs5" event={"ID":"5d7bbd50-55fc-4868-8b19-6de519acb692","Type":"ContainerStarted","Data":"56589b06f9e190e205e6e4e104eb21486f8c85b10bd928723bc8af6387f2854c"} Jun 02 02:06:05.899635 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:05.899351 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:05.915454 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:05.915399 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-6gxs5" podStartSLOduration=1.5290325340000002 podStartE2EDuration="3.915381483s" podCreationTimestamp="2026-06-02 02:06:02 +0000 UTC" firstStartedPulling="2026-06-02 02:06:02.713173294 +0000 UTC m=+625.535581966" lastFinishedPulling="2026-06-02 02:06:05.099522229 +0000 UTC m=+627.921930915" observedRunningTime="2026-06-02 02:06:05.915274514 +0000 UTC m=+628.737683209" watchObservedRunningTime="2026-06-02 02:06:05.915381483 +0000 UTC m=+628.737790179" Jun 02 02:06:11.934295 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:11.934265 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-6gxs5" Jun 02 02:06:13.451907 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.451867 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46"] Jun 02 02:06:13.458927 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.458899 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.463114 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.463088 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 02 02:06:13.463441 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.463412 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 02 02:06:13.463631 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.463531 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vbpkd\"" Jun 02 02:06:13.465569 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.465490 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46"] Jun 02 02:06:13.649373 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.649342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.649567 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.649405 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.649567 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.649461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnsm8\" (UniqueName: \"kubernetes.io/projected/1c6a3d06-6780-44a2-8c36-361550d80a73-kube-api-access-mnsm8\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.750591 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.750501 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.750591 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.750545 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnsm8\" (UniqueName: \"kubernetes.io/projected/1c6a3d06-6780-44a2-8c36-361550d80a73-kube-api-access-mnsm8\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.750829 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.750629 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.750983 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.750965 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.751035 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.751002 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.761830 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.761801 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnsm8\" (UniqueName: \"kubernetes.io/projected/1c6a3d06-6780-44a2-8c36-361550d80a73-kube-api-access-mnsm8\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.769618 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.769599 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:13.899808 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.899756 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46"] Jun 02 02:06:13.901215 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:06:13.901189 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c6a3d06_6780_44a2_8c36_361550d80a73.slice/crio-b01f1df06da1aa5cfcb64b6157a43f102a094c492f6388ee7256f72eb477079e WatchSource:0}: Error finding container b01f1df06da1aa5cfcb64b6157a43f102a094c492f6388ee7256f72eb477079e: Status 404 returned error can't find the container with id b01f1df06da1aa5cfcb64b6157a43f102a094c492f6388ee7256f72eb477079e Jun 02 02:06:13.933156 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:13.933118 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" event={"ID":"1c6a3d06-6780-44a2-8c36-361550d80a73","Type":"ContainerStarted","Data":"b01f1df06da1aa5cfcb64b6157a43f102a094c492f6388ee7256f72eb477079e"} Jun 02 02:06:14.937845 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:14.937806 2560 generic.go:358] "Generic (PLEG): container finished" podID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerID="6014cebf666e8bc995faa253eee36780c78d33cb6aacdd1b11b0aea3684940df" exitCode=0 Jun 02 02:06:14.938221 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:14.937892 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" event={"ID":"1c6a3d06-6780-44a2-8c36-361550d80a73","Type":"ContainerDied","Data":"6014cebf666e8bc995faa253eee36780c78d33cb6aacdd1b11b0aea3684940df"} Jun 02 02:06:15.943683 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:15.943644 2560 generic.go:358] "Generic (PLEG): container finished" podID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerID="f0e1ee0f8ad2be16115b89fff4007ef3d956dbb811bdb36942bf2fc7feca8cbf" exitCode=0 Jun 02 02:06:15.944111 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:15.943730 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" event={"ID":"1c6a3d06-6780-44a2-8c36-361550d80a73","Type":"ContainerDied","Data":"f0e1ee0f8ad2be16115b89fff4007ef3d956dbb811bdb36942bf2fc7feca8cbf"} Jun 02 02:06:16.950810 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:16.950776 2560 generic.go:358] "Generic (PLEG): container finished" podID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerID="e534b8484f66dcfac2af31f13fd87b0ac64b5ccdd5c0dd0470b04618ddb02fed" exitCode=0 Jun 02 02:06:16.951277 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:16.950852 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" event={"ID":"1c6a3d06-6780-44a2-8c36-361550d80a73","Type":"ContainerDied","Data":"e534b8484f66dcfac2af31f13fd87b0ac64b5ccdd5c0dd0470b04618ddb02fed"} Jun 02 02:06:18.081512 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.081487 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:18.192920 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.192871 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnsm8\" (UniqueName: \"kubernetes.io/projected/1c6a3d06-6780-44a2-8c36-361550d80a73-kube-api-access-mnsm8\") pod \"1c6a3d06-6780-44a2-8c36-361550d80a73\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " Jun 02 02:06:18.193096 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.192981 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-bundle\") pod \"1c6a3d06-6780-44a2-8c36-361550d80a73\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " Jun 02 02:06:18.193096 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.193037 2560 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-util\") pod \"1c6a3d06-6780-44a2-8c36-361550d80a73\" (UID: \"1c6a3d06-6780-44a2-8c36-361550d80a73\") " Jun 02 02:06:18.193432 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.193403 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-bundle" (OuterVolumeSpecName: "bundle") pod "1c6a3d06-6780-44a2-8c36-361550d80a73" (UID: "1c6a3d06-6780-44a2-8c36-361550d80a73"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:06:18.195112 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.195084 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c6a3d06-6780-44a2-8c36-361550d80a73-kube-api-access-mnsm8" (OuterVolumeSpecName: "kube-api-access-mnsm8") pod "1c6a3d06-6780-44a2-8c36-361550d80a73" (UID: "1c6a3d06-6780-44a2-8c36-361550d80a73"). InnerVolumeSpecName "kube-api-access-mnsm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 02:06:18.201428 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.201403 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-util" (OuterVolumeSpecName: "util") pod "1c6a3d06-6780-44a2-8c36-361550d80a73" (UID: "1c6a3d06-6780-44a2-8c36-361550d80a73"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 02:06:18.294610 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.294570 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnsm8\" (UniqueName: \"kubernetes.io/projected/1c6a3d06-6780-44a2-8c36-361550d80a73-kube-api-access-mnsm8\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:06:18.294610 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.294607 2560 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-bundle\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:06:18.294610 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.294617 2560 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1c6a3d06-6780-44a2-8c36-361550d80a73-util\") on node \"ip-10-0-134-54.ec2.internal\" DevicePath \"\"" Jun 02 02:06:18.959776 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.959717 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" event={"ID":"1c6a3d06-6780-44a2-8c36-361550d80a73","Type":"ContainerDied","Data":"b01f1df06da1aa5cfcb64b6157a43f102a094c492f6388ee7256f72eb477079e"} Jun 02 02:06:18.959776 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.959757 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b01f1df06da1aa5cfcb64b6157a43f102a094c492f6388ee7256f72eb477079e" Jun 02 02:06:18.959776 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:18.959757 2560 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70f2t46" Jun 02 02:06:21.067001 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.066972 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-crktl"] Jun 02 02:06:21.067405 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.067325 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerName="extract" Jun 02 02:06:21.067405 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.067338 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerName="extract" Jun 02 02:06:21.067405 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.067355 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerName="pull" Jun 02 02:06:21.067405 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.067364 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerName="pull" Jun 02 02:06:21.067405 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.067383 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerName="util" Jun 02 02:06:21.067405 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.067389 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerName="util" Jun 02 02:06:21.067748 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.067437 2560 memory_manager.go:356] "RemoveStaleState removing state" podUID="1c6a3d06-6780-44a2-8c36-361550d80a73" containerName="extract" Jun 02 02:06:21.073267 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.073250 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" Jun 02 02:06:21.075988 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.075959 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 02:06:21.076670 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.076646 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 02:06:21.077317 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.077298 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-wqm2j\"" Jun 02 02:06:21.080997 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.080974 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-crktl"] Jun 02 02:06:21.217536 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.217503 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh4dk\" (UniqueName: \"kubernetes.io/projected/c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e-kube-api-access-jh4dk\") pod \"keycloak-operator-7864d68cbd-crktl\" (UID: \"c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" Jun 02 02:06:21.318546 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.318441 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jh4dk\" (UniqueName: \"kubernetes.io/projected/c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e-kube-api-access-jh4dk\") pod \"keycloak-operator-7864d68cbd-crktl\" (UID: \"c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" Jun 02 02:06:21.333518 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.333491 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh4dk\" (UniqueName: \"kubernetes.io/projected/c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e-kube-api-access-jh4dk\") pod \"keycloak-operator-7864d68cbd-crktl\" (UID: \"c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" Jun 02 02:06:21.384310 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.384269 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" Jun 02 02:06:21.532810 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.532779 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-crktl"] Jun 02 02:06:21.535274 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:06:21.535240 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f4d7e1_c0eb_4b24_96c0_bc8e070bc85e.slice/crio-14ef3e31bff88c44bd6ed3cbb84a8059f136666a6bbac7729c512c64ff9b4016 WatchSource:0}: Error finding container 14ef3e31bff88c44bd6ed3cbb84a8059f136666a6bbac7729c512c64ff9b4016: Status 404 returned error can't find the container with id 14ef3e31bff88c44bd6ed3cbb84a8059f136666a6bbac7729c512c64ff9b4016 Jun 02 02:06:21.971526 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:21.971491 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" event={"ID":"c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e","Type":"ContainerStarted","Data":"14ef3e31bff88c44bd6ed3cbb84a8059f136666a6bbac7729c512c64ff9b4016"} Jun 02 02:06:26.998239 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:26.998200 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" event={"ID":"c4f4d7e1-c0eb-4b24-96c0-bc8e070bc85e","Type":"ContainerStarted","Data":"27e8a2bc3704517fc6708ceffc578a5fad625acb83559e08579295fd69dc19a4"} Jun 02 02:06:27.016104 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:06:27.016048 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-crktl" podStartSLOduration=0.642782872 podStartE2EDuration="6.016032676s" podCreationTimestamp="2026-06-02 02:06:21 +0000 UTC" firstStartedPulling="2026-06-02 02:06:21.536717847 +0000 UTC m=+644.359126523" lastFinishedPulling="2026-06-02 02:06:26.90996765 +0000 UTC m=+649.732376327" observedRunningTime="2026-06-02 02:06:27.01275276 +0000 UTC m=+649.835161456" watchObservedRunningTime="2026-06-02 02:06:27.016032676 +0000 UTC m=+649.838441370" Jun 02 02:09:22.884302 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.884264 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9"] Jun 02 02:09:22.887630 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.887612 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:22.890454 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.890431 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 02:09:22.890585 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.890568 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 02:09:22.891850 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.891826 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t72zz\"" Jun 02 02:09:22.891968 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.891827 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 02 02:09:22.898103 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.898081 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9"] Jun 02 02:09:22.980890 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.980853 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:22.980890 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.980898 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce307124-6674-48b7-997e-a6f08f5bdf20-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:22.981115 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.980920 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:22.981115 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.981022 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:22.981115 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.981060 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:22.981115 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:22.981102 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvx92\" (UniqueName: \"kubernetes.io/projected/ce307124-6674-48b7-997e-a6f08f5bdf20-kube-api-access-cvx92\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082228 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082191 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082228 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082232 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce307124-6674-48b7-997e-a6f08f5bdf20-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082480 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082253 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082480 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082284 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082480 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082319 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082480 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082350 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cvx92\" (UniqueName: \"kubernetes.io/projected/ce307124-6674-48b7-997e-a6f08f5bdf20-kube-api-access-cvx92\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082680 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082584 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082680 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.082841 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.082820 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.084501 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.084481 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce307124-6674-48b7-997e-a6f08f5bdf20-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.084791 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.084749 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce307124-6674-48b7-997e-a6f08f5bdf20-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.090171 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.090147 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvx92\" (UniqueName: \"kubernetes.io/projected/ce307124-6674-48b7-997e-a6f08f5bdf20-kube-api-access-cvx92\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9\" (UID: \"ce307124-6674-48b7-997e-a6f08f5bdf20\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.201295 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.201192 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:23.341649 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.341622 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9"] Jun 02 02:09:23.343533 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:09:23.343499 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce307124_6674_48b7_997e_a6f08f5bdf20.slice/crio-228131b1ee9b2ca15ca47f69f88bb346397bd7212ecd65de6fa226c647fcb6c8 WatchSource:0}: Error finding container 228131b1ee9b2ca15ca47f69f88bb346397bd7212ecd65de6fa226c647fcb6c8: Status 404 returned error can't find the container with id 228131b1ee9b2ca15ca47f69f88bb346397bd7212ecd65de6fa226c647fcb6c8 Jun 02 02:09:23.345478 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.345457 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:09:23.658728 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:23.658692 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" event={"ID":"ce307124-6674-48b7-997e-a6f08f5bdf20","Type":"ContainerStarted","Data":"228131b1ee9b2ca15ca47f69f88bb346397bd7212ecd65de6fa226c647fcb6c8"} Jun 02 02:09:26.671572 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:26.671527 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" event={"ID":"ce307124-6674-48b7-997e-a6f08f5bdf20","Type":"ContainerStarted","Data":"f666c56e2b96d5f812558a4739dabdc9e23902bea34a623c7ce488748c790145"} Jun 02 02:09:27.677498 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:27.677461 2560 generic.go:358] "Generic (PLEG): container finished" podID="ce307124-6674-48b7-997e-a6f08f5bdf20" containerID="f666c56e2b96d5f812558a4739dabdc9e23902bea34a623c7ce488748c790145" exitCode=0 Jun 02 02:09:27.677932 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:27.677506 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" event={"ID":"ce307124-6674-48b7-997e-a6f08f5bdf20","Type":"ContainerDied","Data":"f666c56e2b96d5f812558a4739dabdc9e23902bea34a623c7ce488748c790145"} Jun 02 02:09:29.687086 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:29.687053 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" event={"ID":"ce307124-6674-48b7-997e-a6f08f5bdf20","Type":"ContainerStarted","Data":"5d12cfa1433c5cc44409018fd9e4742f0800c4d6729c3b1318796f824f59f70e"} Jun 02 02:09:29.708694 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:29.708645 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" podStartSLOduration=2.18033971 podStartE2EDuration="7.708628407s" podCreationTimestamp="2026-06-02 02:09:22 +0000 UTC" firstStartedPulling="2026-06-02 02:09:23.345596767 +0000 UTC m=+826.168005439" lastFinishedPulling="2026-06-02 02:09:28.873885464 +0000 UTC m=+831.696294136" observedRunningTime="2026-06-02 02:09:29.70721014 +0000 UTC m=+832.529618846" watchObservedRunningTime="2026-06-02 02:09:29.708628407 +0000 UTC m=+832.531037104" Jun 02 02:09:33.201699 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:33.201657 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:33.202123 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:33.201816 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:33.214455 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:33.214427 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:09:33.712719 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:09:33.712690 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9" Jun 02 02:10:12.272496 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.272464 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh"] Jun 02 02:10:12.276070 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.276044 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.278740 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.278714 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 02:10:12.290791 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.288201 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh"] Jun 02 02:10:12.396502 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.396446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dlfg\" (UniqueName: \"kubernetes.io/projected/87f96bc2-a77c-4a28-95f5-d65fee632412-kube-api-access-7dlfg\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.396502 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.396504 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.396807 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.396609 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87f96bc2-a77c-4a28-95f5-d65fee632412-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.396807 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.396684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.396807 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.396751 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.396951 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.396826 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497259 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497206 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497457 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497275 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497457 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497322 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dlfg\" (UniqueName: \"kubernetes.io/projected/87f96bc2-a77c-4a28-95f5-d65fee632412-kube-api-access-7dlfg\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497457 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497349 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497457 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497388 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87f96bc2-a77c-4a28-95f5-d65fee632412-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497457 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497426 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497717 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497693 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497807 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497690 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.497875 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.497846 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.499800 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.499750 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87f96bc2-a77c-4a28-95f5-d65fee632412-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.499989 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.499973 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87f96bc2-a77c-4a28-95f5-d65fee632412-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.505853 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.505829 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dlfg\" (UniqueName: \"kubernetes.io/projected/87f96bc2-a77c-4a28-95f5-d65fee632412-kube-api-access-7dlfg\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh\" (UID: \"87f96bc2-a77c-4a28-95f5-d65fee632412\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.587100 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.587007 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:12.720209 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.720054 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh"] Jun 02 02:10:12.723036 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:10:12.723001 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f96bc2_a77c_4a28_95f5_d65fee632412.slice/crio-35e29b44cc52008bcda1501971b765fb57ba893024b7bf2e5ce474aafea24021 WatchSource:0}: Error finding container 35e29b44cc52008bcda1501971b765fb57ba893024b7bf2e5ce474aafea24021: Status 404 returned error can't find the container with id 35e29b44cc52008bcda1501971b765fb57ba893024b7bf2e5ce474aafea24021 Jun 02 02:10:12.853890 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.853806 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" event={"ID":"87f96bc2-a77c-4a28-95f5-d65fee632412","Type":"ContainerStarted","Data":"79b181f4ae5bc1771e09e9edd01be1c3f98b8603c0ed7d92f810a29bc16819ce"} Jun 02 02:10:12.853890 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:12.853846 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" event={"ID":"87f96bc2-a77c-4a28-95f5-d65fee632412","Type":"ContainerStarted","Data":"35e29b44cc52008bcda1501971b765fb57ba893024b7bf2e5ce474aafea24021"} Jun 02 02:10:21.888100 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:21.888059 2560 generic.go:358] "Generic (PLEG): container finished" podID="87f96bc2-a77c-4a28-95f5-d65fee632412" containerID="79b181f4ae5bc1771e09e9edd01be1c3f98b8603c0ed7d92f810a29bc16819ce" exitCode=0 Jun 02 02:10:21.888545 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:21.888137 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" event={"ID":"87f96bc2-a77c-4a28-95f5-d65fee632412","Type":"ContainerDied","Data":"79b181f4ae5bc1771e09e9edd01be1c3f98b8603c0ed7d92f810a29bc16819ce"} Jun 02 02:10:22.893516 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:22.893478 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" event={"ID":"87f96bc2-a77c-4a28-95f5-d65fee632412","Type":"ContainerStarted","Data":"f61fba155818862392aceb91b8da292a6eb85f332fcfba6f4ac61bc0af0d892d"} Jun 02 02:10:22.913174 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:22.913126 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" podStartSLOduration=10.637105129 podStartE2EDuration="10.913111215s" podCreationTimestamp="2026-06-02 02:10:12 +0000 UTC" firstStartedPulling="2026-06-02 02:10:21.888728579 +0000 UTC m=+884.711137252" lastFinishedPulling="2026-06-02 02:10:22.164734657 +0000 UTC m=+884.987143338" observedRunningTime="2026-06-02 02:10:22.911783735 +0000 UTC m=+885.734192422" watchObservedRunningTime="2026-06-02 02:10:22.913111215 +0000 UTC m=+885.735519908" Jun 02 02:10:32.587980 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:32.587935 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:32.587980 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:32.587984 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:32.601114 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:32.601080 2560 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:32.944367 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:32.944284 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh" Jun 02 02:10:37.621923 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:37.621895 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:10:37.622350 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:10:37.622315 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:15:37.661571 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:37.661543 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:15:37.664327 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:37.664296 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:15:41.677842 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:41.677811 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-765cfc44cf-cm5tb_5b32ed88-66c2-4fd0-8ba4-9a6e181af401/nginx/0.log" Jun 02 02:15:41.783513 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:41.783481 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-gcc5w_c598cd7b-eb7e-47cc-b88c-292bf84644a2/manager/0.log" Jun 02 02:15:41.896177 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:41.896148 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-lm57b_12ac4e63-2315-411c-89d3-f9c9edc0627a/manager/0.log" Jun 02 02:15:42.480311 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:42.480218 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-vt6vk_a494c7e3-de4d-402a-8d8d-0f5d3a04f607/manager/0.log" Jun 02 02:15:42.706676 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:42.706646 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-fhpnk_eb117e1b-dcfe-4c0b-980c-86a4c2394a87/copy-manifests/0.log" Jun 02 02:15:42.719199 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:42.719175 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-fhpnk_eb117e1b-dcfe-4c0b-980c-86a4c2394a87/manager/0.log" Jun 02 02:15:42.947320 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:42.947291 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6gxs5_5d7bbd50-55fc-4868-8b19-6de519acb692/postgres/0.log" Jun 02 02:15:43.726809 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.726757 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9_ff08c9ad-c99a-40cb-8165-3019927e7c05/util/0.log" Jun 02 02:15:43.732865 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.732840 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9_ff08c9ad-c99a-40cb-8165-3019927e7c05/pull/0.log" Jun 02 02:15:43.738847 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.738827 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9_ff08c9ad-c99a-40cb-8165-3019927e7c05/extract/0.log" Jun 02 02:15:43.848745 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.848717 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq_eafb467a-7a13-4ac6-86d7-52006d587241/util/0.log" Jun 02 02:15:43.855204 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.855185 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq_eafb467a-7a13-4ac6-86d7-52006d587241/pull/0.log" Jun 02 02:15:43.861558 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.861542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq_eafb467a-7a13-4ac6-86d7-52006d587241/extract/0.log" Jun 02 02:15:43.971179 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.971145 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg_5f2534ae-be21-4085-ab14-ba264e0e6fad/util/0.log" Jun 02 02:15:43.977964 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.977902 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg_5f2534ae-be21-4085-ab14-ba264e0e6fad/pull/0.log" Jun 02 02:15:43.984247 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:43.984225 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg_5f2534ae-be21-4085-ab14-ba264e0e6fad/extract/0.log" Jun 02 02:15:44.097437 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:44.097408 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch_3afab1ea-8bda-4453-9361-3835115b7e3e/util/0.log" Jun 02 02:15:44.104252 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:44.104231 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch_3afab1ea-8bda-4453-9361-3835115b7e3e/pull/0.log" Jun 02 02:15:44.110192 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:44.110171 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch_3afab1ea-8bda-4453-9361-3835115b7e3e/extract/0.log" Jun 02 02:15:44.446211 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:44.446183 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-dtx2b_9c4ea94a-788a-42b0-8d62-ca4001489ccd/manager/0.log" Jun 02 02:15:44.779027 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:44.778983 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-jgmr9_a124786e-43a6-477d-bd58-75684044f2a9/manager/0.log" Jun 02 02:15:45.463505 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:45.463472 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-c7plw_5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990/discovery/0.log" Jun 02 02:15:45.677418 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:45.677389 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5797d968-7h49l_d989de2e-1a74-49e7-a8a6-feb573251cce/kube-auth-proxy/0.log" Jun 02 02:15:46.452879 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:46.452850 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9_ce307124-6674-48b7-997e-a6f08f5bdf20/storage-initializer/0.log" Jun 02 02:15:46.460262 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:46.460235 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-dkmp9_ce307124-6674-48b7-997e-a6f08f5bdf20/main/0.log" Jun 02 02:15:46.923726 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:46.923694 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh_87f96bc2-a77c-4a28-95f5-d65fee632412/storage-initializer/0.log" Jun 02 02:15:46.932850 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:46.932825 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-7qfhh_87f96bc2-a77c-4a28-95f5-d65fee632412/main/0.log" Jun 02 02:15:53.537946 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:53.537915 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vrztt_3b5f8112-ad43-4167-bd59-3d749646ec74/global-pull-secret-syncer/0.log" Jun 02 02:15:53.629670 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:53.629641 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-562xl_9f1fbf4a-ccd0-4686-b40d-7e1be4351ed9/konnectivity-agent/0.log" Jun 02 02:15:53.733136 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:53.733111 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-54.ec2.internal_30e5e45055e5bef559a23f3bde5c0818/haproxy/0.log" Jun 02 02:15:57.635355 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.635318 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9_ff08c9ad-c99a-40cb-8165-3019927e7c05/extract/0.log" Jun 02 02:15:57.667306 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.667273 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9_ff08c9ad-c99a-40cb-8165-3019927e7c05/util/0.log" Jun 02 02:15:57.694329 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.694302 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7598gsz9_ff08c9ad-c99a-40cb-8165-3019927e7c05/pull/0.log" Jun 02 02:15:57.724926 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.724902 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq_eafb467a-7a13-4ac6-86d7-52006d587241/extract/0.log" Jun 02 02:15:57.752097 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.752071 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq_eafb467a-7a13-4ac6-86d7-52006d587241/util/0.log" Jun 02 02:15:57.775619 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.775582 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wkntq_eafb467a-7a13-4ac6-86d7-52006d587241/pull/0.log" Jun 02 02:15:57.805152 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.805126 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg_5f2534ae-be21-4085-ab14-ba264e0e6fad/extract/0.log" Jun 02 02:15:57.827448 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.827423 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg_5f2534ae-be21-4085-ab14-ba264e0e6fad/util/0.log" Jun 02 02:15:57.852187 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.852160 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73cd8vg_5f2534ae-be21-4085-ab14-ba264e0e6fad/pull/0.log" Jun 02 02:15:57.888039 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.887960 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch_3afab1ea-8bda-4453-9361-3835115b7e3e/extract/0.log" Jun 02 02:15:57.909954 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.909927 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch_3afab1ea-8bda-4453-9361-3835115b7e3e/util/0.log" Jun 02 02:15:57.932909 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:57.932883 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xv8ch_3afab1ea-8bda-4453-9361-3835115b7e3e/pull/0.log" Jun 02 02:15:58.057332 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:58.057301 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-dtx2b_9c4ea94a-788a-42b0-8d62-ca4001489ccd/manager/0.log" Jun 02 02:15:58.178608 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:15:58.178533 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-jgmr9_a124786e-43a6-477d-bd58-75684044f2a9/manager/0.log" Jun 02 02:16:00.135177 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:00.135144 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7xj26_94227962-2520-4620-b1d5-a257be22899d/node-exporter/0.log" Jun 02 02:16:00.162743 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:00.162717 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7xj26_94227962-2520-4620-b1d5-a257be22899d/kube-rbac-proxy/0.log" Jun 02 02:16:00.186991 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:00.186962 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7xj26_94227962-2520-4620-b1d5-a257be22899d/init-textfile/0.log" Jun 02 02:16:02.080496 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.080458 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-5ztjr_a9e7dcbc-9c49-464d-8f1f-f3ffa75403e1/networking-console-plugin/0.log" Jun 02 02:16:02.709117 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.709075 2560 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z"] Jun 02 02:16:02.711451 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.711428 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.714093 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.714071 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cwwm7\"/\"kube-root-ca.crt\"" Jun 02 02:16:02.715310 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.715291 2560 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cwwm7\"/\"default-dockercfg-rb8ww\"" Jun 02 02:16:02.715400 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.715312 2560 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cwwm7\"/\"openshift-service-ca.crt\"" Jun 02 02:16:02.719629 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.719605 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z"] Jun 02 02:16:02.790191 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.790148 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5l2n\" (UniqueName: \"kubernetes.io/projected/127fc039-e892-4645-bfcc-2cbbb325b476-kube-api-access-c5l2n\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.790375 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.790197 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-lib-modules\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.790375 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.790228 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-sys\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.790375 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.790313 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-proc\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.790375 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.790342 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-podres\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.891776 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.891718 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5l2n\" (UniqueName: \"kubernetes.io/projected/127fc039-e892-4645-bfcc-2cbbb325b476-kube-api-access-c5l2n\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.891977 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.891804 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-lib-modules\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.891977 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.891840 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-sys\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.891977 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.891913 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-proc\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.891977 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.891936 2560 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-podres\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.892149 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.892018 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-sys\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.892149 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.892022 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-proc\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.892149 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.892021 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-lib-modules\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.892149 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.892119 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/127fc039-e892-4645-bfcc-2cbbb325b476-podres\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:02.899879 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:02.899851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5l2n\" (UniqueName: \"kubernetes.io/projected/127fc039-e892-4645-bfcc-2cbbb325b476-kube-api-access-c5l2n\") pod \"perf-node-gather-daemonset-jsj2z\" (UID: \"127fc039-e892-4645-bfcc-2cbbb325b476\") " pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:03.022319 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:03.022289 2560 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:03.154263 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:03.154235 2560 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z"] Jun 02 02:16:03.157039 ip-10-0-134-54 kubenswrapper[2560]: W0602 02:16:03.157009 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod127fc039_e892_4645_bfcc_2cbbb325b476.slice/crio-039e9c8bb4b3af9c80a27606909e3f272fbfdbc9690e3fb0e01c1d425e40adf9 WatchSource:0}: Error finding container 039e9c8bb4b3af9c80a27606909e3f272fbfdbc9690e3fb0e01c1d425e40adf9: Status 404 returned error can't find the container with id 039e9c8bb4b3af9c80a27606909e3f272fbfdbc9690e3fb0e01c1d425e40adf9 Jun 02 02:16:03.158722 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:03.158704 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 02:16:03.182150 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:03.182120 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" event={"ID":"127fc039-e892-4645-bfcc-2cbbb325b476","Type":"ContainerStarted","Data":"039e9c8bb4b3af9c80a27606909e3f272fbfdbc9690e3fb0e01c1d425e40adf9"} Jun 02 02:16:04.187151 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:04.187116 2560 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" event={"ID":"127fc039-e892-4645-bfcc-2cbbb325b476","Type":"ContainerStarted","Data":"15ee9c450bc32fb13b9e26df8f093e29a81d7281d0af4f8c5d532dcc41b8d99b"} Jun 02 02:16:04.187554 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:04.187202 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:04.203502 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:04.203453 2560 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" podStartSLOduration=2.203441076 podStartE2EDuration="2.203441076s" podCreationTimestamp="2026-06-02 02:16:02 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 02:16:04.201644835 +0000 UTC m=+1227.024053531" watchObservedRunningTime="2026-06-02 02:16:04.203441076 +0000 UTC m=+1227.025849773" Jun 02 02:16:04.640379 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:04.640348 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8vpn_66bb65ba-cde3-46a8-a403-784a9efcfec4/dns/0.log" Jun 02 02:16:04.661847 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:04.661808 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t8vpn_66bb65ba-cde3-46a8-a403-784a9efcfec4/kube-rbac-proxy/0.log" Jun 02 02:16:04.703207 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:04.703179 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9qpvq_b76b50db-cb13-4227-b38e-0f8d2fcafbae/dns-node-resolver/0.log" Jun 02 02:16:05.354495 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:05.354468 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b5922_4767abf9-3872-475e-bba4-c76c53504638/node-ca/0.log" Jun 02 02:16:06.329050 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:06.329021 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-c7plw_5a7f7663-2b7e-4cdf-98bb-27fa3e5f1990/discovery/0.log" Jun 02 02:16:06.376066 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:06.376041 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f5797d968-7h49l_d989de2e-1a74-49e7-a8a6-feb573251cce/kube-auth-proxy/0.log" Jun 02 02:16:07.106566 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:07.106542 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kt6w6_1c18895b-d62e-4d56-ba81-9a936df42be7/serve-healthcheck-canary/0.log" Jun 02 02:16:07.762519 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:07.762483 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlzst_a5409855-a56a-4812-8bfb-686a8ac56175/kube-rbac-proxy/0.log" Jun 02 02:16:07.784571 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:07.784535 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlzst_a5409855-a56a-4812-8bfb-686a8ac56175/exporter/0.log" Jun 02 02:16:07.806165 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:07.806112 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wlzst_a5409855-a56a-4812-8bfb-686a8ac56175/extractor/0.log" Jun 02 02:16:09.787160 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:09.787132 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-765cfc44cf-cm5tb_5b32ed88-66c2-4fd0-8ba4-9a6e181af401/nginx/0.log" Jun 02 02:16:09.811690 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:09.811652 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-gcc5w_c598cd7b-eb7e-47cc-b88c-292bf84644a2/manager/0.log" Jun 02 02:16:09.862583 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:09.862554 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-lm57b_12ac4e63-2315-411c-89d3-f9c9edc0627a/manager/0.log" Jun 02 02:16:10.003128 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:10.003101 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-vt6vk_a494c7e3-de4d-402a-8d8d-0f5d3a04f607/manager/0.log" Jun 02 02:16:10.140242 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:10.140154 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-fhpnk_eb117e1b-dcfe-4c0b-980c-86a4c2394a87/manager/0.log" Jun 02 02:16:10.157744 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:10.157718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d47575757-fhpnk_eb117e1b-dcfe-4c0b-980c-86a4c2394a87/copy-manifests/0.log" Jun 02 02:16:10.200815 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:10.200755 2560 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cwwm7/perf-node-gather-daemonset-jsj2z" Jun 02 02:16:10.237093 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:10.237064 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-6gxs5_5d7bbd50-55fc-4868-8b19-6de519acb692/postgres/0.log" Jun 02 02:16:11.808891 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:11.808860 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-mmwx4_4690e2ec-52aa-4735-bfe8-0e41397138a3/openshift-lws-operator/0.log" Jun 02 02:16:18.114566 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.114539 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-782bq_06f6ff7f-86f7-4d7f-9ccd-8b4b70bc1385/kube-multus/0.log" Jun 02 02:16:18.142112 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.142082 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mpbn8_035beb85-018f-4b96-996b-61ec31f45b19/kube-multus-additional-cni-plugins/0.log" Jun 02 02:16:18.167734 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.167704 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mpbn8_035beb85-018f-4b96-996b-61ec31f45b19/egress-router-binary-copy/0.log" Jun 02 02:16:18.191579 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.191552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mpbn8_035beb85-018f-4b96-996b-61ec31f45b19/cni-plugins/0.log" Jun 02 02:16:18.214448 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.214426 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mpbn8_035beb85-018f-4b96-996b-61ec31f45b19/bond-cni-plugin/0.log" Jun 02 02:16:18.237142 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.237120 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mpbn8_035beb85-018f-4b96-996b-61ec31f45b19/routeoverride-cni/0.log" Jun 02 02:16:18.258590 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.258568 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mpbn8_035beb85-018f-4b96-996b-61ec31f45b19/whereabouts-cni-bincopy/0.log" Jun 02 02:16:18.281935 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.281912 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mpbn8_035beb85-018f-4b96-996b-61ec31f45b19/whereabouts-cni/0.log" Jun 02 02:16:18.692918 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.692889 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5crbq_310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44/network-metrics-daemon/0.log" Jun 02 02:16:18.713293 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:18.713269 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5crbq_310b5ea6-fe8c-4364-adc3-ba7b4eeb3e44/kube-rbac-proxy/0.log" Jun 02 02:16:19.657335 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.657254 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-controller/0.log" Jun 02 02:16:19.678570 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.678540 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/0.log" Jun 02 02:16:19.683879 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.683858 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovn-acl-logging/1.log" Jun 02 02:16:19.704630 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.704605 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/kube-rbac-proxy-node/0.log" Jun 02 02:16:19.727633 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.727608 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 02:16:19.749927 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.749902 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/northd/0.log" Jun 02 02:16:19.773652 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.773628 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/nbdb/0.log" Jun 02 02:16:19.797642 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.797623 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/sbdb/0.log" Jun 02 02:16:19.895696 ip-10-0-134-54 kubenswrapper[2560]: I0602 02:16:19.895664 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7js2s_30a65403-2c59-4183-a4de-c90b19da6df7/ovnkube-controller/0.log"