Jun 03 01:04:33.536915 ip-10-0-132-82 systemd[1]: Starting Kubernetes Kubelet... Jun 03 01:04:34.028273 ip-10-0-132-82 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:34.028273 ip-10-0-132-82 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 01:04:34.028273 ip-10-0-132-82 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:34.028273 ip-10-0-132-82 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 01:04:34.028273 ip-10-0-132-82 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 01:04:34.030119 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.030028 2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 01:04:34.033671 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033654 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.033671 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033671 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033675 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033679 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033682 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033685 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033688 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033691 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033693 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033696 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033699 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033702 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033704 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033707 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033710 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033713 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033715 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033718 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033721 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033723 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033726 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.033740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033729 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033740 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033743 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033746 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033749 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033751 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033754 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033757 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033760 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033763 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033766 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033768 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033771 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033774 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033776 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033779 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033781 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033784 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033786 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033789 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.034206 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033792 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033794 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033797 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033799 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033802 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033804 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033808 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033810 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033813 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033816 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033819 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033821 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033823 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033826 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033830 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033832 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033835 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033838 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033840 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033843 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.034851 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033846 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033850 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033854 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033857 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033862 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033865 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033869 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033872 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033875 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033877 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033880 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033883 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033886 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033889 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033892 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033894 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033897 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033899 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033902 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.035431 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033904 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033907 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033909 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033912 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033915 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.033917 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034309 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034315 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034319 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034321 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034325 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034328 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034330 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034333 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034336 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034338 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034341 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034343 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034346 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034349 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.035910 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034352 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034354 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034357 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034360 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034362 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034365 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034368 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034371 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034373 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034376 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034378 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034382 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034385 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034388 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034391 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034394 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034396 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034399 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034401 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.036412 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034405 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034408 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034410 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034413 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034416 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034418 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034421 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034423 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034426 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034428 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034431 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034433 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034436 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034439 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034441 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034444 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034446 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034449 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034451 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034454 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.036950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034457 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034459 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034462 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034464 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034483 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034488 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034491 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034493 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034497 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034501 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034505 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034509 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034514 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034518 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034522 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034526 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034530 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034534 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034538 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.037438 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034543 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034547 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034551 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034555 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034559 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034563 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034567 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034572 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034576 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034580 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034585 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034590 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034595 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.034599 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034698 2556 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034708 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034716 2556 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034723 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034730 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034735 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034742 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 01:04:34.037936 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034755 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034760 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034765 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034771 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034777 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034782 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034788 2556 flags.go:64] FLAG: --cgroup-root="" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034793 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034796 2556 flags.go:64] FLAG: --client-ca-file="" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034799 2556 flags.go:64] FLAG: --cloud-config="" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034802 2556 flags.go:64] FLAG: --cloud-provider="external" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034805 2556 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034810 2556 flags.go:64] FLAG: --cluster-domain="" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034814 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034817 2556 flags.go:64] FLAG: --config-dir="" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034820 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034824 2556 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034828 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034831 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034834 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034837 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034840 2556 flags.go:64] FLAG: --contention-profiling="false" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034843 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034846 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034849 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 01:04:34.038444 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034853 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034858 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034861 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034865 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034868 2556 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034871 2556 flags.go:64] FLAG: --enable-server="true" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034874 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034879 2556 flags.go:64] FLAG: --event-burst="100" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034882 2556 flags.go:64] FLAG: --event-qps="50" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034885 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034888 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034891 2556 flags.go:64] FLAG: --eviction-hard="" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034896 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034899 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034902 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034905 2556 flags.go:64] FLAG: --eviction-soft="" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034908 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034911 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034914 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034917 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034923 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034926 2556 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034928 2556 flags.go:64] FLAG: --feature-gates="" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034932 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034935 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 01:04:34.039066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034939 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034942 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034945 2556 flags.go:64] FLAG: --healthz-port="10248" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034948 2556 flags.go:64] FLAG: --help="false" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034951 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034954 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034957 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034960 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034963 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034971 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034974 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034977 2556 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034980 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034983 2556 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034986 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034989 2556 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034992 2556 flags.go:64] FLAG: --kube-reserved="" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034995 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.034998 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035001 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035003 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035006 2556 flags.go:64] FLAG: --lock-file="" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035009 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035012 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 01:04:34.039679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035015 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035020 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035023 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035027 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035030 2556 flags.go:64] FLAG: --logging-format="text" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035033 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035037 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035040 2556 flags.go:64] FLAG: --manifest-url="" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035043 2556 flags.go:64] FLAG: --manifest-url-header="" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035047 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035050 2556 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035055 2556 flags.go:64] FLAG: --max-pods="110" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035058 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035061 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035064 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035067 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035070 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035074 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035077 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035084 2556 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035088 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035091 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035094 2556 flags.go:64] FLAG: --pod-cidr="" Jun 03 01:04:34.040242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035097 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035103 2556 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035106 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035109 2556 flags.go:64] FLAG: --pods-per-core="0" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035111 2556 flags.go:64] FLAG: --port="10250" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035115 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035118 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-029446d0a4cf2ec8d" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035121 2556 flags.go:64] FLAG: --qos-reserved="" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035124 2556 flags.go:64] FLAG: --read-only-port="10255" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035127 2556 flags.go:64] FLAG: --register-node="true" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035130 2556 flags.go:64] FLAG: --register-schedulable="true" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035133 2556 flags.go:64] FLAG: --register-with-taints="" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035138 2556 flags.go:64] FLAG: --registry-burst="10" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035141 2556 flags.go:64] FLAG: --registry-qps="5" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035144 2556 flags.go:64] FLAG: --reserved-cpus="" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035147 2556 flags.go:64] FLAG: --reserved-memory="" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035151 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035154 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035157 2556 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035160 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035163 2556 flags.go:64] FLAG: --runonce="false" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035166 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035169 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035173 2556 flags.go:64] FLAG: --seccomp-default="false" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035176 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035179 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 01:04:34.040833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035182 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035186 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035190 2556 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035193 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035196 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035199 2556 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035202 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035205 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035208 2556 flags.go:64] FLAG: --system-cgroups="" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035211 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035216 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035219 2556 flags.go:64] FLAG: --tls-cert-file="" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035222 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035226 2556 flags.go:64] FLAG: --tls-min-version="" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035229 2556 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035232 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035235 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035238 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035243 2556 flags.go:64] FLAG: --v="2" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035248 2556 flags.go:64] FLAG: --version="false" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035252 2556 flags.go:64] FLAG: --vmodule="" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035256 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.035260 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035373 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.041459 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035377 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035380 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035383 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035386 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035389 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035392 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035395 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035398 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035400 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035404 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035407 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035410 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035412 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035415 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035418 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035421 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035423 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035426 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035428 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035431 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.042068 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035434 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035437 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035440 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035443 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035446 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035448 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035453 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035456 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035458 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035461 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035463 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035485 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035489 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035492 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035494 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035497 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035501 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035505 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035508 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035510 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.042668 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035513 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035517 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035520 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035523 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035526 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035529 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035532 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035534 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035537 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035540 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035542 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035545 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035548 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035550 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035553 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035556 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035558 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035561 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035569 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.043164 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035572 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035574 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035577 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035580 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035582 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035585 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035587 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035590 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035593 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035595 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035598 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035600 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035603 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035605 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035609 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035612 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035616 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035620 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035623 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035626 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.043651 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035629 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.044140 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035631 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.044140 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035633 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.044140 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035636 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.044140 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035639 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.044140 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.035642 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.044140 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.037096 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:34.044979 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.044960 2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 01:04:34.045022 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.044980 2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 01:04:34.045054 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045035 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.045054 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045041 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.045054 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045045 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.045054 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045047 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.045054 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045051 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.045054 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045054 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.045054 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045057 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045060 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045063 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045066 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045070 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045077 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045083 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045088 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045091 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045094 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045097 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045100 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045103 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045105 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045108 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045110 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045113 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045116 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045118 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045121 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.045226 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045123 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045126 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045129 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045131 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045135 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045139 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045142 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045145 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045147 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045150 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045154 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045158 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045162 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045166 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045172 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045175 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045178 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045180 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045183 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.045734 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045185 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045188 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045191 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045193 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045196 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045199 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045201 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045204 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045206 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045209 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045211 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045214 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045216 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045219 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045221 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045224 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045226 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045229 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045232 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045238 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.046219 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045242 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045247 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045250 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045253 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045255 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045258 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045260 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045264 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045266 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045269 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045272 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045274 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045277 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045280 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045282 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045284 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045287 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045290 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045292 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045295 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.046729 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045297 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.045302 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045411 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045417 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045420 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045424 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045426 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045429 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045432 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045434 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045437 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045439 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045443 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045445 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045448 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045450 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 01:04:34.047209 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045453 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045457 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045459 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045464 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045481 2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045487 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045492 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045495 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045498 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045501 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045503 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045506 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045508 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045511 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045513 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045516 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045519 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045521 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 01:04:34.047628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045523 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045526 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045529 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045531 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045533 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045536 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045538 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045541 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045543 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045546 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045548 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045552 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045555 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045560 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045564 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045568 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045572 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045575 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045578 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045581 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 01:04:34.048057 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045583 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045586 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045588 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045591 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045594 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045596 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045599 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045601 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045604 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045606 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045609 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045611 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045614 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045616 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045618 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045621 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045623 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045626 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045628 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045631 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 01:04:34.048581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045633 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045637 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045640 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045644 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045649 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045654 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045656 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045659 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045661 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045664 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045668 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045670 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045673 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:34.045675 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.045680 2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 01:04:34.049065 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.046417 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 01:04:34.050593 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.050577 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 01:04:34.051533 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.051522 2556 server.go:1019] "Starting client certificate rotation" Jun 03 01:04:34.051636 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.051618 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 01:04:34.052321 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.052310 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 01:04:34.080346 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.080326 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 01:04:34.083215 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.083196 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 01:04:34.100872 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.100842 2556 log.go:25] "Validated CRI v1 runtime API" Jun 03 01:04:34.108636 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.108618 2556 log.go:25] "Validated CRI v1 image API" Jun 03 01:04:34.109818 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.109806 2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 01:04:34.115954 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.115928 2556 fs.go:135] Filesystem UUIDs: map[0068d480-df42-412b-a651-9c9e506ffb86:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7d03faad-1185-49b9-87ad-d826975485a6:/dev/nvme0n1p4] Jun 03 01:04:34.116047 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.115951 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 01:04:34.116047 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.116034 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 01:04:34.120527 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.120371 2556 manager.go:217] Machine: {Timestamp:2026-06-03 01:04:34.119879993 +0000 UTC m=+0.440091656 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100009 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec259df7e2610524483582899ee6165a SystemUUID:ec259df7-e261-0524-4835-82899ee6165a BootID:604ccf2a-30ac-487d-a9c9-b061c1151b9e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9c:3c:f5:2a:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9c:3c:f5:2a:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:98:94:4e:43:42 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 01:04:34.121124 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.121111 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 01:04:34.121235 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.121220 2556 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 01:04:34.123173 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.123148 2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 01:04:34.123306 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.123175 2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-82.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 01:04:34.123374 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.123315 2556 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 01:04:34.123374 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.123323 2556 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 01:04:34.123374 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.123331 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 01:04:34.123374 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.123345 2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 01:04:34.125178 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.125167 2556 state_mem.go:36] "Initialized new in-memory state store" Jun 03 01:04:34.125296 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.125287 2556 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 01:04:34.128365 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.128356 2556 kubelet.go:491] "Attempting to sync node with API server" Jun 03 01:04:34.128365 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.128367 2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 01:04:34.128502 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.128381 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 01:04:34.128502 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.128390 2556 kubelet.go:397] "Adding apiserver pod source" Jun 03 01:04:34.128502 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.128401 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 01:04:34.129774 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.129761 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 01:04:34.129823 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.129780 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 01:04:34.135038 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.135020 2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 01:04:34.136848 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.136834 2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 01:04:34.138677 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138664 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138681 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138688 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138694 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138703 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138720 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138727 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138732 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138740 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 01:04:34.138745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138746 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 01:04:34.138978 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138760 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 01:04:34.138978 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.138766 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 01:04:34.141374 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.141356 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 01:04:34.141456 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.141408 2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 01:04:34.143319 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.143284 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 01:04:34.143412 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.143324 2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-82.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 01:04:34.143461 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.143410 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 01:04:34.145092 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.145077 2556 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 01:04:34.145147 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.145127 2556 server.go:1295] "Started kubelet" Jun 03 01:04:34.145202 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.145181 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 01:04:34.145265 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.145215 2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 01:04:34.145314 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.145286 2556 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 01:04:34.146137 ip-10-0-132-82 systemd[1]: Started Kubernetes Kubelet. Jun 03 01:04:34.146715 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.146377 2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 01:04:34.147361 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.147349 2556 server.go:317] "Adding debug handlers to kubelet server" Jun 03 01:04:34.151293 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.151273 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 01:04:34.151853 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.151836 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 01:04:34.151996 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.151978 2556 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 01:04:34.152058 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.151997 2556 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 01:04:34.152157 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.152074 2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 01:04:34.152209 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.152161 2556 reconstruct.go:97] "Volume reconstruction finished" Jun 03 01:04:34.152209 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.152169 2556 reconciler.go:26] "Reconciler: start to sync state" Jun 03 01:04:34.152963 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.152929 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.153627 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.153611 2556 factory.go:55] Registering systemd factory Jun 03 01:04:34.153627 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.153630 2556 factory.go:223] Registration of the systemd container factory successfully Jun 03 01:04:34.154081 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.154062 2556 factory.go:153] Registering CRI-O factory Jun 03 01:04:34.154081 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.154082 2556 factory.go:223] Registration of the crio container factory successfully Jun 03 01:04:34.154201 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.154132 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 01:04:34.154201 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.154147 2556 factory.go:103] Registering Raw factory Jun 03 01:04:34.154201 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.154161 2556 manager.go:1196] Started watching for new ooms in manager Jun 03 01:04:34.155319 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.155306 2556 manager.go:319] Starting recovery of all containers Jun 03 01:04:34.156207 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.156166 2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 01:04:34.161002 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.160972 2556 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 01:04:34.161200 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.161179 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-82.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 01:04:34.161977 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.160958 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-82.ec2.internal.18b56ca2cb3bc0c8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-82.ec2.internal,UID:ip-10-0-132-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-82.ec2.internal,},FirstTimestamp:2026-06-03 01:04:34.145091784 +0000 UTC m=+0.465303427,LastTimestamp:2026-06-03 01:04:34.145091784 +0000 UTC m=+0.465303427,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-82.ec2.internal,}" Jun 03 01:04:34.166693 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.166535 2556 manager.go:324] Recovery completed Jun 03 01:04:34.169229 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.169194 2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 01:04:34.170883 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.170865 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wrvrz" Jun 03 01:04:34.172660 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.172620 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.174679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.174665 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.174727 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.174692 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.174727 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.174703 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.175179 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.175160 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 01:04:34.175179 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.175176 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 01:04:34.175310 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.175195 2556 state_mem.go:36] "Initialized new in-memory state store" Jun 03 01:04:34.177125 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.177065 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-82.ec2.internal.18b56ca2ccff397f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-82.ec2.internal,UID:ip-10-0-132-82.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-82.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-82.ec2.internal,},FirstTimestamp:2026-06-03 01:04:34.174679423 +0000 UTC m=+0.494891066,LastTimestamp:2026-06-03 01:04:34.174679423 +0000 UTC m=+0.494891066,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-82.ec2.internal,}" Jun 03 01:04:34.177345 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.177326 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wrvrz" Jun 03 01:04:34.177414 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.177372 2556 policy_none.go:49] "None policy: Start" Jun 03 01:04:34.177414 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.177398 2556 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 01:04:34.177414 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.177413 2556 state_mem.go:35] "Initializing new in-memory state store" Jun 03 01:04:34.219131 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.219113 2556 manager.go:341] "Starting Device Plugin manager" Jun 03 01:04:34.219262 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.219149 2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 01:04:34.219262 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.219160 2556 server.go:85] "Starting device plugin registration server" Jun 03 01:04:34.219462 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.219449 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 01:04:34.219528 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.219465 2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 01:04:34.219698 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.219649 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 01:04:34.219804 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.219747 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 01:04:34.219804 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.219757 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 01:04:34.220257 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.220238 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 01:04:34.220342 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.220281 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.278422 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.278344 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 01:04:34.279679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.279663 2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 01:04:34.279767 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.279686 2556 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 01:04:34.279767 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.279711 2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 01:04:34.279767 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.279723 2556 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 01:04:34.279902 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.279770 2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 01:04:34.282997 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.282976 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:34.319642 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.319612 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.320628 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.320611 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.320711 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.320641 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.320711 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.320654 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.320711 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.320678 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.326842 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.326828 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.326887 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.326850 2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-82.ec2.internal\": node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.344665 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.344645 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.380414 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.380365 2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal"] Jun 03 01:04:34.380565 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.380456 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.381417 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.381393 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.381554 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.381427 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.381554 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.381440 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.382889 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.382876 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.383075 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383059 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.383151 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383093 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.383615 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383598 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.383615 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383607 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.383742 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383625 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.383742 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383626 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.383742 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383639 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.383742 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.383647 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.384746 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.384730 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.384789 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.384756 2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 01:04:34.385418 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.385402 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientMemory" Jun 03 01:04:34.385499 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.385432 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 01:04:34.385499 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.385447 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeHasSufficientPID" Jun 03 01:04:34.413273 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.413252 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-82.ec2.internal\" not found" node="ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.417816 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.417797 2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-82.ec2.internal\" not found" node="ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.445749 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.445721 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.454547 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.454527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37ea37eb09bdf53a666260156430e92f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal\" (UID: \"37ea37eb09bdf53a666260156430e92f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.454630 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.454556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ea37eb09bdf53a666260156430e92f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal\" (UID: \"37ea37eb09bdf53a666260156430e92f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.454630 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.454573 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1414ae1b4372e7dbb3b03843f08a2ec9-config\") pod \"kube-apiserver-proxy-ip-10-0-132-82.ec2.internal\" (UID: \"1414ae1b4372e7dbb3b03843f08a2ec9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.546911 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.546842 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.555152 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.555134 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37ea37eb09bdf53a666260156430e92f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal\" (UID: \"37ea37eb09bdf53a666260156430e92f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.555213 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.555159 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ea37eb09bdf53a666260156430e92f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal\" (UID: \"37ea37eb09bdf53a666260156430e92f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.555213 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.555180 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1414ae1b4372e7dbb3b03843f08a2ec9-config\") pod \"kube-apiserver-proxy-ip-10-0-132-82.ec2.internal\" (UID: \"1414ae1b4372e7dbb3b03843f08a2ec9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.555288 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.555236 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37ea37eb09bdf53a666260156430e92f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal\" (UID: \"37ea37eb09bdf53a666260156430e92f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.555288 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.555238 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1414ae1b4372e7dbb3b03843f08a2ec9-config\") pod \"kube-apiserver-proxy-ip-10-0-132-82.ec2.internal\" (UID: \"1414ae1b4372e7dbb3b03843f08a2ec9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.555355 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.555298 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37ea37eb09bdf53a666260156430e92f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal\" (UID: \"37ea37eb09bdf53a666260156430e92f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.647610 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.647567 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.716039 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.716012 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.721497 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:34.721463 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" Jun 03 01:04:34.748509 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.748458 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.849040 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.848936 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:34.949440 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:34.949408 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:35.050020 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:35.049986 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:35.051089 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.051071 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 01:04:35.051229 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.051211 2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 01:04:35.079358 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.079332 2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:35.150590 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:35.150563 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:35.151690 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.151670 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 01:04:35.162429 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.162403 2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 01:04:35.178782 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.178727 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:59:34 +0000 UTC" deadline="2028-02-04 08:41:47.706748863 +0000 UTC" Jun 03 01:04:35.178782 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.178777 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14671h37m12.527974619s" Jun 03 01:04:35.190324 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.190295 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ghqln" Jun 03 01:04:35.198726 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.198705 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ghqln" Jun 03 01:04:35.223093 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:35.223047 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1414ae1b4372e7dbb3b03843f08a2ec9.slice/crio-1c9e98bac7258ebe090f22fcdc33f501d37a28afacf0c8677a2824f1c562522d WatchSource:0}: Error finding container 1c9e98bac7258ebe090f22fcdc33f501d37a28afacf0c8677a2824f1c562522d: Status 404 returned error can't find the container with id 1c9e98bac7258ebe090f22fcdc33f501d37a28afacf0c8677a2824f1c562522d Jun 03 01:04:35.223298 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:35.223279 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ea37eb09bdf53a666260156430e92f.slice/crio-107fd9540b35ee1deb0df9e89806f6815700643e432d930b8b0ea371cb81e3e8 WatchSource:0}: Error finding container 107fd9540b35ee1deb0df9e89806f6815700643e432d930b8b0ea371cb81e3e8: Status 404 returned error can't find the container with id 107fd9540b35ee1deb0df9e89806f6815700643e432d930b8b0ea371cb81e3e8 Jun 03 01:04:35.228313 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.228284 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:04:35.251264 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:35.251234 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:35.273152 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.273126 2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:35.282330 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.282287 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" event={"ID":"1414ae1b4372e7dbb3b03843f08a2ec9","Type":"ContainerStarted","Data":"1c9e98bac7258ebe090f22fcdc33f501d37a28afacf0c8677a2824f1c562522d"} Jun 03 01:04:35.283148 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.283128 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" event={"ID":"37ea37eb09bdf53a666260156430e92f","Type":"ContainerStarted","Data":"107fd9540b35ee1deb0df9e89806f6815700643e432d930b8b0ea371cb81e3e8"} Jun 03 01:04:35.352377 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:35.352349 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:35.452750 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:35.452682 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:35.553100 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:35.553056 2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-82.ec2.internal\" not found" Jun 03 01:04:35.619357 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.619336 2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:35.652721 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.652694 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" Jun 03 01:04:35.665236 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.665207 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 01:04:35.666342 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.666323 2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" Jun 03 01:04:35.675801 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.675780 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 01:04:35.885776 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:35.885699 2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 01:04:36.130488 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.130438 2556 apiserver.go:52] "Watching apiserver" Jun 03 01:04:36.140095 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.140040 2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 01:04:36.140436 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.140412 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-m922r","openshift-image-registry/node-ca-p8gv9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal","openshift-multus/multus-additional-cni-plugins-5z279","openshift-network-diagnostics/network-check-target-64th5","kube-system/global-pull-secret-syncer-hxtfb","kube-system/konnectivity-agent-6sncv","openshift-cluster-node-tuning-operator/tuned-ftjhl","openshift-multus/multus-pl285","openshift-multus/network-metrics-daemon-vf9xt","openshift-network-operator/iptables-alerter-x7b5q","openshift-ovn-kubernetes/ovnkube-node-cnmxp","kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5"] Jun 03 01:04:36.142594 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.142567 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.143584 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.143559 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.143756 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.143738 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.144754 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.144734 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.145284 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.145265 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 01:04:36.145367 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.145300 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2rhwr\"" Jun 03 01:04:36.145367 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.145300 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 01:04:36.145679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.145659 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:36.145759 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.145730 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:36.146227 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.146211 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.146269 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.146237 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w4rvm\"" Jun 03 01:04:36.146781 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.146747 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.146856 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.146780 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 01:04:36.146856 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.146806 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:36.146963 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.146827 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.146963 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.146873 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.147126 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.147108 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.147188 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.147148 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ffp97\"" Jun 03 01:04:36.147542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.147527 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 01:04:36.147627 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.147611 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 01:04:36.147834 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.147821 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pl285" Jun 03 01:04:36.148432 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.148330 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.148432 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.148367 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 01:04:36.148432 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.148387 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-22xnx\"" Jun 03 01:04:36.148432 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.148401 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.148432 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.148419 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 01:04:36.149052 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.149032 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.150163 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.150143 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 01:04:36.150686 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.150299 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.150686 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.150383 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rvwl4\"" Jun 03 01:04:36.151509 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.151494 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.151568 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.151551 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:36.151617 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.151604 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:36.151760 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.151742 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vqww4\"" Jun 03 01:04:36.151842 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.151828 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.153855 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.153013 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.153855 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.153332 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.153855 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.153696 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.154069 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.153924 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wp548\"" Jun 03 01:04:36.154069 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.154023 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 01:04:36.156047 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.156027 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vmh69\"" Jun 03 01:04:36.156131 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.156047 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.156131 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.156089 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.156486 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.156458 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.158693 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.158678 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 01:04:36.158952 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.158938 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 01:04:36.160153 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.160119 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 01:04:36.160209 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.160130 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 01:04:36.160209 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.160133 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9r74\"" Jun 03 01:04:36.160303 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.160211 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 01:04:36.162941 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.162924 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 01:04:36.163677 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cccng\" (UniqueName: \"kubernetes.io/projected/2f24056b-0a92-4e30-b534-c6711db23442-kube-api-access-cccng\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.163720 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f34b3d0-c8f9-4b57-8143-be40b45792bc-konnectivity-ca\") pod \"konnectivity-agent-6sncv\" (UID: \"6f34b3d0-c8f9-4b57-8143-be40b45792bc\") " pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.163778 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163723 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-cnibin\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.163830 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163773 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-cni-multus\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.163830 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:36.163830 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f34b3d0-c8f9-4b57-8143-be40b45792bc-agent-certs\") pod \"konnectivity-agent-6sncv\" (UID: \"6f34b3d0-c8f9-4b57-8143-be40b45792bc\") " pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.163964 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-cni-bin\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.163964 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-sys\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.163964 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-var-lib-kubelet\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.163964 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.163964 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-lib-modules\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.163964 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163926 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwx69\" (UniqueName: \"kubernetes.io/projected/6f1f69d3-8e71-4789-98e5-e0ca691d8929-kube-api-access-bwx69\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.163963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-multus-certs\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc7dm\" (UniqueName: \"kubernetes.io/projected/85de7c04-6c45-4a09-8489-0f99197af1b2-kube-api-access-hc7dm\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97mpf\" (UniqueName: \"kubernetes.io/projected/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-kube-api-access-97mpf\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-cni-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164080 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb15c480-bbd4-416a-97fc-7827fcc384a9-cni-binary-copy\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-daemon-config\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164137 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-sys-fs\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164160 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysctl-d\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-run\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-tmp-dir\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164227 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cnibin\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.164258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-kubelet\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-hostroot\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hd96\" (UniqueName: \"kubernetes.io/projected/eb15c480-bbd4-416a-97fc-7827fcc384a9-kube-api-access-8hd96\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164373 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl9f8\" (UniqueName: \"kubernetes.io/projected/6b125a99-2b32-4323-b6b5-b2994230aa99-kube-api-access-gl9f8\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-registration-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysctl-conf\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-socket-dir-parent\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164564 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b125a99-2b32-4323-b6b5-b2994230aa99-iptables-alerter-script\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164588 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-socket-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164612 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntgt6\" (UniqueName: \"kubernetes.io/projected/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-kube-api-access-ntgt6\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-dbus\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysconfig\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-kubernetes\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164702 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b125a99-2b32-4323-b6b5-b2994230aa99-host-slash\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164728 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-device-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.164887 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164750 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f24056b-0a92-4e30-b534-c6711db23442-tmp\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-hosts-file\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-os-release\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164880 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-k8s-cni-cncf-io\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164910 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-system-cni-dir\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164955 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-os-release\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.164977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-systemd\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-host\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-netns\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165045 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-conf-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba7507f8-ceb8-45a7-a278-4f008706579b-host\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-kubelet-config\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.165463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165155 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f24056b-0a92-4e30-b534-c6711db23442-etc-tuned\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.165919 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba7507f8-ceb8-45a7-a278-4f008706579b-serviceca\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.165919 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165200 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.165919 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.165919 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-etc-kubernetes\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.165919 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165280 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-system-cni-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.165919 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxsr8\" (UniqueName: \"kubernetes.io/projected/ba7507f8-ceb8-45a7-a278-4f008706579b-kube-api-access-bxsr8\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.165919 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.165374 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-modprobe-d\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.199295 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.199250 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:59:35 +0000 UTC" deadline="2028-01-21 19:06:34.35168364 +0000 UTC" Jun 03 01:04:36.199295 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.199294 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14346h1m58.152393113s" Jun 03 01:04:36.253258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.253231 2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 01:04:36.266126 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266095 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-cni-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266301 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266136 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb15c480-bbd4-416a-97fc-7827fcc384a9-cni-binary-copy\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266301 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266227 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-cni-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266301 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266256 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-daemon-config\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266301 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266297 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-sys-fs\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.266531 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266325 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysctl-d\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.266531 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266363 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-run\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.266531 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266377 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-sys-fs\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.266531 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266387 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-tmp-dir\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.266531 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266446 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-run\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.266531 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266492 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cnibin\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.266531 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266521 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-kubelet\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266545 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-hostroot\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266572 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8hd96\" (UniqueName: \"kubernetes.io/projected/eb15c480-bbd4-416a-97fc-7827fcc384a9-kube-api-access-8hd96\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266581 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysctl-d\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266602 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-systemd\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266632 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266640 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-kubelet\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266657 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gl9f8\" (UniqueName: \"kubernetes.io/projected/6b125a99-2b32-4323-b6b5-b2994230aa99-kube-api-access-gl9f8\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cnibin\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266683 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-registration-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266716 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-tmp-dir\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266727 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysctl-conf\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266735 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-hostroot\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266744 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/eb15c480-bbd4-416a-97fc-7827fcc384a9-cni-binary-copy\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266752 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-socket-dir-parent\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266780 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b125a99-2b32-4323-b6b5-b2994230aa99-iptables-alerter-script\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266805 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-socket-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.266852 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266802 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-daemon-config\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266877 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266879 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-socket-dir-parent\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266942 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-registration-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysctl-conf\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266984 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ntgt6\" (UniqueName: \"kubernetes.io/projected/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-kube-api-access-ntgt6\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.266999 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-socket-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267015 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-dbus\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-kubelet\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267062 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-dbus\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-etc-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267089 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-ovn\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267107 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysconfig\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267122 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-kubernetes\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267138 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b125a99-2b32-4323-b6b5-b2994230aa99-host-slash\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267152 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-device-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267166 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f24056b-0a92-4e30-b534-c6711db23442-tmp\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.267618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267181 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267179 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-sysconfig\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267195 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-hosts-file\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267197 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-kubernetes\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267217 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267235 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-device-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267244 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b125a99-2b32-4323-b6b5-b2994230aa99-host-slash\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267258 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-log-socket\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267285 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-cni-netd\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267295 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-hosts-file\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267302 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-os-release\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.267310 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267317 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b125a99-2b32-4323-b6b5-b2994230aa99-iptables-alerter-script\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267319 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.267405 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:36.767357818 +0000 UTC m=+3.087569465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267447 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-k8s-cni-cncf-io\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-node-log\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.268315 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267522 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-ovnkube-config\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267532 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-ovnkube-script-lib\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267569 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-os-release\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267577 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-system-cni-dir\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267619 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-k8s-cni-cncf-io\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267623 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267655 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f1f69d3-8e71-4789-98e5-e0ca691d8929-system-cni-dir\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267661 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-os-release\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267724 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-os-release\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267762 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-systemd\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267770 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267789 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-host\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267816 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-netns\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267829 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-systemd\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267840 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-conf-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267864 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba7507f8-ceb8-45a7-a278-4f008706579b-host\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267871 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-host\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.269062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267905 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-netns\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267906 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-multus-conf-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267925 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-kubelet-config\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267952 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267962 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba7507f8-ceb8-45a7-a278-4f008706579b-host\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267976 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f24056b-0a92-4e30-b534-c6711db23442-etc-tuned\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.267987 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-kubelet-config\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268001 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba7507f8-ceb8-45a7-a278-4f008706579b-serviceca\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268026 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.268030 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268053 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-run-netns\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.268073 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret podName:2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:36.76805724 +0000 UTC m=+3.088268887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret") pod "global-pull-secret-syncer-hxtfb" (UID: "2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-env-overrides\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268113 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268140 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268166 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-etc-kubernetes\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268184 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.269921 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268205 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-etc-kubernetes\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268261 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-system-cni-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268316 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxsr8\" (UniqueName: \"kubernetes.io/projected/ba7507f8-ceb8-45a7-a278-4f008706579b-kube-api-access-bxsr8\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268344 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-modprobe-d\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-system-cni-dir\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268368 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cccng\" (UniqueName: \"kubernetes.io/projected/2f24056b-0a92-4e30-b534-c6711db23442-kube-api-access-cccng\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268395 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f34b3d0-c8f9-4b57-8143-be40b45792bc-konnectivity-ca\") pod \"konnectivity-agent-6sncv\" (UID: \"6f34b3d0-c8f9-4b57-8143-be40b45792bc\") " pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268420 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-cnibin\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268435 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba7507f8-ceb8-45a7-a278-4f008706579b-serviceca\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268444 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-cni-multus\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268505 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-cni-multus\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268504 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-var-lib-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268635 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-etc-modprobe-d\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268667 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f34b3d0-c8f9-4b57-8143-be40b45792bc-agent-certs\") pod \"konnectivity-agent-6sncv\" (UID: \"6f34b3d0-c8f9-4b57-8143-be40b45792bc\") " pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268672 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-cnibin\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268693 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-cni-bin\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.270667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268717 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-sys\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268737 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-var-lib-kubelet\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268748 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-var-lib-cni-bin\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-systemd-units\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268774 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-slash\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50df6db2-833b-483d-9b13-f40f29e98884-ovn-node-metrics-cert\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268806 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-var-lib-kubelet\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268822 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268839 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-lib-modules\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268850 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-sys\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268867 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwx69\" (UniqueName: \"kubernetes.io/projected/6f1f69d3-8e71-4789-98e5-e0ca691d8929-kube-api-access-bwx69\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268901 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-multus-certs\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268930 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hc7dm\" (UniqueName: \"kubernetes.io/projected/85de7c04-6c45-4a09-8489-0f99197af1b2-kube-api-access-hc7dm\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268955 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-97mpf\" (UniqueName: \"kubernetes.io/projected/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-kube-api-access-97mpf\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.268984 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.269013 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-cni-bin\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.269039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffqwh\" (UniqueName: \"kubernetes.io/projected/50df6db2-833b-483d-9b13-f40f29e98884-kube-api-access-ffqwh\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.271458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.269051 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/eb15c480-bbd4-416a-97fc-7827fcc384a9-host-run-multus-certs\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.272154 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.269074 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-etc-selinux\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.272154 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.269014 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6f34b3d0-c8f9-4b57-8143-be40b45792bc-konnectivity-ca\") pod \"konnectivity-agent-6sncv\" (UID: \"6f34b3d0-c8f9-4b57-8143-be40b45792bc\") " pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.272154 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.269142 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f24056b-0a92-4e30-b534-c6711db23442-lib-modules\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.272154 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.269296 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f1f69d3-8e71-4789-98e5-e0ca691d8929-cni-binary-copy\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.272154 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.271498 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f24056b-0a92-4e30-b534-c6711db23442-tmp\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.272154 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.271527 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2f24056b-0a92-4e30-b534-c6711db23442-etc-tuned\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.272154 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.271725 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6f34b3d0-c8f9-4b57-8143-be40b45792bc-agent-certs\") pod \"konnectivity-agent-6sncv\" (UID: \"6f34b3d0-c8f9-4b57-8143-be40b45792bc\") " pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.276303 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.276267 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:36.276303 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.276304 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:36.277133 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.276319 2556 projected.go:194] Error preparing data for projected volume kube-api-access-5ljz2 for pod openshift-network-diagnostics/network-check-target-64th5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:36.277133 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.276394 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2 podName:a94459f0-81da-4476-b4d9-e46d361e43d2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:36.776376791 +0000 UTC m=+3.096588445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5ljz2" (UniqueName: "kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2") pod "network-check-target-64th5" (UID: "a94459f0-81da-4476-b4d9-e46d361e43d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:36.277302 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.277228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntgt6\" (UniqueName: \"kubernetes.io/projected/e3fee7a4-3dda-4c3d-a163-1bea99099c8d-kube-api-access-ntgt6\") pod \"aws-ebs-csi-driver-node-rs9j5\" (UID: \"e3fee7a4-3dda-4c3d-a163-1bea99099c8d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.278262 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.277912 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxsr8\" (UniqueName: \"kubernetes.io/projected/ba7507f8-ceb8-45a7-a278-4f008706579b-kube-api-access-bxsr8\") pod \"node-ca-p8gv9\" (UID: \"ba7507f8-ceb8-45a7-a278-4f008706579b\") " pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.278262 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.277937 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl9f8\" (UniqueName: \"kubernetes.io/projected/6b125a99-2b32-4323-b6b5-b2994230aa99-kube-api-access-gl9f8\") pod \"iptables-alerter-x7b5q\" (UID: \"6b125a99-2b32-4323-b6b5-b2994230aa99\") " pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.278262 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.278221 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hd96\" (UniqueName: \"kubernetes.io/projected/eb15c480-bbd4-416a-97fc-7827fcc384a9-kube-api-access-8hd96\") pod \"multus-pl285\" (UID: \"eb15c480-bbd4-416a-97fc-7827fcc384a9\") " pod="openshift-multus/multus-pl285" Jun 03 01:04:36.280152 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.280015 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwx69\" (UniqueName: \"kubernetes.io/projected/6f1f69d3-8e71-4789-98e5-e0ca691d8929-kube-api-access-bwx69\") pod \"multus-additional-cni-plugins-5z279\" (UID: \"6f1f69d3-8e71-4789-98e5-e0ca691d8929\") " pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.280626 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.280602 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cccng\" (UniqueName: \"kubernetes.io/projected/2f24056b-0a92-4e30-b534-c6711db23442-kube-api-access-cccng\") pod \"tuned-ftjhl\" (UID: \"2f24056b-0a92-4e30-b534-c6711db23442\") " pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.280697 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.280608 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97mpf\" (UniqueName: \"kubernetes.io/projected/df15ae61-4fab-44fc-98dd-67bce5d2ba3f-kube-api-access-97mpf\") pod \"node-resolver-m922r\" (UID: \"df15ae61-4fab-44fc-98dd-67bce5d2ba3f\") " pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.281432 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.281409 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc7dm\" (UniqueName: \"kubernetes.io/projected/85de7c04-6c45-4a09-8489-0f99197af1b2-kube-api-access-hc7dm\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:36.370286 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370258 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-var-lib-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370286 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370293 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-systemd-units\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370314 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-slash\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370369 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-systemd-units\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370378 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-var-lib-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370403 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50df6db2-833b-483d-9b13-f40f29e98884-ovn-node-metrics-cert\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370453 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370496 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-cni-bin\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-run-ovn-kubernetes\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370538 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ffqwh\" (UniqueName: \"kubernetes.io/projected/50df6db2-833b-483d-9b13-f40f29e98884-kube-api-access-ffqwh\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370445 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-slash\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370586 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-systemd\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370601 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-cni-bin\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370644 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-kubelet\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370667 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-etc-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370697 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-ovn\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370700 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-etc-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370699 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-kubelet\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370671 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-systemd\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370745 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370749 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-ovn\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370770 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-log-socket\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370787 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-run-openvswitch\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370794 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-cni-netd\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370826 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-node-log\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370826 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-log-socket\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370848 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-node-log\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.370984 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370826 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-cni-netd\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370852 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-ovnkube-config\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370919 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-ovnkube-script-lib\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370967 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-run-netns\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.370989 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-env-overrides\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.371013 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.371157 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-run-netns\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.371205 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50df6db2-833b-483d-9b13-f40f29e98884-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.371368 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-ovnkube-config\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.371426 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-env-overrides\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.371662 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.371442 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50df6db2-833b-483d-9b13-f40f29e98884-ovnkube-script-lib\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.373185 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.373158 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50df6db2-833b-483d-9b13-f40f29e98884-ovn-node-metrics-cert\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.380212 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.380188 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffqwh\" (UniqueName: \"kubernetes.io/projected/50df6db2-833b-483d-9b13-f40f29e98884-kube-api-access-ffqwh\") pod \"ovnkube-node-cnmxp\" (UID: \"50df6db2-833b-483d-9b13-f40f29e98884\") " pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.453245 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.453152 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:36.460988 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.460960 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x7b5q" Jun 03 01:04:36.468591 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.468569 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" Jun 03 01:04:36.472261 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.472243 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5z279" Jun 03 01:04:36.477905 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.477886 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pl285" Jun 03 01:04:36.484443 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.484420 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" Jun 03 01:04:36.489891 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.489872 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p8gv9" Jun 03 01:04:36.497367 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.497347 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-m922r" Jun 03 01:04:36.503077 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.503059 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:04:36.773714 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.773642 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:36.773714 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.773694 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:36.773928 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.773787 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:36.773928 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.773808 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:36.773928 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.773855 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:37.773835365 +0000 UTC m=+4.094047009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:36.773928 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.773875 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret podName:2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:37.773865111 +0000 UTC m=+4.094076742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret") pod "global-pull-secret-syncer-hxtfb" (UID: "2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:36.875025 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:36.874992 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:36.875174 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.875125 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:36.875174 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.875142 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:36.875174 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.875152 2556 projected.go:194] Error preparing data for projected volume kube-api-access-5ljz2 for pod openshift-network-diagnostics/network-check-target-64th5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:36.875307 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:36.875204 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2 podName:a94459f0-81da-4476-b4d9-e46d361e43d2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:37.875185368 +0000 UTC m=+4.195397016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ljz2" (UniqueName: "kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2") pod "network-check-target-64th5" (UID: "a94459f0-81da-4476-b4d9-e46d361e43d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:37.179133 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.179094 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f24056b_0a92_4e30_b534_c6711db23442.slice/crio-7b7fd34584b5e2c41482394ae377c5827beb50f6134b035e7603540d82adec5d WatchSource:0}: Error finding container 7b7fd34584b5e2c41482394ae377c5827beb50f6134b035e7603540d82adec5d: Status 404 returned error can't find the container with id 7b7fd34584b5e2c41482394ae377c5827beb50f6134b035e7603540d82adec5d Jun 03 01:04:37.180250 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.180224 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50df6db2_833b_483d_9b13_f40f29e98884.slice/crio-232b22ffaadcf77fa4c1fdbe6bc69de2263fd4a69fcec774c134937a28f93c8a WatchSource:0}: Error finding container 232b22ffaadcf77fa4c1fdbe6bc69de2263fd4a69fcec774c134937a28f93c8a: Status 404 returned error can't find the container with id 232b22ffaadcf77fa4c1fdbe6bc69de2263fd4a69fcec774c134937a28f93c8a Jun 03 01:04:37.181294 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.181273 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f34b3d0_c8f9_4b57_8143_be40b45792bc.slice/crio-8b238537abcfd5430da77895462f0a217cc2c5d9b4b202d96442cf598a5ff4bb WatchSource:0}: Error finding container 8b238537abcfd5430da77895462f0a217cc2c5d9b4b202d96442cf598a5ff4bb: Status 404 returned error can't find the container with id 8b238537abcfd5430da77895462f0a217cc2c5d9b4b202d96442cf598a5ff4bb Jun 03 01:04:37.184342 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.184283 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf15ae61_4fab_44fc_98dd_67bce5d2ba3f.slice/crio-0bfb05cd21a588a019761930ddd36a8d01dd991dd000c05ab109da9051e97ade WatchSource:0}: Error finding container 0bfb05cd21a588a019761930ddd36a8d01dd991dd000c05ab109da9051e97ade: Status 404 returned error can't find the container with id 0bfb05cd21a588a019761930ddd36a8d01dd991dd000c05ab109da9051e97ade Jun 03 01:04:37.185806 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.185775 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b125a99_2b32_4323_b6b5_b2994230aa99.slice/crio-204b34b1cca1d3295c049fc1cca4b50df84185f677da8931bdde23469660b76c WatchSource:0}: Error finding container 204b34b1cca1d3295c049fc1cca4b50df84185f677da8931bdde23469660b76c: Status 404 returned error can't find the container with id 204b34b1cca1d3295c049fc1cca4b50df84185f677da8931bdde23469660b76c Jun 03 01:04:37.186405 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.186385 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fee7a4_3dda_4c3d_a163_1bea99099c8d.slice/crio-65bd4dcf164b0b97cc88cdb4aa6d1bc1f78be6d222a484a174e1d5eb263b6921 WatchSource:0}: Error finding container 65bd4dcf164b0b97cc88cdb4aa6d1bc1f78be6d222a484a174e1d5eb263b6921: Status 404 returned error can't find the container with id 65bd4dcf164b0b97cc88cdb4aa6d1bc1f78be6d222a484a174e1d5eb263b6921 Jun 03 01:04:37.187365 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.187244 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb15c480_bbd4_416a_97fc_7827fcc384a9.slice/crio-499ce75ebdd11a64dfa5bb82500a77656285b67b26c9ec952ab94fd000991b3f WatchSource:0}: Error finding container 499ce75ebdd11a64dfa5bb82500a77656285b67b26c9ec952ab94fd000991b3f: Status 404 returned error can't find the container with id 499ce75ebdd11a64dfa5bb82500a77656285b67b26c9ec952ab94fd000991b3f Jun 03 01:04:37.189728 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.189413 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7507f8_ceb8_45a7_a278_4f008706579b.slice/crio-b177faf85eff1f37ae8082f1631a49d9faf55e9721f22049b50d9694d9354b30 WatchSource:0}: Error finding container b177faf85eff1f37ae8082f1631a49d9faf55e9721f22049b50d9694d9354b30: Status 404 returned error can't find the container with id b177faf85eff1f37ae8082f1631a49d9faf55e9721f22049b50d9694d9354b30 Jun 03 01:04:37.190028 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:04:37.189901 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1f69d3_8e71_4789_98e5_e0ca691d8929.slice/crio-00b5c02e60acbc0f1ed6a82027310288c7f7b0fbb94270c65836ecd8b6af615f WatchSource:0}: Error finding container 00b5c02e60acbc0f1ed6a82027310288c7f7b0fbb94270c65836ecd8b6af615f: Status 404 returned error can't find the container with id 00b5c02e60acbc0f1ed6a82027310288c7f7b0fbb94270c65836ecd8b6af615f Jun 03 01:04:37.199974 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.199937 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:59:35 +0000 UTC" deadline="2027-11-01 10:00:41.298512286 +0000 UTC" Jun 03 01:04:37.199974 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.199970 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12392h56m4.098546442s" Jun 03 01:04:37.289549 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.289362 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerStarted","Data":"00b5c02e60acbc0f1ed6a82027310288c7f7b0fbb94270c65836ecd8b6af615f"} Jun 03 01:04:37.291991 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.291960 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8gv9" event={"ID":"ba7507f8-ceb8-45a7-a278-4f008706579b","Type":"ContainerStarted","Data":"b177faf85eff1f37ae8082f1631a49d9faf55e9721f22049b50d9694d9354b30"} Jun 03 01:04:37.292979 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.292954 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" event={"ID":"e3fee7a4-3dda-4c3d-a163-1bea99099c8d","Type":"ContainerStarted","Data":"65bd4dcf164b0b97cc88cdb4aa6d1bc1f78be6d222a484a174e1d5eb263b6921"} Jun 03 01:04:37.293913 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.293893 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m922r" event={"ID":"df15ae61-4fab-44fc-98dd-67bce5d2ba3f","Type":"ContainerStarted","Data":"0bfb05cd21a588a019761930ddd36a8d01dd991dd000c05ab109da9051e97ade"} Jun 03 01:04:37.294778 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.294736 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6sncv" event={"ID":"6f34b3d0-c8f9-4b57-8143-be40b45792bc","Type":"ContainerStarted","Data":"8b238537abcfd5430da77895462f0a217cc2c5d9b4b202d96442cf598a5ff4bb"} Jun 03 01:04:37.295622 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.295603 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"232b22ffaadcf77fa4c1fdbe6bc69de2263fd4a69fcec774c134937a28f93c8a"} Jun 03 01:04:37.296461 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.296440 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" event={"ID":"2f24056b-0a92-4e30-b534-c6711db23442","Type":"ContainerStarted","Data":"7b7fd34584b5e2c41482394ae377c5827beb50f6134b035e7603540d82adec5d"} Jun 03 01:04:37.297744 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.297720 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" event={"ID":"1414ae1b4372e7dbb3b03843f08a2ec9","Type":"ContainerStarted","Data":"3ab04f240bb9c49d26f165e1e0edc0fc45b2cf6f410369e0c50479fe5e6fd24a"} Jun 03 01:04:37.298664 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.298646 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pl285" event={"ID":"eb15c480-bbd4-416a-97fc-7827fcc384a9","Type":"ContainerStarted","Data":"499ce75ebdd11a64dfa5bb82500a77656285b67b26c9ec952ab94fd000991b3f"} Jun 03 01:04:37.299487 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.299455 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7b5q" event={"ID":"6b125a99-2b32-4323-b6b5-b2994230aa99","Type":"ContainerStarted","Data":"204b34b1cca1d3295c049fc1cca4b50df84185f677da8931bdde23469660b76c"} Jun 03 01:04:37.325752 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.325704 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-82.ec2.internal" podStartSLOduration=2.325692087 podStartE2EDuration="2.325692087s" podCreationTimestamp="2026-06-03 01:04:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:04:37.325411765 +0000 UTC m=+3.645623428" watchObservedRunningTime="2026-06-03 01:04:37.325692087 +0000 UTC m=+3.645903740" Jun 03 01:04:37.780777 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.780691 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:37.780777 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.780753 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:37.780993 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.780871 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:37.780993 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.780931 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret podName:2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:39.780912559 +0000 UTC m=+6.101124195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret") pod "global-pull-secret-syncer-hxtfb" (UID: "2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:37.781373 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.781355 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:37.781465 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.781409 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:39.781393584 +0000 UTC m=+6.101605216 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:37.881548 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:37.881511 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:37.881744 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.881728 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:37.881801 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.881752 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:37.881801 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.881764 2556 projected.go:194] Error preparing data for projected volume kube-api-access-5ljz2 for pod openshift-network-diagnostics/network-check-target-64th5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:37.881913 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:37.881822 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2 podName:a94459f0-81da-4476-b4d9-e46d361e43d2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:39.881804278 +0000 UTC m=+6.202015913 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ljz2" (UniqueName: "kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2") pod "network-check-target-64th5" (UID: "a94459f0-81da-4476-b4d9-e46d361e43d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:38.280832 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:38.280734 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:38.281270 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:38.280949 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:38.281560 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:38.281390 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:38.281560 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:38.281512 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:38.281709 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:38.281606 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:38.281757 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:38.281708 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:38.321173 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:38.319828 2556 generic.go:358] "Generic (PLEG): container finished" podID="37ea37eb09bdf53a666260156430e92f" containerID="d698c52d04b2069f78186263240833cbedb0ef5182679270b165fe4a2e9db8b4" exitCode=0 Jun 03 01:04:38.321173 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:38.320964 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" event={"ID":"37ea37eb09bdf53a666260156430e92f","Type":"ContainerDied","Data":"d698c52d04b2069f78186263240833cbedb0ef5182679270b165fe4a2e9db8b4"} Jun 03 01:04:39.340514 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:39.340451 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" event={"ID":"37ea37eb09bdf53a666260156430e92f","Type":"ContainerStarted","Data":"ee99b7daefcba6fa52ec914a721bd6df704c80f9ea7e82b547baf98d9d27b9d9"} Jun 03 01:04:39.355147 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:39.355096 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-82.ec2.internal" podStartSLOduration=4.355078732 podStartE2EDuration="4.355078732s" podCreationTimestamp="2026-06-03 01:04:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:04:39.353283206 +0000 UTC m=+5.673494872" watchObservedRunningTime="2026-06-03 01:04:39.355078732 +0000 UTC m=+5.675290387" Jun 03 01:04:39.798104 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:39.797938 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:39.798104 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:39.797998 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:39.798338 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.798142 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:39.798338 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.798208 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret podName:2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:43.798189982 +0000 UTC m=+10.118401633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret") pod "global-pull-secret-syncer-hxtfb" (UID: "2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:39.798853 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.798590 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:39.798853 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.798651 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:43.798634178 +0000 UTC m=+10.118845816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:39.898987 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:39.898947 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:39.899168 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.899133 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:39.899168 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.899148 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:39.899168 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.899157 2556 projected.go:194] Error preparing data for projected volume kube-api-access-5ljz2 for pod openshift-network-diagnostics/network-check-target-64th5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:39.899321 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:39.899202 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2 podName:a94459f0-81da-4476-b4d9-e46d361e43d2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:43.899186913 +0000 UTC m=+10.219398550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ljz2" (UniqueName: "kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2") pod "network-check-target-64th5" (UID: "a94459f0-81da-4476-b4d9-e46d361e43d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:40.280600 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:40.280116 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:40.280600 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:40.280237 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:40.280790 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:40.280692 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:40.280790 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:40.280767 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:40.280914 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:40.280890 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:40.281037 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:40.281015 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:42.281101 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:42.280451 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:42.281101 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:42.280586 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:42.281101 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:42.280967 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:42.281101 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:42.281059 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:42.281837 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:42.281807 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:42.281952 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:42.281918 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:43.831529 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:43.831481 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:43.831934 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:43.831540 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:43.831934 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.831635 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:43.831934 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.831640 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:43.831934 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.831714 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:51.831694971 +0000 UTC m=+18.151906623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:43.831934 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.831734 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret podName:2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:51.831724755 +0000 UTC m=+18.151936388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret") pod "global-pull-secret-syncer-hxtfb" (UID: "2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:43.932682 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:43.932141 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:43.932682 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.932358 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:43.932682 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.932381 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:43.932682 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.932394 2556 projected.go:194] Error preparing data for projected volume kube-api-access-5ljz2 for pod openshift-network-diagnostics/network-check-target-64th5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:43.932682 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:43.932457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2 podName:a94459f0-81da-4476-b4d9-e46d361e43d2 nodeName:}" failed. No retries permitted until 2026-06-03 01:04:51.932436852 +0000 UTC m=+18.252648486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ljz2" (UniqueName: "kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2") pod "network-check-target-64th5" (UID: "a94459f0-81da-4476-b4d9-e46d361e43d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:44.281550 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:44.281453 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:44.281707 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:44.281566 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:44.281707 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:44.281582 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:44.281707 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:44.281643 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:44.281707 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:44.281676 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:44.281912 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:44.281814 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:46.280865 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:46.280830 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:46.281333 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:46.280870 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:46.281333 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:46.280881 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:46.281333 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:46.280981 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:46.281333 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:46.281093 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:46.281333 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:46.281192 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:47.357326 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.357248 2556 generic.go:358] "Generic (PLEG): container finished" podID="6f1f69d3-8e71-4789-98e5-e0ca691d8929" containerID="a723e2f71eee73fb3ac41c39c82792bd1d67082dd38feed2351258ebedc228a4" exitCode=0 Jun 03 01:04:47.357326 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.357318 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerDied","Data":"a723e2f71eee73fb3ac41c39c82792bd1d67082dd38feed2351258ebedc228a4"} Jun 03 01:04:47.358667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.358618 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p8gv9" event={"ID":"ba7507f8-ceb8-45a7-a278-4f008706579b","Type":"ContainerStarted","Data":"09faec8744af793397f93a653f41bbb4dda990f31d31dcb011f7f33547e3f550"} Jun 03 01:04:47.359863 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.359840 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" event={"ID":"e3fee7a4-3dda-4c3d-a163-1bea99099c8d","Type":"ContainerStarted","Data":"03e315b185d6f0427feb0169888d86cda365f6f8eee96b54da8a03f27f1760c3"} Jun 03 01:04:47.361094 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.361072 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-m922r" event={"ID":"df15ae61-4fab-44fc-98dd-67bce5d2ba3f","Type":"ContainerStarted","Data":"31744c3dc691a7d12edfcb30e651bde251099bf1a92818f8a80ca097170a3ef3"} Jun 03 01:04:47.362200 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.362178 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6sncv" event={"ID":"6f34b3d0-c8f9-4b57-8143-be40b45792bc","Type":"ContainerStarted","Data":"7299486f19b5fda6a82d24040a7301c8f99bf0bec969e3366aaade729b3de9eb"} Jun 03 01:04:47.363391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.363373 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" event={"ID":"2f24056b-0a92-4e30-b534-c6711db23442","Type":"ContainerStarted","Data":"69fa2cb951cb25098b317ce69122c5018d405a20cb5b8f4a69b004d720865234"} Jun 03 01:04:47.403688 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.403632 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p8gv9" podStartSLOduration=3.952841215 podStartE2EDuration="13.403618531s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.190773559 +0000 UTC m=+3.510985197" lastFinishedPulling="2026-06-03 01:04:46.641550879 +0000 UTC m=+12.961762513" observedRunningTime="2026-06-03 01:04:47.402812132 +0000 UTC m=+13.723023775" watchObservedRunningTime="2026-06-03 01:04:47.403618531 +0000 UTC m=+13.723830183" Jun 03 01:04:47.416550 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.416496 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-m922r" podStartSLOduration=3.9440173229999997 podStartE2EDuration="13.416459826s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.186336013 +0000 UTC m=+3.506547652" lastFinishedPulling="2026-06-03 01:04:46.658778509 +0000 UTC m=+12.978990155" observedRunningTime="2026-06-03 01:04:47.416110738 +0000 UTC m=+13.736322392" watchObservedRunningTime="2026-06-03 01:04:47.416459826 +0000 UTC m=+13.736671481" Jun 03 01:04:47.436089 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.436048 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6sncv" podStartSLOduration=3.970287313 podStartE2EDuration="13.436035527s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.183215362 +0000 UTC m=+3.503426996" lastFinishedPulling="2026-06-03 01:04:46.648963572 +0000 UTC m=+12.969175210" observedRunningTime="2026-06-03 01:04:47.435883436 +0000 UTC m=+13.756095091" watchObservedRunningTime="2026-06-03 01:04:47.436035527 +0000 UTC m=+13.756247180" Jun 03 01:04:47.455174 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:47.454882 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ftjhl" podStartSLOduration=3.965685036 podStartE2EDuration="13.454865363s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.18153679 +0000 UTC m=+3.501748424" lastFinishedPulling="2026-06-03 01:04:46.670717113 +0000 UTC m=+12.990928751" observedRunningTime="2026-06-03 01:04:47.454214295 +0000 UTC m=+13.774425950" watchObservedRunningTime="2026-06-03 01:04:47.454865363 +0000 UTC m=+13.775077018" Jun 03 01:04:48.033605 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.033369 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 01:04:48.229048 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.228933 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T01:04:48.033603381Z","UUID":"1f438cc5-a0eb-43e9-bf5a-5b405ed0da9c","Handler":null,"Name":"","Endpoint":""} Jun 03 01:04:48.231979 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.231956 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 01:04:48.231979 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.231983 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 01:04:48.280967 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.280936 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:48.281145 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.280936 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:48.281145 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:48.281047 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:48.281145 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:48.281136 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:48.281313 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.280936 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:48.281313 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:48.281215 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:48.368502 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.367915 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x7b5q" event={"ID":"6b125a99-2b32-4323-b6b5-b2994230aa99","Type":"ContainerStarted","Data":"14bbee833dba9c61894fc8c7f415ed451d3f24af3da6c5ddbb44c594836efcd5"} Jun 03 01:04:48.370835 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.370794 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" event={"ID":"e3fee7a4-3dda-4c3d-a163-1bea99099c8d","Type":"ContainerStarted","Data":"8f0dd97bf82110bc2a5a8655eac8caf35ac0feb034a26b4ebdf383638628e329"} Jun 03 01:04:48.384389 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:48.384340 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x7b5q" podStartSLOduration=4.921958339 podStartE2EDuration="14.384323193s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.187527422 +0000 UTC m=+3.507739071" lastFinishedPulling="2026-06-03 01:04:46.64989228 +0000 UTC m=+12.970103925" observedRunningTime="2026-06-03 01:04:48.383727725 +0000 UTC m=+14.703939381" watchObservedRunningTime="2026-06-03 01:04:48.384323193 +0000 UTC m=+14.704534847" Jun 03 01:04:50.280739 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:50.280703 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:50.281307 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:50.280703 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:50.281307 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:50.280826 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:50.281307 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:50.280703 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:50.281307 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:50.280897 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:50.281307 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:50.280983 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:50.933683 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:50.933648 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:50.934217 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:50.934191 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:51.896859 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:51.896787 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:51.896859 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:51.896847 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:51.897587 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.896998 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:51.897587 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.896999 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:51.897587 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.897066 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret podName:2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:07.897047913 +0000 UTC m=+34.217259548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret") pod "global-pull-secret-syncer-hxtfb" (UID: "2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:04:51.897587 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.897103 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:07.897086994 +0000 UTC m=+34.217298648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:04:51.998069 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:51.998036 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:51.998243 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.998207 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:04:51.998243 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.998234 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:04:51.998360 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.998247 2556 projected.go:194] Error preparing data for projected volume kube-api-access-5ljz2 for pod openshift-network-diagnostics/network-check-target-64th5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:51.998360 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:51.998311 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2 podName:a94459f0-81da-4476-b4d9-e46d361e43d2 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:07.998294321 +0000 UTC m=+34.318505967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ljz2" (UniqueName: "kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2") pod "network-check-target-64th5" (UID: "a94459f0-81da-4476-b4d9-e46d361e43d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:04:52.280714 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:52.280679 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:52.280896 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:52.280679 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:52.280896 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:52.280811 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:52.280896 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:52.280813 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:52.281019 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:52.280909 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:52.281019 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:52.281000 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:54.280957 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:54.280924 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:54.281500 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:54.281012 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:54.281500 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:54.281084 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:54.281500 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:54.281165 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:54.281500 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:54.281250 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:54.281500 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:54.281384 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:56.280309 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:56.280041 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:56.280772 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:56.280041 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:56.280772 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:56.280419 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:56.280772 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:56.280041 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:56.280772 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:56.280466 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:56.280772 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:56.280565 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:56.909734 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:56.909690 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:56.910008 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:56.909855 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 01:04:56.910406 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:56.910382 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6sncv" Jun 03 01:04:58.280579 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:58.280545 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:04:58.280951 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:58.280595 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:04:58.280951 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:58.280659 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:04:58.280951 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:58.280727 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:04:58.280951 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:58.280720 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:04:58.280951 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:04:58.280802 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:04:59.392778 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.392576 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"26935d6e8323452b5c9835fbb5e6f85e8df3491050f6f80907cf62130181e8a8"} Jun 03 01:04:59.392778 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.392784 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"a19226ab0a972838906c3c601c2990445e8caa68beeb87151aaf5a6a000d4a09"} Jun 03 01:04:59.393223 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.392799 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"1d9841f7b3a810dc35194be5f0eeb0e6cdfdb569aa369cc5d126f2ea67e20af1"} Jun 03 01:04:59.393223 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.392810 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"67495d8797adb5c5f33f29de70a5813b74ac469b7912ee28f9890ec4260c5744"} Jun 03 01:04:59.393223 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.392821 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"d6b5a76cdc6ead2bb53f185c28c21a27750166316a276c23b5b13ffbb1b76a94"} Jun 03 01:04:59.393223 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.392831 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"4851d347f0fd789e89c4ce2bba668619f13a9c220d4e15583d5f07d07d3c8e1d"} Jun 03 01:04:59.393773 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.393751 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pl285" event={"ID":"eb15c480-bbd4-416a-97fc-7827fcc384a9","Type":"ContainerStarted","Data":"72cb86143148497b2b78456d3d55212a6045219e2c77594809f50c274f420a0e"} Jun 03 01:04:59.395266 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.395239 2556 generic.go:358] "Generic (PLEG): container finished" podID="6f1f69d3-8e71-4789-98e5-e0ca691d8929" containerID="f6a428cc9799124ae7bab22a1d2903f13d4c7595f046d67218ee9a4b78523654" exitCode=0 Jun 03 01:04:59.395373 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.395293 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerDied","Data":"f6a428cc9799124ae7bab22a1d2903f13d4c7595f046d67218ee9a4b78523654"} Jun 03 01:04:59.397179 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.397156 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" event={"ID":"e3fee7a4-3dda-4c3d-a163-1bea99099c8d","Type":"ContainerStarted","Data":"807237c36c9a8977b9051ee9ad7ea4798562eaf787251c67b1217f2a6757b51c"} Jun 03 01:04:59.410775 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.410739 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-pl285" podStartSLOduration=4.155685167 podStartE2EDuration="25.410729048s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.189658193 +0000 UTC m=+3.509869823" lastFinishedPulling="2026-06-03 01:04:58.444702066 +0000 UTC m=+24.764913704" observedRunningTime="2026-06-03 01:04:59.409275029 +0000 UTC m=+25.729486682" watchObservedRunningTime="2026-06-03 01:04:59.410729048 +0000 UTC m=+25.730940728" Jun 03 01:04:59.424782 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:04:59.424746 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rs9j5" podStartSLOduration=4.142039307 podStartE2EDuration="25.424734957s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.188747705 +0000 UTC m=+3.508959349" lastFinishedPulling="2026-06-03 01:04:58.471443352 +0000 UTC m=+24.791654999" observedRunningTime="2026-06-03 01:04:59.424548565 +0000 UTC m=+25.744760218" watchObservedRunningTime="2026-06-03 01:04:59.424734957 +0000 UTC m=+25.744946610" Jun 03 01:05:00.280185 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:00.280153 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:00.280348 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:00.280153 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:00.280348 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:00.280269 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:05:00.280348 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:00.280327 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:05:00.280454 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:00.280362 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:00.280454 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:00.280416 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:05:00.401105 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:00.401009 2556 generic.go:358] "Generic (PLEG): container finished" podID="6f1f69d3-8e71-4789-98e5-e0ca691d8929" containerID="99dd79b755d5181ebff787ce2be58bfc13c3a694dc92a9f23bf701ef7ac6193c" exitCode=0 Jun 03 01:05:00.401105 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:00.401094 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerDied","Data":"99dd79b755d5181ebff787ce2be58bfc13c3a694dc92a9f23bf701ef7ac6193c"} Jun 03 01:05:01.404438 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:01.404405 2556 generic.go:358] "Generic (PLEG): container finished" podID="6f1f69d3-8e71-4789-98e5-e0ca691d8929" containerID="7c9c83bcfc7b43ddc0e14ed9b3decf319494b48c78a3eebecb7fdb7bc9a83407" exitCode=0 Jun 03 01:05:01.404896 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:01.404492 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerDied","Data":"7c9c83bcfc7b43ddc0e14ed9b3decf319494b48c78a3eebecb7fdb7bc9a83407"} Jun 03 01:05:01.407438 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:01.407419 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"46aa94b11308e66abde63834920870469e3a232a7192d491ab87aa083138c72d"} Jun 03 01:05:02.280043 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:02.279984 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:02.280210 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:02.279991 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:02.280210 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:02.280103 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:05:02.280210 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:02.280174 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:05:02.280210 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:02.280199 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:02.280411 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:02.280280 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:05:03.414806 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:03.414484 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" event={"ID":"50df6db2-833b-483d-9b13-f40f29e98884","Type":"ContainerStarted","Data":"db049b15494adb6827ee99817c43196504d98804f6b77e6a584b2bea82bbd9d8"} Jun 03 01:05:03.415406 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:03.414856 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:05:03.432679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:03.432653 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:05:03.440091 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:03.440047 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" podStartSLOduration=8.17822056 podStartE2EDuration="29.440035155s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.18320568 +0000 UTC m=+3.503417327" lastFinishedPulling="2026-06-03 01:04:58.445020284 +0000 UTC m=+24.765231922" observedRunningTime="2026-06-03 01:05:03.4381685 +0000 UTC m=+29.758380153" watchObservedRunningTime="2026-06-03 01:05:03.440035155 +0000 UTC m=+29.760246807" Jun 03 01:05:04.281672 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:04.281634 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:04.281910 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:04.281715 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:04.281910 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:04.281737 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:05:04.281910 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:04.281749 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:04.281910 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:04.281821 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:05:04.282052 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:04.281920 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:05:04.417429 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:04.417393 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:05:04.417429 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:04.417436 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:05:04.435127 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:04.435100 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:05:05.316953 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:05.316920 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hxtfb"] Jun 03 01:05:05.317144 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:05.317043 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:05.317144 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:05.317123 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:05:05.319941 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:05.319917 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vf9xt"] Jun 03 01:05:05.320086 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:05.320026 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:05.320139 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:05.320112 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:05:05.320591 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:05.320569 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64th5"] Jun 03 01:05:05.320693 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:05.320680 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:05.320794 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:05.320774 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:05:07.279941 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:07.279908 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:07.279941 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:07.279941 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:07.280427 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:07.279911 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:07.280427 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:07.280038 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:05:07.280427 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:07.280118 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:05:07.280427 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:07.280203 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:05:07.921307 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:07.921273 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:07.921482 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:07.921332 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:07.921482 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:07.921446 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:05:07.921482 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:07.921457 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 01:05:07.921656 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:07.921538 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret podName:2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:39.92151701 +0000 UTC m=+66.241728658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret") pod "global-pull-secret-syncer-hxtfb" (UID: "2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88") : object "kube-system"/"original-pull-secret" not registered Jun 03 01:05:07.921656 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:07.921554 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:39.921548058 +0000 UTC m=+66.241759688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 01:05:08.022332 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:08.022293 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:08.022517 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:08.022455 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 01:05:08.022517 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:08.022495 2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 01:05:08.022517 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:08.022505 2556 projected.go:194] Error preparing data for projected volume kube-api-access-5ljz2 for pod openshift-network-diagnostics/network-check-target-64th5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:05:08.022626 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:08.022557 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2 podName:a94459f0-81da-4476-b4d9-e46d361e43d2 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:40.022543103 +0000 UTC m=+66.342754733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5ljz2" (UniqueName: "kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2") pod "network-check-target-64th5" (UID: "a94459f0-81da-4476-b4d9-e46d361e43d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 01:05:09.280719 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:09.280683 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:09.280719 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:09.280707 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:09.281172 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:09.280681 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:09.281172 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:09.280820 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vf9xt" podUID="85de7c04-6c45-4a09-8489-0f99197af1b2" Jun 03 01:05:09.281172 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:09.280902 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hxtfb" podUID="2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88" Jun 03 01:05:09.281172 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:09.280991 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-64th5" podUID="a94459f0-81da-4476-b4d9-e46d361e43d2" Jun 03 01:05:10.945464 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:10.945317 2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-82.ec2.internal" event="NodeReady" Jun 03 01:05:10.945847 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:10.945613 2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 01:05:10.979732 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:10.979437 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cf569fc5d-z6s7p"] Jun 03 01:05:10.999270 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:10.999242 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd"] Jun 03 01:05:10.999466 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:10.999416 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.002415 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.002167 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lxj66\"" Jun 03 01:05:11.002415 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.002169 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 01:05:11.002415 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.002181 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 01:05:11.002415 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.002258 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 01:05:11.011229 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.010793 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 01:05:11.021302 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.021273 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv"] Jun 03 01:05:11.021459 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.021408 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.024389 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.024346 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7g6lc\"" Jun 03 01:05:11.024389 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.024356 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 01:05:11.024389 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.024390 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 01:05:11.024657 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.024385 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 01:05:11.025076 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.025058 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 01:05:11.045432 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.045402 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght"] Jun 03 01:05:11.045606 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.045566 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.048108 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.048072 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 01:05:11.048108 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.048085 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 01:05:11.048108 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.048086 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 01:05:11.048368 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.048329 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 01:05:11.067705 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.067675 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd"] Jun 03 01:05:11.067705 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.067709 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght"] Jun 03 01:05:11.067875 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.067723 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv"] Jun 03 01:05:11.067875 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.067739 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cf569fc5d-z6s7p"] Jun 03 01:05:11.067875 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.067757 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4nrbl"] Jun 03 01:05:11.067875 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.067813 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.070302 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.070277 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 01:05:11.086129 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.086105 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mzdpl"] Jun 03 01:05:11.086287 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.086242 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:11.088903 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.088882 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 01:05:11.089022 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.088911 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 01:05:11.089022 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.088924 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 01:05:11.089022 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.088956 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kzjqn\"" Jun 03 01:05:11.106258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.106237 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nrbl"] Jun 03 01:05:11.106258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.106261 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mzdpl"] Jun 03 01:05:11.106401 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.106387 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.109164 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.109148 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 01:05:11.109262 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.109176 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tw28v\"" Jun 03 01:05:11.109262 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.109151 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 01:05:11.145079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145056 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.145193 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-image-registry-private-configuration\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145193 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145119 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-certificates\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145193 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcckm\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-kube-api-access-wcckm\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145193 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfkpb\" (UniqueName: \"kubernetes.io/projected/f6efb82e-69aa-48fe-ac50-b750898b4043-kube-api-access-tfkpb\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.145312 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-ca-trust-extracted\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145312 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn7gx\" (UniqueName: \"kubernetes.io/projected/1e9439cf-ef89-4f4f-9143-737258e8fb40-kube-api-access-xn7gx\") pod \"managed-serviceaccount-addon-agent-557cd944cb-9xjtd\" (UID: \"1e9439cf-ef89-4f4f-9143-737258e8fb40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.145312 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-ca\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.145402 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145343 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-installation-pull-secrets\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145402 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145368 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.145402 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145385 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f6efb82e-69aa-48fe-ac50-b750898b4043-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.145508 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-trusted-ca\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145508 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145508 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-bound-sa-token\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.145595 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e9439cf-ef89-4f4f-9143-737258e8fb40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-557cd944cb-9xjtd\" (UID: \"1e9439cf-ef89-4f4f-9143-737258e8fb40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.145595 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.145532 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-hub\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.246159 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246126 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wcckm\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-kube-api-access-wcckm\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.246159 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246163 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfkpb\" (UniqueName: \"kubernetes.io/projected/f6efb82e-69aa-48fe-ac50-b750898b4043-kube-api-access-tfkpb\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246207 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqnl\" (UniqueName: \"kubernetes.io/projected/6e67a5f6-9d8a-469c-a66a-276525dd255e-kube-api-access-pcqnl\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246231 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-ca-trust-extracted\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246249 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xn7gx\" (UniqueName: \"kubernetes.io/projected/1e9439cf-ef89-4f4f-9143-737258e8fb40-kube-api-access-xn7gx\") pod \"managed-serviceaccount-addon-agent-557cd944cb-9xjtd\" (UID: \"1e9439cf-ef89-4f4f-9143-737258e8fb40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246267 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-ca\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e67a5f6-9d8a-469c-a66a-276525dd255e-tmp\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6e67a5f6-9d8a-469c-a66a-276525dd255e-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7kvt\" (UniqueName: \"kubernetes.io/projected/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-kube-api-access-d7kvt\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:11.246391 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246392 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-installation-pull-secrets\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246420 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246451 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f6efb82e-69aa-48fe-ac50-b750898b4043-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246553 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-trusted-ca\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246582 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246610 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1216639-c507-49b3-b4cb-e818dfbc9653-config-volume\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1216639-c507-49b3-b4cb-e818dfbc9653-tmp-dir\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246756 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.246787 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246768 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-ca-trust-extracted\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.247169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246819 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-bound-sa-token\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.247169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246851 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e9439cf-ef89-4f4f-9143-737258e8fb40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-557cd944cb-9xjtd\" (UID: \"1e9439cf-ef89-4f4f-9143-737258e8fb40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.247169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246880 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-hub\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.247169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999vj\" (UniqueName: \"kubernetes.io/projected/e1216639-c507-49b3-b4cb-e818dfbc9653-kube-api-access-999vj\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.247169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246958 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.247169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.246993 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-image-registry-private-configuration\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.247169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.247025 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-certificates\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.247426 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.247224 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/f6efb82e-69aa-48fe-ac50-b750898b4043-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.247494 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.246916 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:05:11.247494 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.247445 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:05:11.247586 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.247534 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:11.747515221 +0000 UTC m=+38.067726852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:05:11.247586 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.247535 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-certificates\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.247684 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.247649 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-trusted-ca\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.251010 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.250985 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.251132 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.251006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-image-registry-private-configuration\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.251132 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.250992 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-ca\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.251132 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.251031 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-installation-pull-secrets\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.251132 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.251083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.251293 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.251205 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f6efb82e-69aa-48fe-ac50-b750898b4043-hub\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.251811 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.251788 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e9439cf-ef89-4f4f-9143-737258e8fb40-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-557cd944cb-9xjtd\" (UID: \"1e9439cf-ef89-4f4f-9143-737258e8fb40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.257139 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.257115 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn7gx\" (UniqueName: \"kubernetes.io/projected/1e9439cf-ef89-4f4f-9143-737258e8fb40-kube-api-access-xn7gx\") pod \"managed-serviceaccount-addon-agent-557cd944cb-9xjtd\" (UID: \"1e9439cf-ef89-4f4f-9143-737258e8fb40\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.260541 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.260519 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcckm\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-kube-api-access-wcckm\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.260693 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.260676 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-bound-sa-token\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.260933 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.260911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfkpb\" (UniqueName: \"kubernetes.io/projected/f6efb82e-69aa-48fe-ac50-b750898b4043-kube-api-access-tfkpb\") pod \"cluster-proxy-proxy-agent-569c5c656b-67bkv\" (UID: \"f6efb82e-69aa-48fe-ac50-b750898b4043\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.280636 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.280609 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:11.280747 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.280700 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:11.280882 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.280866 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:11.283777 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.283758 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 01:05:11.283922 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.283819 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 01:05:11.284031 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.284014 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 01:05:11.284082 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.284052 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-55dgg\"" Jun 03 01:05:11.284122 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.284021 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgszk\"" Jun 03 01:05:11.284156 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.284131 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 01:05:11.347683 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347592 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:11.347683 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347632 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1216639-c507-49b3-b4cb-e818dfbc9653-config-volume\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.347683 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347654 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1216639-c507-49b3-b4cb-e818dfbc9653-tmp-dir\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.347683 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347685 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-999vj\" (UniqueName: \"kubernetes.io/projected/e1216639-c507-49b3-b4cb-e818dfbc9653-kube-api-access-999vj\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.347973 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347733 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqnl\" (UniqueName: \"kubernetes.io/projected/6e67a5f6-9d8a-469c-a66a-276525dd255e-kube-api-access-pcqnl\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.347973 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347766 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e67a5f6-9d8a-469c-a66a-276525dd255e-tmp\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.347973 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.347772 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:11.347973 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347790 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6e67a5f6-9d8a-469c-a66a-276525dd255e-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.347973 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.347839 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:11.847820539 +0000 UTC m=+38.168032171 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:05:11.347973 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347873 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7kvt\" (UniqueName: \"kubernetes.io/projected/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-kube-api-access-d7kvt\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:11.347973 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.347945 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.348232 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.348048 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e1216639-c507-49b3-b4cb-e818dfbc9653-tmp-dir\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.348232 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.348082 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:11.348232 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.348130 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:11.848113761 +0000 UTC m=+38.168325398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:05:11.348333 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.348267 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e67a5f6-9d8a-469c-a66a-276525dd255e-tmp\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.350215 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.350196 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/6e67a5f6-9d8a-469c-a66a-276525dd255e-klusterlet-config\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.351180 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.351165 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" Jun 03 01:05:11.358272 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.356534 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqnl\" (UniqueName: \"kubernetes.io/projected/6e67a5f6-9d8a-469c-a66a-276525dd255e-kube-api-access-pcqnl\") pod \"klusterlet-addon-workmgr-58fcfcff5c-rtght\" (UID: \"6e67a5f6-9d8a-469c-a66a-276525dd255e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.358272 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.356667 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-999vj\" (UniqueName: \"kubernetes.io/projected/e1216639-c507-49b3-b4cb-e818dfbc9653-kube-api-access-999vj\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.358272 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.356706 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7kvt\" (UniqueName: \"kubernetes.io/projected/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-kube-api-access-d7kvt\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:11.358525 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.358508 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:05:11.363172 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.363150 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e1216639-c507-49b3-b4cb-e818dfbc9653-config-volume\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.383206 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.383176 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:11.431741 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.431701 2556 generic.go:358] "Generic (PLEG): container finished" podID="6f1f69d3-8e71-4789-98e5-e0ca691d8929" containerID="bcb295dcca57feba60765f7b33d2b496676d2f1e7b93837d09a6807f0185db81" exitCode=0 Jun 03 01:05:11.431873 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.431766 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerDied","Data":"bcb295dcca57feba60765f7b33d2b496676d2f1e7b93837d09a6807f0185db81"} Jun 03 01:05:11.542957 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.542920 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd"] Jun 03 01:05:11.546168 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:05:11.546139 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e9439cf_ef89_4f4f_9143_737258e8fb40.slice/crio-70c4fab2c476b401ada05d7a56c833665ef3c883f4a370c7bc3e018bb72140b5 WatchSource:0}: Error finding container 70c4fab2c476b401ada05d7a56c833665ef3c883f4a370c7bc3e018bb72140b5: Status 404 returned error can't find the container with id 70c4fab2c476b401ada05d7a56c833665ef3c883f4a370c7bc3e018bb72140b5 Jun 03 01:05:11.549010 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.548843 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght"] Jun 03 01:05:11.551963 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:05:11.551936 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e67a5f6_9d8a_469c_a66a_276525dd255e.slice/crio-751edf3aca4dacaa79cadbcdcd9739c1f515b2b7d980ca18262d2cd062984014 WatchSource:0}: Error finding container 751edf3aca4dacaa79cadbcdcd9739c1f515b2b7d980ca18262d2cd062984014: Status 404 returned error can't find the container with id 751edf3aca4dacaa79cadbcdcd9739c1f515b2b7d980ca18262d2cd062984014 Jun 03 01:05:11.554946 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.554928 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv"] Jun 03 01:05:11.559597 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:05:11.559577 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6efb82e_69aa_48fe_ac50_b750898b4043.slice/crio-48ae22e9a6205585fc507da34d67167e2ebc5d67f3a1cc7c4f7ec03179cedbdf WatchSource:0}: Error finding container 48ae22e9a6205585fc507da34d67167e2ebc5d67f3a1cc7c4f7ec03179cedbdf: Status 404 returned error can't find the container with id 48ae22e9a6205585fc507da34d67167e2ebc5d67f3a1cc7c4f7ec03179cedbdf Jun 03 01:05:11.750705 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.750666 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:11.750876 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.750776 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:05:11.750876 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.750794 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:05:11.750876 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.750849 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:12.750833859 +0000 UTC m=+39.071045491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:05:11.851939 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.851904 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:11.851939 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:11.851944 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:11.852121 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.852041 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:11.852121 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.852044 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:11.852121 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.852091 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:12.852077641 +0000 UTC m=+39.172289272 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:05:11.852121 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:11.852103 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:12.852097109 +0000 UTC m=+39.172308740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:05:12.435122 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.435084 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" event={"ID":"f6efb82e-69aa-48fe-ac50-b750898b4043","Type":"ContainerStarted","Data":"48ae22e9a6205585fc507da34d67167e2ebc5d67f3a1cc7c4f7ec03179cedbdf"} Jun 03 01:05:12.436248 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.436224 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" event={"ID":"1e9439cf-ef89-4f4f-9143-737258e8fb40","Type":"ContainerStarted","Data":"70c4fab2c476b401ada05d7a56c833665ef3c883f4a370c7bc3e018bb72140b5"} Jun 03 01:05:12.440212 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.440106 2556 generic.go:358] "Generic (PLEG): container finished" podID="6f1f69d3-8e71-4789-98e5-e0ca691d8929" containerID="c721078b211eb1fad32a1eeda52246743e63ce3f65536927b4ed88e96b99fd87" exitCode=0 Jun 03 01:05:12.440212 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.440180 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerDied","Data":"c721078b211eb1fad32a1eeda52246743e63ce3f65536927b4ed88e96b99fd87"} Jun 03 01:05:12.441375 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.441341 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" event={"ID":"6e67a5f6-9d8a-469c-a66a-276525dd255e","Type":"ContainerStarted","Data":"751edf3aca4dacaa79cadbcdcd9739c1f515b2b7d980ca18262d2cd062984014"} Jun 03 01:05:12.760621 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.760461 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:12.760621 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:12.760609 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:05:12.760838 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:12.760628 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:05:12.760838 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:12.760695 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:14.760672304 +0000 UTC m=+41.080883941 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:05:12.861929 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.861141 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:12.861929 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:12.861198 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:12.861929 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:12.861341 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:12.861929 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:12.861401 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:14.861382624 +0000 UTC m=+41.181594268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:05:12.861929 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:12.861835 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:12.861929 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:12.861888 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:14.861870977 +0000 UTC m=+41.182082616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:05:13.451082 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:13.450441 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5z279" event={"ID":"6f1f69d3-8e71-4789-98e5-e0ca691d8929","Type":"ContainerStarted","Data":"36e1aac4e769e2db345456c09720f214fe70a79042b4afb2cd1158411ecd3898"} Jun 03 01:05:13.476014 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:13.475513 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5z279" podStartSLOduration=5.819729056 podStartE2EDuration="39.475499318s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:04:37.191666079 +0000 UTC m=+3.511877713" lastFinishedPulling="2026-06-03 01:05:10.847436336 +0000 UTC m=+37.167647975" observedRunningTime="2026-06-03 01:05:13.473029462 +0000 UTC m=+39.793241141" watchObservedRunningTime="2026-06-03 01:05:13.475499318 +0000 UTC m=+39.795710973" Jun 03 01:05:14.778703 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:14.778662 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:14.779123 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:14.778798 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:05:14.779123 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:14.778813 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:05:14.779123 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:14.778867 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:18.778851475 +0000 UTC m=+45.099063107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:05:14.879173 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:14.879133 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:14.879351 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:14.879189 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:14.879351 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:14.879288 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:14.879464 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:14.879354 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:18.879336349 +0000 UTC m=+45.199547980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:05:14.879464 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:14.879353 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:14.879464 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:14.879424 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:18.879407872 +0000 UTC m=+45.199619515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:05:18.811230 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:18.811050 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:18.811626 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:18.811207 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:05:18.811626 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:18.811297 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:05:18.811626 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:18.811348 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:26.811335158 +0000 UTC m=+53.131546795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:05:18.912376 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:18.912346 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:18.912548 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:18.912388 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:18.912548 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:18.912515 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:18.912548 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:18.912519 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:18.912664 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:18.912572 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:26.912558083 +0000 UTC m=+53.232769718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:05:18.912664 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:18.912587 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:26.912580122 +0000 UTC m=+53.232791753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:05:19.463433 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:19.463397 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" event={"ID":"6e67a5f6-9d8a-469c-a66a-276525dd255e","Type":"ContainerStarted","Data":"ca1eda33ae66cc050d805940cc028cacca8d83715e1fcf96a928fb073fb7bb71"} Jun 03 01:05:19.463864 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:19.463839 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:19.464987 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:19.464947 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" event={"ID":"f6efb82e-69aa-48fe-ac50-b750898b4043","Type":"ContainerStarted","Data":"8818b1a96b0349715dc1e568860a5a82baa3ec566e6a085b35a059ed4caef454"} Jun 03 01:05:19.465820 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:19.465798 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:05:19.466578 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:19.466552 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" event={"ID":"1e9439cf-ef89-4f4f-9143-737258e8fb40","Type":"ContainerStarted","Data":"262be90b6b223646b3f09a41804fc1cd2957d70e7b9f035764cd1f53f9ccd4fb"} Jun 03 01:05:19.483511 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:19.483440 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" podStartSLOduration=37.647200703 podStartE2EDuration="44.483426339s" podCreationTimestamp="2026-06-03 01:04:35 +0000 UTC" firstStartedPulling="2026-06-03 01:05:11.554499203 +0000 UTC m=+37.874710834" lastFinishedPulling="2026-06-03 01:05:18.390724834 +0000 UTC m=+44.710936470" observedRunningTime="2026-06-03 01:05:19.481823358 +0000 UTC m=+45.802035013" watchObservedRunningTime="2026-06-03 01:05:19.483426339 +0000 UTC m=+45.803637993" Jun 03 01:05:19.497417 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:19.497358 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" podStartSLOduration=37.658376493 podStartE2EDuration="44.49734428s" podCreationTimestamp="2026-06-03 01:04:35 +0000 UTC" firstStartedPulling="2026-06-03 01:05:11.548156454 +0000 UTC m=+37.868368086" lastFinishedPulling="2026-06-03 01:05:18.387124238 +0000 UTC m=+44.707335873" observedRunningTime="2026-06-03 01:05:19.496555799 +0000 UTC m=+45.816767460" watchObservedRunningTime="2026-06-03 01:05:19.49734428 +0000 UTC m=+45.817555932" Jun 03 01:05:21.472655 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:21.472615 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" event={"ID":"f6efb82e-69aa-48fe-ac50-b750898b4043","Type":"ContainerStarted","Data":"769966fe06822a8c40c9d08c2719eb4c567a2f92cf4f0b917d8e85760fce0978"} Jun 03 01:05:21.472655 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:21.472654 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" event={"ID":"f6efb82e-69aa-48fe-ac50-b750898b4043","Type":"ContainerStarted","Data":"34786aaf349b2d98c3ee10f15f3b25ede189f1cef864733f2fcb96a2a9f30a95"} Jun 03 01:05:21.491714 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:21.491661 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" podStartSLOduration=37.394149509 podStartE2EDuration="46.491648132s" podCreationTimestamp="2026-06-03 01:04:35 +0000 UTC" firstStartedPulling="2026-06-03 01:05:11.561456286 +0000 UTC m=+37.881667917" lastFinishedPulling="2026-06-03 01:05:20.658954906 +0000 UTC m=+46.979166540" observedRunningTime="2026-06-03 01:05:21.489720298 +0000 UTC m=+47.809931961" watchObservedRunningTime="2026-06-03 01:05:21.491648132 +0000 UTC m=+47.811859785" Jun 03 01:05:26.872834 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:26.872792 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:26.873213 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:26.872941 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:05:26.873213 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:26.872963 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:05:26.873213 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:26.873016 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:42.873000174 +0000 UTC m=+69.193211805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:05:26.973903 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:26.973859 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:26.974086 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:26.973919 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:26.974086 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:26.974022 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:26.974086 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:26.974056 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:26.974199 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:26.974101 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:42.974080668 +0000 UTC m=+69.294292307 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:05:26.974199 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:26.974117 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:05:42.974109454 +0000 UTC m=+69.294321087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:05:36.435915 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:36.435887 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cnmxp" Jun 03 01:05:39.980746 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:39.980707 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:05:39.981176 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:39.980774 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:39.983867 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:39.983844 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 01:05:39.983977 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:39.983883 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 01:05:39.991161 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:39.991138 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 01:05:39.991234 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:39.991199 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs podName:85de7c04-6c45-4a09-8489-0f99197af1b2 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:43.99118197 +0000 UTC m=+130.311393600 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs") pod "network-metrics-daemon-vf9xt" (UID: "85de7c04-6c45-4a09-8489-0f99197af1b2") : secret "metrics-daemon-secret" not found Jun 03 01:05:39.994972 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:39.994947 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88-original-pull-secret\") pod \"global-pull-secret-syncer-hxtfb\" (UID: \"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88\") " pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:40.081820 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.081785 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:40.084812 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.084786 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 01:05:40.093276 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.093258 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hxtfb" Jun 03 01:05:40.094457 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.094441 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 01:05:40.105038 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.105010 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ljz2\" (UniqueName: \"kubernetes.io/projected/a94459f0-81da-4476-b4d9-e46d361e43d2-kube-api-access-5ljz2\") pod \"network-check-target-64th5\" (UID: \"a94459f0-81da-4476-b4d9-e46d361e43d2\") " pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:40.211747 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.211714 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hxtfb"] Jun 03 01:05:40.214628 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:05:40.214598 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3e6dc3_cb4b_4e41_b5d0_63213d63bb88.slice/crio-57961b82509c6a593d6b0ea6841d4ebd16c8b35231aefffb8a05db79fb6b76a7 WatchSource:0}: Error finding container 57961b82509c6a593d6b0ea6841d4ebd16c8b35231aefffb8a05db79fb6b76a7: Status 404 returned error can't find the container with id 57961b82509c6a593d6b0ea6841d4ebd16c8b35231aefffb8a05db79fb6b76a7 Jun 03 01:05:40.406833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.406806 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-55dgg\"" Jun 03 01:05:40.414963 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.414937 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:40.514884 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.514850 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hxtfb" event={"ID":"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88","Type":"ContainerStarted","Data":"57961b82509c6a593d6b0ea6841d4ebd16c8b35231aefffb8a05db79fb6b76a7"} Jun 03 01:05:40.533102 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:40.533076 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-64th5"] Jun 03 01:05:40.535787 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:05:40.535757 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94459f0_81da_4476_b4d9_e46d361e43d2.slice/crio-27d12a177c9e200f640050c059c44469b394ec2ddf7f83b1db5e111105546117 WatchSource:0}: Error finding container 27d12a177c9e200f640050c059c44469b394ec2ddf7f83b1db5e111105546117: Status 404 returned error can't find the container with id 27d12a177c9e200f640050c059c44469b394ec2ddf7f83b1db5e111105546117 Jun 03 01:05:41.518933 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:41.518892 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64th5" event={"ID":"a94459f0-81da-4476-b4d9-e46d361e43d2","Type":"ContainerStarted","Data":"27d12a177c9e200f640050c059c44469b394ec2ddf7f83b1db5e111105546117"} Jun 03 01:05:42.903328 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:42.903286 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:05:42.903863 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:42.903458 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:05:42.903863 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:42.903489 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:05:42.903863 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:42.903550 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:14.903529042 +0000 UTC m=+101.223740683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:05:43.004747 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:43.004705 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:05:43.004934 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:43.004762 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:05:43.004934 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:43.004886 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:05:43.005047 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:43.004960 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:15.004939598 +0000 UTC m=+101.325151239 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:05:43.005047 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:43.004984 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:05:43.005142 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:05:43.005051 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:06:15.005032352 +0000 UTC m=+101.325243987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:05:45.532100 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:45.531962 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hxtfb" event={"ID":"2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88","Type":"ContainerStarted","Data":"4baf1b4205f5e54a15ad42516994eb553ad227c9101becd636d298ec8fc84fb7"} Jun 03 01:05:45.533295 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:45.533263 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-64th5" event={"ID":"a94459f0-81da-4476-b4d9-e46d361e43d2","Type":"ContainerStarted","Data":"303a77a6586cee2cdc161fcb868d60d235816dd0372488431e640b036d9a4fa0"} Jun 03 01:05:45.533442 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:45.533428 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:05:45.547499 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:45.547401 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hxtfb" podStartSLOduration=66.461628403 podStartE2EDuration="1m11.547386615s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:05:40.2164231 +0000 UTC m=+66.536634731" lastFinishedPulling="2026-06-03 01:05:45.302181312 +0000 UTC m=+71.622392943" observedRunningTime="2026-06-03 01:05:45.547352844 +0000 UTC m=+71.867564497" watchObservedRunningTime="2026-06-03 01:05:45.547386615 +0000 UTC m=+71.867598268" Jun 03 01:05:45.561285 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:05:45.561241 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-64th5" podStartSLOduration=66.801786173 podStartE2EDuration="1m11.561229429s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:05:40.537780369 +0000 UTC m=+66.857992009" lastFinishedPulling="2026-06-03 01:05:45.297223631 +0000 UTC m=+71.617435265" observedRunningTime="2026-06-03 01:05:45.560791987 +0000 UTC m=+71.881003639" watchObservedRunningTime="2026-06-03 01:05:45.561229429 +0000 UTC m=+71.881441081" Jun 03 01:06:14.943562 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:14.943460 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:06:14.943945 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:06:14.943613 2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 01:06:14.943945 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:06:14.943635 2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cf569fc5d-z6s7p: secret "image-registry-tls" not found Jun 03 01:06:14.943945 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:06:14.943689 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls podName:aa94ea55-d3d4-47b5-84c1-5d3f77b7a976 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:18.943673093 +0000 UTC m=+165.263884724 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls") pod "image-registry-7cf569fc5d-z6s7p" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976") : secret "image-registry-tls" not found Jun 03 01:06:15.044688 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:15.044653 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:06:15.044688 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:15.044692 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:06:15.044863 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:06:15.044812 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 01:06:15.044912 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:06:15.044902 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls podName:e1216639-c507-49b3-b4cb-e818dfbc9653 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:19.044884159 +0000 UTC m=+165.365095791 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls") pod "dns-default-mzdpl" (UID: "e1216639-c507-49b3-b4cb-e818dfbc9653") : secret "dns-default-metrics-tls" not found Jun 03 01:06:15.044955 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:06:15.044815 2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 01:06:15.044955 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:06:15.044940 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert podName:01ce2775-bfc8-4e01-a60e-21bf86b70fb0 nodeName:}" failed. No retries permitted until 2026-06-03 01:07:19.044933095 +0000 UTC m=+165.365144725 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert") pod "ingress-canary-4nrbl" (UID: "01ce2775-bfc8-4e01-a60e-21bf86b70fb0") : secret "canary-serving-cert" not found Jun 03 01:06:16.537750 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:16.537718 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-64th5" Jun 03 01:06:23.154668 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:23.154639 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m922r_df15ae61-4fab-44fc-98dd-67bce5d2ba3f/dns-node-resolver/0.log" Jun 03 01:06:23.954644 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:23.954617 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8gv9_ba7507f8-ceb8-45a7-a278-4f008706579b/node-ca/0.log" Jun 03 01:06:41.359699 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:41.359652 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" podUID="f6efb82e-69aa-48fe-ac50-b750898b4043" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 01:06:44.062565 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:44.062521 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:06:44.064914 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:44.064892 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/85de7c04-6c45-4a09-8489-0f99197af1b2-metrics-certs\") pod \"network-metrics-daemon-vf9xt\" (UID: \"85de7c04-6c45-4a09-8489-0f99197af1b2\") " pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:06:44.302607 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:44.302578 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgszk\"" Jun 03 01:06:44.310826 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:44.310792 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vf9xt" Jun 03 01:06:44.429116 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:44.429081 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vf9xt"] Jun 03 01:06:44.432131 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:06:44.432103 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85de7c04_6c45_4a09_8489_0f99197af1b2.slice/crio-fa9ec924abe46b96fd1dfe9f453537f62ee07cde11fb2120dd15272634b078e1 WatchSource:0}: Error finding container fa9ec924abe46b96fd1dfe9f453537f62ee07cde11fb2120dd15272634b078e1: Status 404 returned error can't find the container with id fa9ec924abe46b96fd1dfe9f453537f62ee07cde11fb2120dd15272634b078e1 Jun 03 01:06:44.671092 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:44.671002 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vf9xt" event={"ID":"85de7c04-6c45-4a09-8489-0f99197af1b2","Type":"ContainerStarted","Data":"fa9ec924abe46b96fd1dfe9f453537f62ee07cde11fb2120dd15272634b078e1"} Jun 03 01:06:46.199074 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.199043 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x4fl8"] Jun 03 01:06:46.200895 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.200879 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.203776 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.203751 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l2788\"" Jun 03 01:06:46.204045 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.203830 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 01:06:46.204968 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.204949 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 01:06:46.205175 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.205160 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 01:06:46.205306 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.205292 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 01:06:46.216166 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.216135 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x4fl8"] Jun 03 01:06:46.279523 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.279491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.279523 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.279530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-crio-socket\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.279726 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.279555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.279726 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.279579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-data-volume\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.279726 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.279595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9kg\" (UniqueName: \"kubernetes.io/projected/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-kube-api-access-xw9kg\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.380377 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.380338 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.380377 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.380377 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-crio-socket\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.380680 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.380400 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.380680 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.380435 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-data-volume\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.380680 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.380463 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9kg\" (UniqueName: \"kubernetes.io/projected/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-kube-api-access-xw9kg\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.380680 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.380505 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-crio-socket\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.380886 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.380871 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-data-volume\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.381098 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.381078 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.382903 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.382884 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.391945 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.391921 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9kg\" (UniqueName: \"kubernetes.io/projected/2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11-kube-api-access-xw9kg\") pod \"insights-runtime-extractor-x4fl8\" (UID: \"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11\") " pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.510209 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.510111 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x4fl8" Jun 03 01:06:46.630293 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.630258 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x4fl8"] Jun 03 01:06:46.635449 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:06:46.635413 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb2cf3a_ad68_4b1a_b09b_d7b3b00b7c11.slice/crio-503545b99cde519f3987859b99433a4a939c6a08329d05588420e3b7554e5d4a WatchSource:0}: Error finding container 503545b99cde519f3987859b99433a4a939c6a08329d05588420e3b7554e5d4a: Status 404 returned error can't find the container with id 503545b99cde519f3987859b99433a4a939c6a08329d05588420e3b7554e5d4a Jun 03 01:06:46.678901 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.678871 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vf9xt" event={"ID":"85de7c04-6c45-4a09-8489-0f99197af1b2","Type":"ContainerStarted","Data":"7d7e4ae0e06de3b73885ce4f66bf7d8eb46fc259b347cc9ae125e645e6621422"} Jun 03 01:06:46.679029 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.678909 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vf9xt" event={"ID":"85de7c04-6c45-4a09-8489-0f99197af1b2","Type":"ContainerStarted","Data":"747defe31141d536235b5d955ca688eff0afcd0657a379619389fa161bd1ddfc"} Jun 03 01:06:46.679778 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:46.679755 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4fl8" event={"ID":"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11","Type":"ContainerStarted","Data":"503545b99cde519f3987859b99433a4a939c6a08329d05588420e3b7554e5d4a"} Jun 03 01:06:47.695878 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:47.695786 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4fl8" event={"ID":"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11","Type":"ContainerStarted","Data":"8b79a8fe679ed34c09361d8d6a8bb2dfa68fa63dd30f86d11ebac629403eb5b2"} Jun 03 01:06:47.695878 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:47.695826 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4fl8" event={"ID":"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11","Type":"ContainerStarted","Data":"5b552c1103e23b335ee666b4be4e2995390ab36e9da2bd121b09b4550c151c46"} Jun 03 01:06:49.702560 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:49.702524 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x4fl8" event={"ID":"2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11","Type":"ContainerStarted","Data":"72537be7685d4d1e850363225ef220709d3c6b8a62da41c8a9317d1b5aca6637"} Jun 03 01:06:49.720214 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:49.720134 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x4fl8" podStartSLOduration=0.945834335 podStartE2EDuration="3.720120369s" podCreationTimestamp="2026-06-03 01:06:46 +0000 UTC" firstStartedPulling="2026-06-03 01:06:46.693035144 +0000 UTC m=+133.013246776" lastFinishedPulling="2026-06-03 01:06:49.467321174 +0000 UTC m=+135.787532810" observedRunningTime="2026-06-03 01:06:49.7187051 +0000 UTC m=+136.038916764" watchObservedRunningTime="2026-06-03 01:06:49.720120369 +0000 UTC m=+136.040332028" Jun 03 01:06:49.720585 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:49.720558 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vf9xt" podStartSLOduration=134.475255578 podStartE2EDuration="2m15.720552196s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="2026-06-03 01:06:44.434216082 +0000 UTC m=+130.754427716" lastFinishedPulling="2026-06-03 01:06:45.679512689 +0000 UTC m=+131.999724334" observedRunningTime="2026-06-03 01:06:46.694465494 +0000 UTC m=+133.014677147" watchObservedRunningTime="2026-06-03 01:06:49.720552196 +0000 UTC m=+136.040763848" Jun 03 01:06:51.360516 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:06:51.360463 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" podUID="f6efb82e-69aa-48fe-ac50-b750898b4043" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 01:07:00.283442 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.283413 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t9nzl"] Jun 03 01:07:00.285494 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.285462 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.287920 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.287895 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 01:07:00.288064 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.287945 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 01:07:00.288064 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.287982 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 01:07:00.289528 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.289504 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 01:07:00.289652 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.289534 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sjcbr\"" Jun 03 01:07:00.289652 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.289542 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 01:07:00.289652 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.289534 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 01:07:00.382573 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-tls\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382573 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382585 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-textfile\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382828 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-sys\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382828 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382649 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-wtmp\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382828 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-root\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382828 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382702 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-metrics-client-ca\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382828 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crl2f\" (UniqueName: \"kubernetes.io/projected/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-kube-api-access-crl2f\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382998 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382840 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.382998 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.382876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.483841 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.483809 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-tls\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.483841 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.483850 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-textfile\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.483876 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-sys\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.483900 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-wtmp\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.483928 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-root\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.483954 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-metrics-client-ca\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:07:00.483966 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484019 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-root\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484025 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-sys\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484079 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:07:00.484048 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-tls podName:81e82c8f-6611-4e6d-8754-a0a7b222bb4e nodeName:}" failed. No retries permitted until 2026-06-03 01:07:00.98402859 +0000 UTC m=+147.304240222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-tls") pod "node-exporter-t9nzl" (UID: "81e82c8f-6611-4e6d-8754-a0a7b222bb4e") : secret "node-exporter-tls" not found Jun 03 01:07:00.484510 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484088 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crl2f\" (UniqueName: \"kubernetes.io/projected/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-kube-api-access-crl2f\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484510 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484167 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484510 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484090 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-wtmp\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484510 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484183 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-textfile\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484510 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484202 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484700 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484551 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-metrics-client-ca\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.484700 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.484627 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-accelerators-collector-config\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.486297 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.486278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.491836 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.491808 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crl2f\" (UniqueName: \"kubernetes.io/projected/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-kube-api-access-crl2f\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.988928 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.988893 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-tls\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:00.991239 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:00.991204 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/81e82c8f-6611-4e6d-8754-a0a7b222bb4e-node-exporter-tls\") pod \"node-exporter-t9nzl\" (UID: \"81e82c8f-6611-4e6d-8754-a0a7b222bb4e\") " pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:01.194930 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.194897 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t9nzl" Jun 03 01:07:01.202591 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:07:01.202560 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e82c8f_6611_4e6d_8754_a0a7b222bb4e.slice/crio-e0986a5901b7479259f7b8d0a400ca97f045a6f6093074bb562f7c12cfac15d9 WatchSource:0}: Error finding container e0986a5901b7479259f7b8d0a400ca97f045a6f6093074bb562f7c12cfac15d9: Status 404 returned error can't find the container with id e0986a5901b7479259f7b8d0a400ca97f045a6f6093074bb562f7c12cfac15d9 Jun 03 01:07:01.360232 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.360197 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" podUID="f6efb82e-69aa-48fe-ac50-b750898b4043" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 01:07:01.360630 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.360257 2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" Jun 03 01:07:01.360886 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.360854 2556 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"769966fe06822a8c40c9d08c2719eb4c567a2f92cf4f0b917d8e85760fce0978"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 01:07:01.360939 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.360923 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" podUID="f6efb82e-69aa-48fe-ac50-b750898b4043" containerName="service-proxy" containerID="cri-o://769966fe06822a8c40c9d08c2719eb4c567a2f92cf4f0b917d8e85760fce0978" gracePeriod=30 Jun 03 01:07:01.735021 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.734932 2556 generic.go:358] "Generic (PLEG): container finished" podID="f6efb82e-69aa-48fe-ac50-b750898b4043" containerID="769966fe06822a8c40c9d08c2719eb4c567a2f92cf4f0b917d8e85760fce0978" exitCode=2 Jun 03 01:07:01.735021 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.734996 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" event={"ID":"f6efb82e-69aa-48fe-ac50-b750898b4043","Type":"ContainerDied","Data":"769966fe06822a8c40c9d08c2719eb4c567a2f92cf4f0b917d8e85760fce0978"} Jun 03 01:07:01.735242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.735033 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-569c5c656b-67bkv" event={"ID":"f6efb82e-69aa-48fe-ac50-b750898b4043","Type":"ContainerStarted","Data":"45eaec8c50f648463d37129c8ac538fc7b6ae415fdbc8ba395852596f1382214"} Jun 03 01:07:01.736169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:01.736144 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9nzl" event={"ID":"81e82c8f-6611-4e6d-8754-a0a7b222bb4e","Type":"ContainerStarted","Data":"e0986a5901b7479259f7b8d0a400ca97f045a6f6093074bb562f7c12cfac15d9"} Jun 03 01:07:02.740515 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:02.740413 2556 generic.go:358] "Generic (PLEG): container finished" podID="81e82c8f-6611-4e6d-8754-a0a7b222bb4e" containerID="3e62695cded531a5988c26ad817b72face01ec0ec35135d6cb2e30aa88e46616" exitCode=0 Jun 03 01:07:02.740515 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:02.740464 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9nzl" event={"ID":"81e82c8f-6611-4e6d-8754-a0a7b222bb4e","Type":"ContainerDied","Data":"3e62695cded531a5988c26ad817b72face01ec0ec35135d6cb2e30aa88e46616"} Jun 03 01:07:03.744712 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:03.744667 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9nzl" event={"ID":"81e82c8f-6611-4e6d-8754-a0a7b222bb4e","Type":"ContainerStarted","Data":"b7b80f887d657125485e9680d2756da68b162f691a7d00e5e3f39ab022f34181"} Jun 03 01:07:03.744712 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:03.744716 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t9nzl" event={"ID":"81e82c8f-6611-4e6d-8754-a0a7b222bb4e","Type":"ContainerStarted","Data":"7cbf4da7e4f889d6a994f0c80f27c97f8d94ddbb01e9e5cd9b263259dcda8030"} Jun 03 01:07:03.763524 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:03.763460 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t9nzl" podStartSLOduration=2.551335619 podStartE2EDuration="3.763444592s" podCreationTimestamp="2026-06-03 01:07:00 +0000 UTC" firstStartedPulling="2026-06-03 01:07:01.20427097 +0000 UTC m=+147.524482602" lastFinishedPulling="2026-06-03 01:07:02.41637994 +0000 UTC m=+148.736591575" observedRunningTime="2026-06-03 01:07:03.761800496 +0000 UTC m=+150.082012149" watchObservedRunningTime="2026-06-03 01:07:03.763444592 +0000 UTC m=+150.083656244" Jun 03 01:07:14.014387 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:07:14.014343 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" podUID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" Jun 03 01:07:14.094737 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:07:14.094697 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-4nrbl" podUID="01ce2775-bfc8-4e01-a60e-21bf86b70fb0" Jun 03 01:07:14.154268 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:07:14.154229 2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mzdpl" podUID="e1216639-c507-49b3-b4cb-e818dfbc9653" Jun 03 01:07:14.771322 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:14.771293 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:07:14.771527 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:14.771502 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:07:18.784319 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:18.784279 2556 generic.go:358] "Generic (PLEG): container finished" podID="6e67a5f6-9d8a-469c-a66a-276525dd255e" containerID="ca1eda33ae66cc050d805940cc028cacca8d83715e1fcf96a928fb073fb7bb71" exitCode=1 Jun 03 01:07:18.784812 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:18.784373 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" event={"ID":"6e67a5f6-9d8a-469c-a66a-276525dd255e","Type":"ContainerDied","Data":"ca1eda33ae66cc050d805940cc028cacca8d83715e1fcf96a928fb073fb7bb71"} Jun 03 01:07:18.784812 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:18.784805 2556 scope.go:117] "RemoveContainer" containerID="ca1eda33ae66cc050d805940cc028cacca8d83715e1fcf96a928fb073fb7bb71" Jun 03 01:07:18.786065 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:18.786036 2556 generic.go:358] "Generic (PLEG): container finished" podID="1e9439cf-ef89-4f4f-9143-737258e8fb40" containerID="262be90b6b223646b3f09a41804fc1cd2957d70e7b9f035764cd1f53f9ccd4fb" exitCode=255 Jun 03 01:07:18.786137 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:18.786093 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" event={"ID":"1e9439cf-ef89-4f4f-9143-737258e8fb40","Type":"ContainerDied","Data":"262be90b6b223646b3f09a41804fc1cd2957d70e7b9f035764cd1f53f9ccd4fb"} Jun 03 01:07:18.786411 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:18.786386 2556 scope.go:117] "RemoveContainer" containerID="262be90b6b223646b3f09a41804fc1cd2957d70e7b9f035764cd1f53f9ccd4fb" Jun 03 01:07:19.026724 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.026683 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:07:19.029115 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.029084 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"image-registry-7cf569fc5d-z6s7p\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:07:19.127634 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.127540 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:07:19.127634 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.127602 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:07:19.129951 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.129927 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1216639-c507-49b3-b4cb-e818dfbc9653-metrics-tls\") pod \"dns-default-mzdpl\" (UID: \"e1216639-c507-49b3-b4cb-e818dfbc9653\") " pod="openshift-dns/dns-default-mzdpl" Jun 03 01:07:19.130059 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.129975 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01ce2775-bfc8-4e01-a60e-21bf86b70fb0-cert\") pod \"ingress-canary-4nrbl\" (UID: \"01ce2775-bfc8-4e01-a60e-21bf86b70fb0\") " pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:07:19.275759 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.275732 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kzjqn\"" Jun 03 01:07:19.275759 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.275732 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lxj66\"" Jun 03 01:07:19.283180 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.283159 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:07:19.283317 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.283228 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4nrbl" Jun 03 01:07:19.407659 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.407459 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4nrbl"] Jun 03 01:07:19.409629 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:07:19.409599 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ce2775_bfc8_4e01_a60e_21bf86b70fb0.slice/crio-5c4ecf5fb2aed292f8cb5e4385c1e62305f1a332b643a12abe637d7f839c22de WatchSource:0}: Error finding container 5c4ecf5fb2aed292f8cb5e4385c1e62305f1a332b643a12abe637d7f839c22de: Status 404 returned error can't find the container with id 5c4ecf5fb2aed292f8cb5e4385c1e62305f1a332b643a12abe637d7f839c22de Jun 03 01:07:19.427062 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.427006 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cf569fc5d-z6s7p"] Jun 03 01:07:19.428892 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:07:19.428868 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa94ea55_d3d4_47b5_84c1_5d3f77b7a976.slice/crio-652ca62ecea742cce405552364e3d507d0446de3db3cfdcdb8ddb2639fae3aaf WatchSource:0}: Error finding container 652ca62ecea742cce405552364e3d507d0446de3db3cfdcdb8ddb2639fae3aaf: Status 404 returned error can't find the container with id 652ca62ecea742cce405552364e3d507d0446de3db3cfdcdb8ddb2639fae3aaf Jun 03 01:07:19.463639 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.463619 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:07:19.791307 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.791271 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" event={"ID":"6e67a5f6-9d8a-469c-a66a-276525dd255e","Type":"ContainerStarted","Data":"a2cdd8f155cca0850bec25dd2b19ff532cc7c6a6e070134a7cb0ab69399356cd"} Jun 03 01:07:19.791839 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.791688 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:07:19.792183 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.792159 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58fcfcff5c-rtght" Jun 03 01:07:19.792848 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.792830 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557cd944cb-9xjtd" event={"ID":"1e9439cf-ef89-4f4f-9143-737258e8fb40","Type":"ContainerStarted","Data":"cc4554e4b96ad7890d89285169d9f4e03469c779c38a584376d5b8d2155e90c9"} Jun 03 01:07:19.793825 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.793806 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nrbl" event={"ID":"01ce2775-bfc8-4e01-a60e-21bf86b70fb0","Type":"ContainerStarted","Data":"5c4ecf5fb2aed292f8cb5e4385c1e62305f1a332b643a12abe637d7f839c22de"} Jun 03 01:07:19.795074 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.795053 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" event={"ID":"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976","Type":"ContainerStarted","Data":"3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f"} Jun 03 01:07:19.798991 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.795078 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" event={"ID":"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976","Type":"ContainerStarted","Data":"652ca62ecea742cce405552364e3d507d0446de3db3cfdcdb8ddb2639fae3aaf"} Jun 03 01:07:19.799303 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.799287 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:07:19.852648 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:19.852587 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" podStartSLOduration=165.852570062 podStartE2EDuration="2m45.852570062s" podCreationTimestamp="2026-06-03 01:04:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:07:19.851529519 +0000 UTC m=+166.171741172" watchObservedRunningTime="2026-06-03 01:07:19.852570062 +0000 UTC m=+166.172781717" Jun 03 01:07:21.802555 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:21.802516 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4nrbl" event={"ID":"01ce2775-bfc8-4e01-a60e-21bf86b70fb0","Type":"ContainerStarted","Data":"9eba130f312c9d0ff9fc2a117e75020a49e623e7bff9bb73bc79c36c8c38e86b"} Jun 03 01:07:21.816968 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:21.816926 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4nrbl" podStartSLOduration=129.935885919 podStartE2EDuration="2m11.816911986s" podCreationTimestamp="2026-06-03 01:05:10 +0000 UTC" firstStartedPulling="2026-06-03 01:07:19.411549599 +0000 UTC m=+165.731761229" lastFinishedPulling="2026-06-03 01:07:21.292575659 +0000 UTC m=+167.612787296" observedRunningTime="2026-06-03 01:07:21.816544627 +0000 UTC m=+168.136756280" watchObservedRunningTime="2026-06-03 01:07:21.816911986 +0000 UTC m=+168.137123639" Jun 03 01:07:28.280638 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:28.280600 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mzdpl" Jun 03 01:07:28.283515 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:28.283492 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tw28v\"" Jun 03 01:07:28.291723 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:28.291706 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mzdpl" Jun 03 01:07:28.410586 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:28.410554 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mzdpl"] Jun 03 01:07:28.413758 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:07:28.413725 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1216639_c507_49b3_b4cb_e818dfbc9653.slice/crio-3e0080009bf550a166fb36816412c0602985d2c7e8396bee2cd9706792dbeb80 WatchSource:0}: Error finding container 3e0080009bf550a166fb36816412c0602985d2c7e8396bee2cd9706792dbeb80: Status 404 returned error can't find the container with id 3e0080009bf550a166fb36816412c0602985d2c7e8396bee2cd9706792dbeb80 Jun 03 01:07:28.822455 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:28.822419 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mzdpl" event={"ID":"e1216639-c507-49b3-b4cb-e818dfbc9653","Type":"ContainerStarted","Data":"3e0080009bf550a166fb36816412c0602985d2c7e8396bee2cd9706792dbeb80"} Jun 03 01:07:29.826735 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:29.826695 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mzdpl" event={"ID":"e1216639-c507-49b3-b4cb-e818dfbc9653","Type":"ContainerStarted","Data":"dc6653315d69a92d32458e33fd9d057bebcf96f3fb01038c81226fdfff23790b"} Jun 03 01:07:29.826735 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:29.826729 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mzdpl" event={"ID":"e1216639-c507-49b3-b4cb-e818dfbc9653","Type":"ContainerStarted","Data":"0c6e074d97c6c6e7f1c354755771f8e3365b49dddc3ede688fed703b5ed2b940"} Jun 03 01:07:29.827178 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:29.826814 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mzdpl" Jun 03 01:07:29.843283 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:29.843204 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mzdpl" podStartSLOduration=138.675740566 podStartE2EDuration="2m19.843191949s" podCreationTimestamp="2026-06-03 01:05:10 +0000 UTC" firstStartedPulling="2026-06-03 01:07:28.41540785 +0000 UTC m=+174.735619481" lastFinishedPulling="2026-06-03 01:07:29.582859219 +0000 UTC m=+175.903070864" observedRunningTime="2026-06-03 01:07:29.841499514 +0000 UTC m=+176.161711169" watchObservedRunningTime="2026-06-03 01:07:29.843191949 +0000 UTC m=+176.163403603" Jun 03 01:07:39.287225 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:39.287190 2556 patch_prober.go:28] interesting pod/image-registry-7cf569fc5d-z6s7p container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 01:07:39.287683 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:39.287242 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" podUID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:07:39.832354 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:39.832326 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mzdpl" Jun 03 01:07:40.803622 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:40.803590 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:07:46.661366 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:07:46.661329 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cf569fc5d-z6s7p"] Jun 03 01:08:11.680621 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:11.680554 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" podUID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" containerName="registry" containerID="cri-o://3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f" gracePeriod=30 Jun 03 01:08:12.914860 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.914837 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:08:12.943923 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.943885 2556 generic.go:358] "Generic (PLEG): container finished" podID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" containerID="3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f" exitCode=0 Jun 03 01:08:12.944088 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.943944 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" Jun 03 01:08:12.944088 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.943959 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" event={"ID":"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976","Type":"ContainerDied","Data":"3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f"} Jun 03 01:08:12.944088 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.944002 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cf569fc5d-z6s7p" event={"ID":"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976","Type":"ContainerDied","Data":"652ca62ecea742cce405552364e3d507d0446de3db3cfdcdb8ddb2639fae3aaf"} Jun 03 01:08:12.944088 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.944021 2556 scope.go:117] "RemoveContainer" containerID="3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f" Jun 03 01:08:12.953796 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.953778 2556 scope.go:117] "RemoveContainer" containerID="3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f" Jun 03 01:08:12.954078 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:08:12.954052 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f\": container with ID starting with 3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f not found: ID does not exist" containerID="3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f" Jun 03 01:08:12.954160 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:12.954088 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f"} err="failed to get container status \"3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f\": rpc error: code = NotFound desc = could not find container \"3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f\": container with ID starting with 3e8cd4d9d888f879d122341014aa229588758ec52c3b3e61dd07ac7b6378e85f not found: ID does not exist" Jun 03 01:08:13.010181 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010092 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-bound-sa-token\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010181 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010147 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-ca-trust-extracted\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010181 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010175 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010428 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010202 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-image-registry-private-configuration\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010428 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010245 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-trusted-ca\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010428 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010279 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcckm\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-kube-api-access-wcckm\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010428 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010308 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-installation-pull-secrets\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010428 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010335 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-certificates\") pod \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\" (UID: \"aa94ea55-d3d4-47b5-84c1-5d3f77b7a976\") " Jun 03 01:08:13.010888 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010830 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:08:13.011016 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.010883 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 01:08:13.012782 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.012752 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:08:13.012782 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.012771 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-kube-api-access-wcckm" (OuterVolumeSpecName: "kube-api-access-wcckm") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "kube-api-access-wcckm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:08:13.012927 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.012866 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:08:13.012927 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.012914 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 01:08:13.013069 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.013047 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:08:13.027305 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.027280 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" (UID: "aa94ea55-d3d4-47b5-84c1-5d3f77b7a976"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 01:08:13.111296 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111266 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-bound-sa-token\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.111296 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111293 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-ca-trust-extracted\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.111296 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111303 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-tls\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.111530 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111314 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-image-registry-private-configuration\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.111530 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111324 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-trusted-ca\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.111530 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111332 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcckm\" (UniqueName: \"kubernetes.io/projected/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-kube-api-access-wcckm\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.111530 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111342 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-installation-pull-secrets\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.111530 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.111351 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976-registry-certificates\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:08:13.264213 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.264185 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cf569fc5d-z6s7p"] Jun 03 01:08:13.267726 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:13.267691 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cf569fc5d-z6s7p"] Jun 03 01:08:14.283823 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:08:14.283791 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" path="/var/lib/kubelet/pods/aa94ea55-d3d4-47b5-84c1-5d3f77b7a976/volumes" Jun 03 01:09:34.172153 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:09:34.172125 2556 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 01:10:02.235132 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.235098 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4"] Jun 03 01:10:02.237328 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.235310 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" containerName="registry" Jun 03 01:10:02.237328 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.235320 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" containerName="registry" Jun 03 01:10:02.237328 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.235365 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa94ea55-d3d4-47b5-84c1-5d3f77b7a976" containerName="registry" Jun 03 01:10:02.238098 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.238083 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.240450 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.240421 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 01:10:02.240583 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.240531 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 01:10:02.241594 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.241580 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wbp4p\"" Jun 03 01:10:02.245386 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.245366 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4"] Jun 03 01:10:02.348369 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.348334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frmvh\" (UniqueName: \"kubernetes.io/projected/4d1b77bf-ef64-41c5-a134-47c45b609fc3-kube-api-access-frmvh\") pod \"openshift-lws-operator-bfc7f696d-4vff4\" (UID: \"4d1b77bf-ef64-41c5-a134-47c45b609fc3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.348558 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.348394 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d1b77bf-ef64-41c5-a134-47c45b609fc3-tmp\") pod \"openshift-lws-operator-bfc7f696d-4vff4\" (UID: \"4d1b77bf-ef64-41c5-a134-47c45b609fc3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.449028 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.448980 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d1b77bf-ef64-41c5-a134-47c45b609fc3-tmp\") pod \"openshift-lws-operator-bfc7f696d-4vff4\" (UID: \"4d1b77bf-ef64-41c5-a134-47c45b609fc3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.449205 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.449057 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frmvh\" (UniqueName: \"kubernetes.io/projected/4d1b77bf-ef64-41c5-a134-47c45b609fc3-kube-api-access-frmvh\") pod \"openshift-lws-operator-bfc7f696d-4vff4\" (UID: \"4d1b77bf-ef64-41c5-a134-47c45b609fc3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.449370 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.449350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d1b77bf-ef64-41c5-a134-47c45b609fc3-tmp\") pod \"openshift-lws-operator-bfc7f696d-4vff4\" (UID: \"4d1b77bf-ef64-41c5-a134-47c45b609fc3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.457124 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.457101 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frmvh\" (UniqueName: \"kubernetes.io/projected/4d1b77bf-ef64-41c5-a134-47c45b609fc3-kube-api-access-frmvh\") pod \"openshift-lws-operator-bfc7f696d-4vff4\" (UID: \"4d1b77bf-ef64-41c5-a134-47c45b609fc3\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.548038 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.548009 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" Jun 03 01:10:02.672548 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.672413 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4"] Jun 03 01:10:02.675126 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:10:02.675100 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d1b77bf_ef64_41c5_a134_47c45b609fc3.slice/crio-698cec1b0a865302ff47d1d52b2eab9758365363e79ca3adf0572331ad564275 WatchSource:0}: Error finding container 698cec1b0a865302ff47d1d52b2eab9758365363e79ca3adf0572331ad564275: Status 404 returned error can't find the container with id 698cec1b0a865302ff47d1d52b2eab9758365363e79ca3adf0572331ad564275 Jun 03 01:10:02.676389 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:02.676370 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:10:03.225940 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:03.225905 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" event={"ID":"4d1b77bf-ef64-41c5-a134-47c45b609fc3","Type":"ContainerStarted","Data":"698cec1b0a865302ff47d1d52b2eab9758365363e79ca3adf0572331ad564275"} Jun 03 01:10:06.236014 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:06.235913 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" event={"ID":"4d1b77bf-ef64-41c5-a134-47c45b609fc3","Type":"ContainerStarted","Data":"7deb2dad29acc61a1c0e12427ea419bf06a362451b6e2cc324320f9531234e8e"} Jun 03 01:10:06.251795 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:06.251740 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-4vff4" podStartSLOduration=1.021140623 podStartE2EDuration="4.251723325s" podCreationTimestamp="2026-06-03 01:10:02 +0000 UTC" firstStartedPulling="2026-06-03 01:10:02.676539109 +0000 UTC m=+328.996750740" lastFinishedPulling="2026-06-03 01:10:05.907121799 +0000 UTC m=+332.227333442" observedRunningTime="2026-06-03 01:10:06.250545877 +0000 UTC m=+332.570757529" watchObservedRunningTime="2026-06-03 01:10:06.251723325 +0000 UTC m=+332.571934977" Jun 03 01:10:25.430673 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.430590 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4"] Jun 03 01:10:25.437911 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.437889 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.440588 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.440563 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l57z2\"" Jun 03 01:10:25.440705 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.440611 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 01:10:25.440705 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.440629 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 01:10:25.440705 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.440575 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 01:10:25.440938 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.440922 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 01:10:25.445781 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.445761 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4"] Jun 03 01:10:25.508274 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.508239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1291665d-2a45-4e7a-b4e4-be5724cc200f-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.508274 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.508276 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1291665d-2a45-4e7a-b4e4-be5724cc200f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.508455 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.508358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1291665d-2a45-4e7a-b4e4-be5724cc200f-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.508455 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.508388 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4m69\" (UniqueName: \"kubernetes.io/projected/1291665d-2a45-4e7a-b4e4-be5724cc200f-kube-api-access-z4m69\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.508455 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.508418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1291665d-2a45-4e7a-b4e4-be5724cc200f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.609706 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.609676 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1291665d-2a45-4e7a-b4e4-be5724cc200f-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.609706 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.609708 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z4m69\" (UniqueName: \"kubernetes.io/projected/1291665d-2a45-4e7a-b4e4-be5724cc200f-kube-api-access-z4m69\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.609907 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.609726 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1291665d-2a45-4e7a-b4e4-be5724cc200f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.609907 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.609749 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1291665d-2a45-4e7a-b4e4-be5724cc200f-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.609907 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.609789 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1291665d-2a45-4e7a-b4e4-be5724cc200f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.610226 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.610205 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1291665d-2a45-4e7a-b4e4-be5724cc200f-manifests\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.611988 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.611968 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1291665d-2a45-4e7a-b4e4-be5724cc200f-tmp\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.612197 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.612180 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1291665d-2a45-4e7a-b4e4-be5724cc200f-webhook-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.612329 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.612300 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1291665d-2a45-4e7a-b4e4-be5724cc200f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.620124 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.620097 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4m69\" (UniqueName: \"kubernetes.io/projected/1291665d-2a45-4e7a-b4e4-be5724cc200f-kube-api-access-z4m69\") pod \"opendatahub-operator-controller-manager-85b884ccf6-ch4f4\" (UID: \"1291665d-2a45-4e7a-b4e4-be5724cc200f\") " pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.748439 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.748351 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:25.890827 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:25.890800 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4"] Jun 03 01:10:25.893713 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:10:25.893686 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1291665d_2a45_4e7a_b4e4_be5724cc200f.slice/crio-4c2d5d76d6b4f975afc4e70917dc005fe61d802fd5c00ceadc3e1c2453c0d92a WatchSource:0}: Error finding container 4c2d5d76d6b4f975afc4e70917dc005fe61d802fd5c00ceadc3e1c2453c0d92a: Status 404 returned error can't find the container with id 4c2d5d76d6b4f975afc4e70917dc005fe61d802fd5c00ceadc3e1c2453c0d92a Jun 03 01:10:26.287618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:26.287585 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" event={"ID":"1291665d-2a45-4e7a-b4e4-be5724cc200f","Type":"ContainerStarted","Data":"4c2d5d76d6b4f975afc4e70917dc005fe61d802fd5c00ceadc3e1c2453c0d92a"} Jun 03 01:10:29.295753 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:29.295714 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" event={"ID":"1291665d-2a45-4e7a-b4e4-be5724cc200f","Type":"ContainerStarted","Data":"08956e6e2e77775006811ab11f823cf35e0e467b8d983ad4d6e6e36140c755c6"} Jun 03 01:10:30.299689 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:30.299655 2556 generic.go:358] "Generic (PLEG): container finished" podID="1291665d-2a45-4e7a-b4e4-be5724cc200f" containerID="08956e6e2e77775006811ab11f823cf35e0e467b8d983ad4d6e6e36140c755c6" exitCode=0 Jun 03 01:10:30.300060 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:30.299710 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" event={"ID":"1291665d-2a45-4e7a-b4e4-be5724cc200f","Type":"ContainerDied","Data":"08956e6e2e77775006811ab11f823cf35e0e467b8d983ad4d6e6e36140c755c6"} Jun 03 01:10:31.304228 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:31.304192 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" event={"ID":"1291665d-2a45-4e7a-b4e4-be5724cc200f","Type":"ContainerStarted","Data":"73d867aadc6079d1c2314d1d9cac22e9aad817f2f5d09c6f2173fd2da8e089b0"} Jun 03 01:10:31.304722 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:31.304280 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:31.327295 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:31.327252 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" podStartSLOduration=1.6319934809999999 podStartE2EDuration="6.327238659s" podCreationTimestamp="2026-06-03 01:10:25 +0000 UTC" firstStartedPulling="2026-06-03 01:10:25.895352527 +0000 UTC m=+352.215564157" lastFinishedPulling="2026-06-03 01:10:30.590597704 +0000 UTC m=+356.910809335" observedRunningTime="2026-06-03 01:10:31.326320842 +0000 UTC m=+357.646532485" watchObservedRunningTime="2026-06-03 01:10:31.327238659 +0000 UTC m=+357.647450315" Jun 03 01:10:42.308830 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:42.308802 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85b884ccf6-ch4f4" Jun 03 01:10:44.529598 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.529567 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5"] Jun 03 01:10:44.537763 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.537741 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.540603 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.540584 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x2mlx\"" Jun 03 01:10:44.541634 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.541613 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 01:10:44.541810 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.541789 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 01:10:44.541810 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.541802 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 01:10:44.541964 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.541852 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 01:10:44.544285 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.543992 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5"] Jun 03 01:10:44.643443 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.643411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tmp\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.643607 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.643504 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8ssc\" (UniqueName: \"kubernetes.io/projected/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-kube-api-access-m8ssc\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.643607 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.643538 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.743885 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.743854 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8ssc\" (UniqueName: \"kubernetes.io/projected/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-kube-api-access-m8ssc\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.743885 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.743889 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.744066 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:10:44.744043 2556 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 03 01:10:44.744100 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.744084 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tmp\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.744100 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:10:44.744099 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tls-certs podName:5fd05112-3fc2-402a-b4b5-7ca1c9242f0e nodeName:}" failed. No retries permitted until 2026-06-03 01:10:45.244082622 +0000 UTC m=+371.564294253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tls-certs") pod "kube-auth-proxy-db4bc68bb-h6bf5" (UID: "5fd05112-3fc2-402a-b4b5-7ca1c9242f0e") : secret "kube-auth-proxy-tls" not found Jun 03 01:10:44.746122 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.746104 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tmp\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:44.762484 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:44.762439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8ssc\" (UniqueName: \"kubernetes.io/projected/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-kube-api-access-m8ssc\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:45.248945 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.248905 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:45.251303 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.251282 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fd05112-3fc2-402a-b4b5-7ca1c9242f0e-tls-certs\") pod \"kube-auth-proxy-db4bc68bb-h6bf5\" (UID: \"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e\") " pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:45.447330 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.447299 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" Jun 03 01:10:45.565492 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.565446 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5"] Jun 03 01:10:45.568463 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:10:45.568439 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd05112_3fc2_402a_b4b5_7ca1c9242f0e.slice/crio-7fc6a110d750d10d3443c83638a46ee1c40c7801d9991832db76c20c786cf377 WatchSource:0}: Error finding container 7fc6a110d750d10d3443c83638a46ee1c40c7801d9991832db76c20c786cf377: Status 404 returned error can't find the container with id 7fc6a110d750d10d3443c83638a46ee1c40c7801d9991832db76c20c786cf377 Jun 03 01:10:45.704608 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.704576 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-f4qsk"] Jun 03 01:10:45.708718 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.708701 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:45.711291 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.711272 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 01:10:45.711399 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.711302 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-m9khs\"" Jun 03 01:10:45.715928 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.715705 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-f4qsk"] Jun 03 01:10:45.753338 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.753312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-tls-certs\") pod \"model-serving-api-6577596cd5-f4qsk\" (UID: \"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb\") " pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:45.753460 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.753367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgs4\" (UniqueName: \"kubernetes.io/projected/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-kube-api-access-mcgs4\") pod \"model-serving-api-6577596cd5-f4qsk\" (UID: \"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb\") " pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:45.854588 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.854497 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-tls-certs\") pod \"model-serving-api-6577596cd5-f4qsk\" (UID: \"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb\") " pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:45.854588 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.854555 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgs4\" (UniqueName: \"kubernetes.io/projected/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-kube-api-access-mcgs4\") pod \"model-serving-api-6577596cd5-f4qsk\" (UID: \"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb\") " pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:45.854832 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:10:45.854653 2556 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 03 01:10:45.854832 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:10:45.854726 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-tls-certs podName:b21ce213-8e70-41ce-86bc-6c42bb1b4aeb nodeName:}" failed. No retries permitted until 2026-06-03 01:10:46.354703016 +0000 UTC m=+372.674914661 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-tls-certs") pod "model-serving-api-6577596cd5-f4qsk" (UID: "b21ce213-8e70-41ce-86bc-6c42bb1b4aeb") : secret "model-serving-api-tls" not found Jun 03 01:10:45.863284 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:45.863258 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgs4\" (UniqueName: \"kubernetes.io/projected/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-kube-api-access-mcgs4\") pod \"model-serving-api-6577596cd5-f4qsk\" (UID: \"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb\") " pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:46.344833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:46.344795 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" event={"ID":"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e","Type":"ContainerStarted","Data":"7fc6a110d750d10d3443c83638a46ee1c40c7801d9991832db76c20c786cf377"} Jun 03 01:10:46.359205 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:46.359179 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-tls-certs\") pod \"model-serving-api-6577596cd5-f4qsk\" (UID: \"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb\") " pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:46.361691 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:46.361671 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b21ce213-8e70-41ce-86bc-6c42bb1b4aeb-tls-certs\") pod \"model-serving-api-6577596cd5-f4qsk\" (UID: \"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb\") " pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:46.619343 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:46.619258 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:46.773594 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:46.773300 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-f4qsk"] Jun 03 01:10:46.776564 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:10:46.776534 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21ce213_8e70_41ce_86bc_6c42bb1b4aeb.slice/crio-882895c102f22fe379358fedf5d9103a87e584446f871100870bf81750250fba WatchSource:0}: Error finding container 882895c102f22fe379358fedf5d9103a87e584446f871100870bf81750250fba: Status 404 returned error can't find the container with id 882895c102f22fe379358fedf5d9103a87e584446f871100870bf81750250fba Jun 03 01:10:47.349758 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:47.349703 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-f4qsk" event={"ID":"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb","Type":"ContainerStarted","Data":"882895c102f22fe379358fedf5d9103a87e584446f871100870bf81750250fba"} Jun 03 01:10:49.356624 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:49.356524 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-f4qsk" event={"ID":"b21ce213-8e70-41ce-86bc-6c42bb1b4aeb","Type":"ContainerStarted","Data":"816bd028e974242fe8d5d4118eceb461f06add687c65b288a248a1f6707367d3"} Jun 03 01:10:49.357059 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:49.356638 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:10:49.357721 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:49.357701 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" event={"ID":"5fd05112-3fc2-402a-b4b5-7ca1c9242f0e","Type":"ContainerStarted","Data":"8de02bcb4fab5d0038a35bd89aee8481938ff4627a906c8cfe7fa962bc777320"} Jun 03 01:10:49.372720 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:49.372673 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-f4qsk" podStartSLOduration=2.079065265 podStartE2EDuration="4.372662376s" podCreationTimestamp="2026-06-03 01:10:45 +0000 UTC" firstStartedPulling="2026-06-03 01:10:46.779030534 +0000 UTC m=+373.099242168" lastFinishedPulling="2026-06-03 01:10:49.072627642 +0000 UTC m=+375.392839279" observedRunningTime="2026-06-03 01:10:49.370804407 +0000 UTC m=+375.691016060" watchObservedRunningTime="2026-06-03 01:10:49.372662376 +0000 UTC m=+375.692874029" Jun 03 01:10:49.386297 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:49.386254 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-db4bc68bb-h6bf5" podStartSLOduration=2.385571717 podStartE2EDuration="5.386243518s" podCreationTimestamp="2026-06-03 01:10:44 +0000 UTC" firstStartedPulling="2026-06-03 01:10:45.570019365 +0000 UTC m=+371.890230996" lastFinishedPulling="2026-06-03 01:10:48.570691158 +0000 UTC m=+374.890902797" observedRunningTime="2026-06-03 01:10:49.38482098 +0000 UTC m=+375.705032632" watchObservedRunningTime="2026-06-03 01:10:49.386243518 +0000 UTC m=+375.706455171" Jun 03 01:10:54.832994 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.832961 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk"] Jun 03 01:10:54.835972 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.835957 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:54.839649 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.839623 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 01:10:54.839757 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.839649 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cx6bf\"" Jun 03 01:10:54.842835 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.842810 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64"] Jun 03 01:10:54.846039 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.846020 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:54.846649 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.846630 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk"] Jun 03 01:10:54.848380 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.848362 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 01:10:54.848497 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.848398 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n8z6g\"" Jun 03 01:10:54.858609 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.858584 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64"] Jun 03 01:10:54.923835 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.923801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9d47\" (UniqueName: \"kubernetes.io/projected/3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae-kube-api-access-b9d47\") pod \"llmisvc-controller-manager-c6b9847d7-zjp64\" (UID: \"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:54.923986 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.923845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpwpq\" (UniqueName: \"kubernetes.io/projected/f2694d71-fb23-47cc-b8ce-39e98abe0ee2-kube-api-access-tpwpq\") pod \"kserve-controller-manager-7c99ffcdcd-tnlgk\" (UID: \"f2694d71-fb23-47cc-b8ce-39e98abe0ee2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:54.923986 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.923864 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zjp64\" (UID: \"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:54.923986 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:54.923911 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2694d71-fb23-47cc-b8ce-39e98abe0ee2-cert\") pod \"kserve-controller-manager-7c99ffcdcd-tnlgk\" (UID: \"f2694d71-fb23-47cc-b8ce-39e98abe0ee2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:55.024673 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.024630 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b9d47\" (UniqueName: \"kubernetes.io/projected/3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae-kube-api-access-b9d47\") pod \"llmisvc-controller-manager-c6b9847d7-zjp64\" (UID: \"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:55.024878 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.024686 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpwpq\" (UniqueName: \"kubernetes.io/projected/f2694d71-fb23-47cc-b8ce-39e98abe0ee2-kube-api-access-tpwpq\") pod \"kserve-controller-manager-7c99ffcdcd-tnlgk\" (UID: \"f2694d71-fb23-47cc-b8ce-39e98abe0ee2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:55.024878 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.024703 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zjp64\" (UID: \"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:55.024878 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.024721 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2694d71-fb23-47cc-b8ce-39e98abe0ee2-cert\") pod \"kserve-controller-manager-7c99ffcdcd-tnlgk\" (UID: \"f2694d71-fb23-47cc-b8ce-39e98abe0ee2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:55.027178 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.027151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae-cert\") pod \"llmisvc-controller-manager-c6b9847d7-zjp64\" (UID: \"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:55.027276 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.027160 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2694d71-fb23-47cc-b8ce-39e98abe0ee2-cert\") pod \"kserve-controller-manager-7c99ffcdcd-tnlgk\" (UID: \"f2694d71-fb23-47cc-b8ce-39e98abe0ee2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:55.038345 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.038323 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9d47\" (UniqueName: \"kubernetes.io/projected/3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae-kube-api-access-b9d47\") pod \"llmisvc-controller-manager-c6b9847d7-zjp64\" (UID: \"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:55.038456 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.038399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpwpq\" (UniqueName: \"kubernetes.io/projected/f2694d71-fb23-47cc-b8ce-39e98abe0ee2-kube-api-access-tpwpq\") pod \"kserve-controller-manager-7c99ffcdcd-tnlgk\" (UID: \"f2694d71-fb23-47cc-b8ce-39e98abe0ee2\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:55.147520 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.147411 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:55.158206 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.158179 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:55.281023 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.280998 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk"] Jun 03 01:10:55.283456 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:10:55.283430 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2694d71_fb23_47cc_b8ce_39e98abe0ee2.slice/crio-72d110f08577ea81c88b412316b3baf75798a55c2f03623feb238628ac9bbfaf WatchSource:0}: Error finding container 72d110f08577ea81c88b412316b3baf75798a55c2f03623feb238628ac9bbfaf: Status 404 returned error can't find the container with id 72d110f08577ea81c88b412316b3baf75798a55c2f03623feb238628ac9bbfaf Jun 03 01:10:55.303122 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.303104 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64"] Jun 03 01:10:55.305177 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:10:55.305148 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f6dbfa4_b684_4597_8fc4_4ec6f4c5c4ae.slice/crio-5ab56495748609c8627524e0450e3f1dc9f2bf73e92d00bd3902bcb131280e13 WatchSource:0}: Error finding container 5ab56495748609c8627524e0450e3f1dc9f2bf73e92d00bd3902bcb131280e13: Status 404 returned error can't find the container with id 5ab56495748609c8627524e0450e3f1dc9f2bf73e92d00bd3902bcb131280e13 Jun 03 01:10:55.376748 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.376715 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" event={"ID":"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae","Type":"ContainerStarted","Data":"5ab56495748609c8627524e0450e3f1dc9f2bf73e92d00bd3902bcb131280e13"} Jun 03 01:10:55.377608 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:55.377578 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" event={"ID":"f2694d71-fb23-47cc-b8ce-39e98abe0ee2","Type":"ContainerStarted","Data":"72d110f08577ea81c88b412316b3baf75798a55c2f03623feb238628ac9bbfaf"} Jun 03 01:10:59.391945 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:59.391903 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" event={"ID":"f2694d71-fb23-47cc-b8ce-39e98abe0ee2","Type":"ContainerStarted","Data":"d384aa8aceaeb5a587ff3e8e5d60027df34caf33179e27b46f9b6d70b3fdc2fd"} Jun 03 01:10:59.392411 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:59.391981 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:10:59.393235 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:59.393213 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" event={"ID":"3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae","Type":"ContainerStarted","Data":"181b8282fec712ca74de91c946a15222c10e576a3ab1cecce81566d7e9d3da3f"} Jun 03 01:10:59.393359 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:59.393343 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:10:59.408395 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:59.408345 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" podStartSLOduration=1.7635935520000001 podStartE2EDuration="5.408324927s" podCreationTimestamp="2026-06-03 01:10:54 +0000 UTC" firstStartedPulling="2026-06-03 01:10:55.284849011 +0000 UTC m=+381.605060646" lastFinishedPulling="2026-06-03 01:10:58.929580375 +0000 UTC m=+385.249792021" observedRunningTime="2026-06-03 01:10:59.407412563 +0000 UTC m=+385.727624219" watchObservedRunningTime="2026-06-03 01:10:59.408324927 +0000 UTC m=+385.728536580" Jun 03 01:10:59.424135 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:10:59.424096 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" podStartSLOduration=1.802360771 podStartE2EDuration="5.424086764s" podCreationTimestamp="2026-06-03 01:10:54 +0000 UTC" firstStartedPulling="2026-06-03 01:10:55.306422472 +0000 UTC m=+381.626634104" lastFinishedPulling="2026-06-03 01:10:58.928148463 +0000 UTC m=+385.248360097" observedRunningTime="2026-06-03 01:10:59.422802033 +0000 UTC m=+385.743013683" watchObservedRunningTime="2026-06-03 01:10:59.424086764 +0000 UTC m=+385.744298416" Jun 03 01:11:00.364326 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:00.364299 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-f4qsk" Jun 03 01:11:02.510872 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.510835 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b"] Jun 03 01:11:02.584582 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.584503 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b"] Jun 03 01:11:02.584742 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.584642 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:02.589258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.589228 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 01:11:02.589258 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.589258 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 01:11:02.589452 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.589239 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-4bcsh\"" Jun 03 01:11:02.689929 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.689897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3f5e05ef-ea93-48aa-ac59-856c36efa4e1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pzx4b\" (UID: \"3f5e05ef-ea93-48aa-ac59-856c36efa4e1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:02.690119 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.689946 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsn29\" (UniqueName: \"kubernetes.io/projected/3f5e05ef-ea93-48aa-ac59-856c36efa4e1-kube-api-access-bsn29\") pod \"servicemesh-operator3-55f49c5f94-pzx4b\" (UID: \"3f5e05ef-ea93-48aa-ac59-856c36efa4e1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:02.791046 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.791012 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3f5e05ef-ea93-48aa-ac59-856c36efa4e1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pzx4b\" (UID: \"3f5e05ef-ea93-48aa-ac59-856c36efa4e1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:02.791245 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.791062 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn29\" (UniqueName: \"kubernetes.io/projected/3f5e05ef-ea93-48aa-ac59-856c36efa4e1-kube-api-access-bsn29\") pod \"servicemesh-operator3-55f49c5f94-pzx4b\" (UID: \"3f5e05ef-ea93-48aa-ac59-856c36efa4e1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:02.793559 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.793540 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3f5e05ef-ea93-48aa-ac59-856c36efa4e1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-pzx4b\" (UID: \"3f5e05ef-ea93-48aa-ac59-856c36efa4e1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:02.806110 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.806077 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsn29\" (UniqueName: \"kubernetes.io/projected/3f5e05ef-ea93-48aa-ac59-856c36efa4e1-kube-api-access-bsn29\") pod \"servicemesh-operator3-55f49c5f94-pzx4b\" (UID: \"3f5e05ef-ea93-48aa-ac59-856c36efa4e1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:02.894042 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:02.894007 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:03.024625 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:03.024526 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b"] Jun 03 01:11:03.026970 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:11:03.026941 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5e05ef_ea93_48aa_ac59_856c36efa4e1.slice/crio-c4d4d3adaee0c599f99d44fdb4c6e6719b2bc0330128d6291e4cd2e5c8fc6876 WatchSource:0}: Error finding container c4d4d3adaee0c599f99d44fdb4c6e6719b2bc0330128d6291e4cd2e5c8fc6876: Status 404 returned error can't find the container with id c4d4d3adaee0c599f99d44fdb4c6e6719b2bc0330128d6291e4cd2e5c8fc6876 Jun 03 01:11:03.406940 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:03.406902 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" event={"ID":"3f5e05ef-ea93-48aa-ac59-856c36efa4e1","Type":"ContainerStarted","Data":"c4d4d3adaee0c599f99d44fdb4c6e6719b2bc0330128d6291e4cd2e5c8fc6876"} Jun 03 01:11:06.417294 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:06.417264 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" event={"ID":"3f5e05ef-ea93-48aa-ac59-856c36efa4e1","Type":"ContainerStarted","Data":"103eadca23d6805decec5b9cd496d75b9391e6b7c7170f5a98196c3e75df1149"} Jun 03 01:11:06.417695 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:06.417368 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:06.440489 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:06.440215 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" podStartSLOduration=1.9778457550000001 podStartE2EDuration="4.440198524s" podCreationTimestamp="2026-06-03 01:11:02 +0000 UTC" firstStartedPulling="2026-06-03 01:11:03.029600533 +0000 UTC m=+389.349812164" lastFinishedPulling="2026-06-03 01:11:05.491953302 +0000 UTC m=+391.812164933" observedRunningTime="2026-06-03 01:11:06.436317276 +0000 UTC m=+392.756528928" watchObservedRunningTime="2026-06-03 01:11:06.440198524 +0000 UTC m=+392.760410177" Jun 03 01:11:13.298198 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.298163 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8"] Jun 03 01:11:13.300362 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.300331 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.303247 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.303080 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 01:11:13.303247 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.303121 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 01:11:13.303247 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.303080 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 01:11:13.303247 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.303082 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jlb4w\"" Jun 03 01:11:13.303247 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.303085 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 01:11:13.314839 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.314812 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8"] Jun 03 01:11:13.478337 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.478300 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx95v\" (UniqueName: \"kubernetes.io/projected/17645d81-f1d7-4b61-a419-29565809190d-kube-api-access-mx95v\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.478337 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.478339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17645d81-f1d7-4b61-a419-29565809190d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.478619 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.478415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17645d81-f1d7-4b61-a419-29565809190d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.478619 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.478458 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17645d81-f1d7-4b61-a419-29565809190d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.478619 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.478491 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.478619 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.478511 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.478619 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.478534 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.579367 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.579268 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mx95v\" (UniqueName: \"kubernetes.io/projected/17645d81-f1d7-4b61-a419-29565809190d-kube-api-access-mx95v\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.579367 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.579323 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17645d81-f1d7-4b61-a419-29565809190d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.579736 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.579370 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17645d81-f1d7-4b61-a419-29565809190d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.579736 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.579400 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17645d81-f1d7-4b61-a419-29565809190d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.579736 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.579429 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.579736 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.579457 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.579736 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.579510 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.580206 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.580149 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/17645d81-f1d7-4b61-a419-29565809190d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.581882 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.581858 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.581975 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.581866 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.582016 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.581983 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/17645d81-f1d7-4b61-a419-29565809190d-local-certs\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.582159 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.582141 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/17645d81-f1d7-4b61-a419-29565809190d-cacerts\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.596069 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.591992 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx95v\" (UniqueName: \"kubernetes.io/projected/17645d81-f1d7-4b61-a419-29565809190d-kube-api-access-mx95v\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.596069 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.592103 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17645d81-f1d7-4b61-a419-29565809190d-istio-token\") pod \"istiod-openshift-gateway-798958bb55-b42q8\" (UID: \"17645d81-f1d7-4b61-a419-29565809190d\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.609440 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.609419 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:13.770221 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:13.768805 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8"] Jun 03 01:11:13.772033 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:11:13.772000 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17645d81_f1d7_4b61_a419_29565809190d.slice/crio-e958b5afaa797344da9e68763f15eab4d8d3f9e07cc3dc45ea731b5b0cf1e510 WatchSource:0}: Error finding container e958b5afaa797344da9e68763f15eab4d8d3f9e07cc3dc45ea731b5b0cf1e510: Status 404 returned error can't find the container with id e958b5afaa797344da9e68763f15eab4d8d3f9e07cc3dc45ea731b5b0cf1e510 Jun 03 01:11:14.442169 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:14.442133 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" event={"ID":"17645d81-f1d7-4b61-a419-29565809190d","Type":"ContainerStarted","Data":"e958b5afaa797344da9e68763f15eab4d8d3f9e07cc3dc45ea731b5b0cf1e510"} Jun 03 01:11:17.260414 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:17.260370 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 01:11:17.260679 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:17.260445 2556 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 01:11:17.422422 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:17.422393 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-pzx4b" Jun 03 01:11:17.454055 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:17.454017 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" event={"ID":"17645d81-f1d7-4b61-a419-29565809190d","Type":"ContainerStarted","Data":"b5e604944934bd3e9320d850bac0d79546e469f403cb7a7f6be13a9d41169138"} Jun 03 01:11:17.454237 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:17.454130 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:17.476497 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:17.476439 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" podStartSLOduration=0.990956719 podStartE2EDuration="4.47642655s" podCreationTimestamp="2026-06-03 01:11:13 +0000 UTC" firstStartedPulling="2026-06-03 01:11:13.774684962 +0000 UTC m=+400.094896597" lastFinishedPulling="2026-06-03 01:11:17.260154797 +0000 UTC m=+403.580366428" observedRunningTime="2026-06-03 01:11:17.475329733 +0000 UTC m=+403.795541398" watchObservedRunningTime="2026-06-03 01:11:17.47642655 +0000 UTC m=+403.796638204" Jun 03 01:11:18.462146 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:18.462105 2556 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-b42q8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 01:11:18.462528 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:18.462177 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" podUID="17645d81-f1d7-4b61-a419-29565809190d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 01:11:21.458559 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:21.458529 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-b42q8" Jun 03 01:11:25.565652 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.565613 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-86cc4fb5f5-hdk92"] Jun 03 01:11:25.571448 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.571430 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:25.574337 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.574318 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4ptqm\"" Jun 03 01:11:25.574422 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.574340 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 01:11:25.578091 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.577926 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86cc4fb5f5-hdk92"] Jun 03 01:11:25.674798 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.674772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh4kl\" (UniqueName: \"kubernetes.io/projected/0e4d0386-f532-43c2-86d4-d56ae717d29e-kube-api-access-hh4kl\") pod \"dashboard-redirect-86cc4fb5f5-hdk92\" (UID: \"0e4d0386-f532-43c2-86d4-d56ae717d29e\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:25.674945 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.674817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e4d0386-f532-43c2-86d4-d56ae717d29e-redirect-config\") pod \"dashboard-redirect-86cc4fb5f5-hdk92\" (UID: \"0e4d0386-f532-43c2-86d4-d56ae717d29e\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:25.776039 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.776009 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e4d0386-f532-43c2-86d4-d56ae717d29e-redirect-config\") pod \"dashboard-redirect-86cc4fb5f5-hdk92\" (UID: \"0e4d0386-f532-43c2-86d4-d56ae717d29e\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:25.776201 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.776071 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh4kl\" (UniqueName: \"kubernetes.io/projected/0e4d0386-f532-43c2-86d4-d56ae717d29e-kube-api-access-hh4kl\") pod \"dashboard-redirect-86cc4fb5f5-hdk92\" (UID: \"0e4d0386-f532-43c2-86d4-d56ae717d29e\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:25.776738 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.776721 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0e4d0386-f532-43c2-86d4-d56ae717d29e-redirect-config\") pod \"dashboard-redirect-86cc4fb5f5-hdk92\" (UID: \"0e4d0386-f532-43c2-86d4-d56ae717d29e\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:25.784463 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.784432 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh4kl\" (UniqueName: \"kubernetes.io/projected/0e4d0386-f532-43c2-86d4-d56ae717d29e-kube-api-access-hh4kl\") pod \"dashboard-redirect-86cc4fb5f5-hdk92\" (UID: \"0e4d0386-f532-43c2-86d4-d56ae717d29e\") " pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:25.882605 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:25.882531 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" Jun 03 01:11:26.003325 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:26.003295 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86cc4fb5f5-hdk92"] Jun 03 01:11:26.005581 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:11:26.005549 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4d0386_f532_43c2_86d4_d56ae717d29e.slice/crio-6980a6628d6ded3d896de5f07c409fb02138bf98cf2bcea30fcec1545b30c576 WatchSource:0}: Error finding container 6980a6628d6ded3d896de5f07c409fb02138bf98cf2bcea30fcec1545b30c576: Status 404 returned error can't find the container with id 6980a6628d6ded3d896de5f07c409fb02138bf98cf2bcea30fcec1545b30c576 Jun 03 01:11:26.481411 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:26.481380 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" event={"ID":"0e4d0386-f532-43c2-86d4-d56ae717d29e","Type":"ContainerStarted","Data":"6980a6628d6ded3d896de5f07c409fb02138bf98cf2bcea30fcec1545b30c576"} Jun 03 01:11:28.489479 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:28.489445 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" event={"ID":"0e4d0386-f532-43c2-86d4-d56ae717d29e","Type":"ContainerStarted","Data":"0e51c6289a8ee7028b6feb5a22266637cd697d1870648544910ac309c2de2ef8"} Jun 03 01:11:28.506938 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:28.506896 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-86cc4fb5f5-hdk92" podStartSLOduration=1.128094523 podStartE2EDuration="3.506882363s" podCreationTimestamp="2026-06-03 01:11:25 +0000 UTC" firstStartedPulling="2026-06-03 01:11:26.006949086 +0000 UTC m=+412.327160720" lastFinishedPulling="2026-06-03 01:11:28.385736915 +0000 UTC m=+414.705948560" observedRunningTime="2026-06-03 01:11:28.504687567 +0000 UTC m=+414.824899219" watchObservedRunningTime="2026-06-03 01:11:28.506882363 +0000 UTC m=+414.827094016" Jun 03 01:11:30.398510 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:30.398460 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-zjp64" Jun 03 01:11:30.401956 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:11:30.401934 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-tnlgk" Jun 03 01:12:23.691840 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.691806 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj"] Jun 03 01:12:23.694859 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.694845 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:23.701586 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.701566 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fntxl\"" Jun 03 01:12:23.701710 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.701646 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 01:12:23.701779 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.701567 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 01:12:23.707093 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.707071 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj"] Jun 03 01:12:23.810174 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.810140 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwqlv\" (UniqueName: \"kubernetes.io/projected/0a50b6b2-9f23-4747-84e7-50822e7dd1ff-kube-api-access-pwqlv\") pod \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" (UID: \"0a50b6b2-9f23-4747-84e7-50822e7dd1ff\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:23.910915 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.910881 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwqlv\" (UniqueName: \"kubernetes.io/projected/0a50b6b2-9f23-4747-84e7-50822e7dd1ff-kube-api-access-pwqlv\") pod \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" (UID: \"0a50b6b2-9f23-4747-84e7-50822e7dd1ff\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:23.923176 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:23.923148 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwqlv\" (UniqueName: \"kubernetes.io/projected/0a50b6b2-9f23-4747-84e7-50822e7dd1ff-kube-api-access-pwqlv\") pod \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" (UID: \"0a50b6b2-9f23-4747-84e7-50822e7dd1ff\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:24.004227 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:24.004139 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:24.131305 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:24.131279 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj"] Jun 03 01:12:24.133950 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:12:24.133925 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a50b6b2_9f23_4747_84e7_50822e7dd1ff.slice/crio-d6430375be940880d8419c4859cdfc716f62a68d9ba335de085ae3fd759aee69 WatchSource:0}: Error finding container d6430375be940880d8419c4859cdfc716f62a68d9ba335de085ae3fd759aee69: Status 404 returned error can't find the container with id d6430375be940880d8419c4859cdfc716f62a68d9ba335de085ae3fd759aee69 Jun 03 01:12:24.659518 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:24.659483 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" event={"ID":"0a50b6b2-9f23-4747-84e7-50822e7dd1ff","Type":"ContainerStarted","Data":"d6430375be940880d8419c4859cdfc716f62a68d9ba335de085ae3fd759aee69"} Jun 03 01:12:26.666162 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:26.666122 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" event={"ID":"0a50b6b2-9f23-4747-84e7-50822e7dd1ff","Type":"ContainerStarted","Data":"30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55"} Jun 03 01:12:26.666690 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:26.666287 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:26.683746 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:26.683705 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" podStartSLOduration=1.659802561 podStartE2EDuration="3.683677745s" podCreationTimestamp="2026-06-03 01:12:23 +0000 UTC" firstStartedPulling="2026-06-03 01:12:24.136138456 +0000 UTC m=+470.456350087" lastFinishedPulling="2026-06-03 01:12:26.160013637 +0000 UTC m=+472.480225271" observedRunningTime="2026-06-03 01:12:26.681643594 +0000 UTC m=+473.001855247" watchObservedRunningTime="2026-06-03 01:12:26.683677745 +0000 UTC m=+473.003889397" Jun 03 01:12:37.672634 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:37.672603 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:38.286772 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.286741 2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj"] Jun 03 01:12:38.286975 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.286952 2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" containerName="manager" containerID="cri-o://30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55" gracePeriod=2 Jun 03 01:12:38.299484 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.299444 2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj"] Jun 03 01:12:38.315939 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.315910 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz"] Jun 03 01:12:38.316202 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.316190 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" containerName="manager" Jun 03 01:12:38.316246 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.316203 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" containerName="manager" Jun 03 01:12:38.316279 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.316249 2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" containerName="manager" Jun 03 01:12:38.319019 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.318999 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" Jun 03 01:12:38.337779 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.337739 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz"] Jun 03 01:12:38.354941 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.354905 2556 status_manager.go:895] "Failed to get status for pod" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" err="pods \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" is forbidden: User \"system:node:ip-10-0-132-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-82.ec2.internal' and this object" Jun 03 01:12:38.426508 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.426457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg5w5\" (UniqueName: \"kubernetes.io/projected/c1a877ab-03d0-4c5f-a14e-f67255eb6725-kube-api-access-rg5w5\") pod \"limitador-operator-controller-manager-85c4996f8c-l5wzz\" (UID: \"c1a877ab-03d0-4c5f-a14e-f67255eb6725\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" Jun 03 01:12:38.519530 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.519503 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:38.521701 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.521675 2556 status_manager.go:895] "Failed to get status for pod" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" err="pods \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" is forbidden: User \"system:node:ip-10-0-132-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-82.ec2.internal' and this object" Jun 03 01:12:38.526997 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.526978 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rg5w5\" (UniqueName: \"kubernetes.io/projected/c1a877ab-03d0-4c5f-a14e-f67255eb6725-kube-api-access-rg5w5\") pod \"limitador-operator-controller-manager-85c4996f8c-l5wzz\" (UID: \"c1a877ab-03d0-4c5f-a14e-f67255eb6725\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" Jun 03 01:12:38.538486 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.538422 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg5w5\" (UniqueName: \"kubernetes.io/projected/c1a877ab-03d0-4c5f-a14e-f67255eb6725-kube-api-access-rg5w5\") pod \"limitador-operator-controller-manager-85c4996f8c-l5wzz\" (UID: \"c1a877ab-03d0-4c5f-a14e-f67255eb6725\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" Jun 03 01:12:38.627617 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.627588 2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwqlv\" (UniqueName: \"kubernetes.io/projected/0a50b6b2-9f23-4747-84e7-50822e7dd1ff-kube-api-access-pwqlv\") pod \"0a50b6b2-9f23-4747-84e7-50822e7dd1ff\" (UID: \"0a50b6b2-9f23-4747-84e7-50822e7dd1ff\") " Jun 03 01:12:38.629634 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.629609 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a50b6b2-9f23-4747-84e7-50822e7dd1ff-kube-api-access-pwqlv" (OuterVolumeSpecName: "kube-api-access-pwqlv") pod "0a50b6b2-9f23-4747-84e7-50822e7dd1ff" (UID: "0a50b6b2-9f23-4747-84e7-50822e7dd1ff"). InnerVolumeSpecName "kube-api-access-pwqlv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 01:12:38.670046 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.670020 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" Jun 03 01:12:38.707733 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.707704 2556 generic.go:358] "Generic (PLEG): container finished" podID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" containerID="30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55" exitCode=0 Jun 03 01:12:38.708134 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.707761 2556 scope.go:117] "RemoveContainer" containerID="30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55" Jun 03 01:12:38.708134 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.707772 2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" Jun 03 01:12:38.710518 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.710465 2556 status_manager.go:895] "Failed to get status for pod" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" err="pods \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" is forbidden: User \"system:node:ip-10-0-132-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-82.ec2.internal' and this object" Jun 03 01:12:38.715084 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.715067 2556 scope.go:117] "RemoveContainer" containerID="30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55" Jun 03 01:12:38.715313 ip-10-0-132-82 kubenswrapper[2556]: E0603 01:12:38.715295 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55\": container with ID starting with 30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55 not found: ID does not exist" containerID="30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55" Jun 03 01:12:38.715359 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.715321 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55"} err="failed to get container status \"30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55\": rpc error: code = NotFound desc = could not find container \"30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55\": container with ID starting with 30bd4fdfdde4e4b50ec40a76b4e645f0c3a9a696ee84ec25ea6e191a86e3ea55 not found: ID does not exist" Jun 03 01:12:38.722089 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.722058 2556 status_manager.go:895] "Failed to get status for pod" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" err="pods \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" is forbidden: User \"system:node:ip-10-0-132-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-82.ec2.internal' and this object" Jun 03 01:12:38.728599 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.728571 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwqlv\" (UniqueName: \"kubernetes.io/projected/0a50b6b2-9f23-4747-84e7-50822e7dd1ff-kube-api-access-pwqlv\") on node \"ip-10-0-132-82.ec2.internal\" DevicePath \"\"" Jun 03 01:12:38.799721 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:38.799697 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz"] Jun 03 01:12:38.802064 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:12:38.802030 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a877ab_03d0_4c5f_a14e_f67255eb6725.slice/crio-aca442fc0ab0e6cc420f1381f9fb07860dcb3bf84ca82b7b39bdfada5d22f451 WatchSource:0}: Error finding container aca442fc0ab0e6cc420f1381f9fb07860dcb3bf84ca82b7b39bdfada5d22f451: Status 404 returned error can't find the container with id aca442fc0ab0e6cc420f1381f9fb07860dcb3bf84ca82b7b39bdfada5d22f451 Jun 03 01:12:39.711754 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:39.711719 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" event={"ID":"c1a877ab-03d0-4c5f-a14e-f67255eb6725","Type":"ContainerStarted","Data":"f9f48a7e2d4686ed1b619c1b7b566d47d465fd5ae4e84ddc1b7b99df454d291b"} Jun 03 01:12:39.711754 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:39.711764 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" event={"ID":"c1a877ab-03d0-4c5f-a14e-f67255eb6725","Type":"ContainerStarted","Data":"aca442fc0ab0e6cc420f1381f9fb07860dcb3bf84ca82b7b39bdfada5d22f451"} Jun 03 01:12:39.712218 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:39.711816 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" Jun 03 01:12:39.729624 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:39.729580 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" podStartSLOduration=1.729567289 podStartE2EDuration="1.729567289s" podCreationTimestamp="2026-06-03 01:12:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:12:39.728317692 +0000 UTC m=+486.048529346" watchObservedRunningTime="2026-06-03 01:12:39.729567289 +0000 UTC m=+486.049778966" Jun 03 01:12:39.730261 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:39.730230 2556 status_manager.go:895] "Failed to get status for pod" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-lkrkj" err="pods \"limitador-operator-controller-manager-85c4996f8c-lkrkj\" is forbidden: User \"system:node:ip-10-0-132-82.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-82.ec2.internal' and this object" Jun 03 01:12:40.284671 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:40.284636 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a50b6b2-9f23-4747-84e7-50822e7dd1ff" path="/var/lib/kubelet/pods/0a50b6b2-9f23-4747-84e7-50822e7dd1ff/volumes" Jun 03 01:12:50.718399 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:12:50.718363 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-l5wzz" Jun 03 01:13:11.363497 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.363438 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:13:11.368950 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.368930 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.371681 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.371654 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xl8l2\"" Jun 03 01:13:11.371970 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.371952 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 01:13:11.376870 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.376849 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:13:11.400161 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.400124 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:13:11.459099 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.459071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f45b88a1-33d0-42f8-84bf-73a469626d2b-config-file\") pod \"limitador-limitador-78c99df468-w8j59\" (UID: \"f45b88a1-33d0-42f8-84bf-73a469626d2b\") " pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.459206 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.459123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4hnj\" (UniqueName: \"kubernetes.io/projected/f45b88a1-33d0-42f8-84bf-73a469626d2b-kube-api-access-x4hnj\") pod \"limitador-limitador-78c99df468-w8j59\" (UID: \"f45b88a1-33d0-42f8-84bf-73a469626d2b\") " pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.559713 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.559680 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f45b88a1-33d0-42f8-84bf-73a469626d2b-config-file\") pod \"limitador-limitador-78c99df468-w8j59\" (UID: \"f45b88a1-33d0-42f8-84bf-73a469626d2b\") " pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.559836 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.559730 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4hnj\" (UniqueName: \"kubernetes.io/projected/f45b88a1-33d0-42f8-84bf-73a469626d2b-kube-api-access-x4hnj\") pod \"limitador-limitador-78c99df468-w8j59\" (UID: \"f45b88a1-33d0-42f8-84bf-73a469626d2b\") " pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.560252 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.560233 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f45b88a1-33d0-42f8-84bf-73a469626d2b-config-file\") pod \"limitador-limitador-78c99df468-w8j59\" (UID: \"f45b88a1-33d0-42f8-84bf-73a469626d2b\") " pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.569789 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.569764 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4hnj\" (UniqueName: \"kubernetes.io/projected/f45b88a1-33d0-42f8-84bf-73a469626d2b-kube-api-access-x4hnj\") pod \"limitador-limitador-78c99df468-w8j59\" (UID: \"f45b88a1-33d0-42f8-84bf-73a469626d2b\") " pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.679760 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.679674 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:11.827680 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:11.827656 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:13:11.830342 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:13:11.830314 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45b88a1_33d0_42f8_84bf_73a469626d2b.slice/crio-31b4f863ce7e3db481087d8db95b4de331589c5fe3b2c210c5e67d3d93e57330 WatchSource:0}: Error finding container 31b4f863ce7e3db481087d8db95b4de331589c5fe3b2c210c5e67d3d93e57330: Status 404 returned error can't find the container with id 31b4f863ce7e3db481087d8db95b4de331589c5fe3b2c210c5e67d3d93e57330 Jun 03 01:13:12.815770 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:12.815734 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" event={"ID":"f45b88a1-33d0-42f8-84bf-73a469626d2b","Type":"ContainerStarted","Data":"31b4f863ce7e3db481087d8db95b4de331589c5fe3b2c210c5e67d3d93e57330"} Jun 03 01:13:14.824549 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:14.824513 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" event={"ID":"f45b88a1-33d0-42f8-84bf-73a469626d2b","Type":"ContainerStarted","Data":"8156f1e099e53af786d6111958cddcd66ce2014eff0c5c63ce2715a8ce0a3aef"} Jun 03 01:13:14.824928 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:14.824747 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:13:14.843291 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:14.843248 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" podStartSLOduration=1.447440557 podStartE2EDuration="3.843237239s" podCreationTimestamp="2026-06-03 01:13:11 +0000 UTC" firstStartedPulling="2026-06-03 01:13:11.83193477 +0000 UTC m=+518.152146400" lastFinishedPulling="2026-06-03 01:13:14.227731451 +0000 UTC m=+520.547943082" observedRunningTime="2026-06-03 01:13:14.842226279 +0000 UTC m=+521.162437933" watchObservedRunningTime="2026-06-03 01:13:14.843237239 +0000 UTC m=+521.163448950" Jun 03 01:13:25.828830 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:13:25.828758 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-w8j59" Jun 03 01:15:14.144302 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.144268 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-x5vf7"] Jun 03 01:15:14.147458 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.147443 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" Jun 03 01:15:14.149968 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.149944 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 01:15:14.158817 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.158798 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-x5vf7"] Jun 03 01:15:14.216657 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.216624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmk6\" (UniqueName: \"kubernetes.io/projected/f670e1cc-2aac-47d6-9ddc-034cbcd057f5-kube-api-access-dkmk6\") pod \"payload-processing-58b6c8fdc7-x5vf7\" (UID: \"f670e1cc-2aac-47d6-9ddc-034cbcd057f5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" Jun 03 01:15:14.249986 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.249949 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:15:14.317885 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.317852 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmk6\" (UniqueName: \"kubernetes.io/projected/f670e1cc-2aac-47d6-9ddc-034cbcd057f5-kube-api-access-dkmk6\") pod \"payload-processing-58b6c8fdc7-x5vf7\" (UID: \"f670e1cc-2aac-47d6-9ddc-034cbcd057f5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" Jun 03 01:15:14.331324 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.331299 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmk6\" (UniqueName: \"kubernetes.io/projected/f670e1cc-2aac-47d6-9ddc-034cbcd057f5-kube-api-access-dkmk6\") pod \"payload-processing-58b6c8fdc7-x5vf7\" (UID: \"f670e1cc-2aac-47d6-9ddc-034cbcd057f5\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" Jun 03 01:15:14.457645 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.457564 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" Jun 03 01:15:14.581299 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.581106 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-x5vf7"] Jun 03 01:15:14.583980 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:15:14.583952 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf670e1cc_2aac_47d6_9ddc_034cbcd057f5.slice/crio-9bd532daa1803018ad7dda13f7987d772d3a7330a4c7f48251925dd29a58c719 WatchSource:0}: Error finding container 9bd532daa1803018ad7dda13f7987d772d3a7330a4c7f48251925dd29a58c719: Status 404 returned error can't find the container with id 9bd532daa1803018ad7dda13f7987d772d3a7330a4c7f48251925dd29a58c719 Jun 03 01:15:14.585706 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:14.585564 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:15:15.208836 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:15.208795 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" event={"ID":"f670e1cc-2aac-47d6-9ddc-034cbcd057f5","Type":"ContainerStarted","Data":"9bd532daa1803018ad7dda13f7987d772d3a7330a4c7f48251925dd29a58c719"} Jun 03 01:15:17.217946 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:17.217907 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" event={"ID":"f670e1cc-2aac-47d6-9ddc-034cbcd057f5","Type":"ContainerStarted","Data":"53089b63744be69c11fe3d374ec9feb1c55138e3af8034563cea8116073fd4c4"} Jun 03 01:15:17.218411 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:17.218025 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" Jun 03 01:15:17.233799 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:17.233739 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" podStartSLOduration=1.083671967 podStartE2EDuration="3.23372429s" podCreationTimestamp="2026-06-03 01:15:14 +0000 UTC" firstStartedPulling="2026-06-03 01:15:14.585705714 +0000 UTC m=+640.905917345" lastFinishedPulling="2026-06-03 01:15:16.735758038 +0000 UTC m=+643.055969668" observedRunningTime="2026-06-03 01:15:17.233214695 +0000 UTC m=+643.553426349" watchObservedRunningTime="2026-06-03 01:15:17.23372429 +0000 UTC m=+643.553935943" Jun 03 01:15:28.223031 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:15:28.222997 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-x5vf7" Jun 03 01:16:18.334667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:18.334587 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:16:23.220149 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.220105 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf"] Jun 03 01:16:23.222548 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.222531 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.225064 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.225045 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 01:16:23.226429 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.226405 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wwwg7\"" Jun 03 01:16:23.226588 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.226490 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 01:16:23.226588 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.226417 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 01:16:23.232613 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.232588 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf"] Jun 03 01:16:23.344656 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.344620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.344813 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.344659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.344813 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.344759 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.344913 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.344820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.344913 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.344889 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhf82\" (UniqueName: \"kubernetes.io/projected/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-kube-api-access-mhf82\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.345011 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.344952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445515 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445691 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445552 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445691 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445587 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhf82\" (UniqueName: \"kubernetes.io/projected/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-kube-api-access-mhf82\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445691 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445609 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445691 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445650 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445691 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445678 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445959 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445872 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.445959 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.445946 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.446067 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.446034 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.447716 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.447695 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.447980 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.447961 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.453397 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.453373 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhf82\" (UniqueName: \"kubernetes.io/projected/8df2fe68-e4d1-4247-a601-73d48fd5d1f5-kube-api-access-mhf82\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-92xjf\" (UID: \"8df2fe68-e4d1-4247-a601-73d48fd5d1f5\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.534490 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.534440 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:23.665239 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.665215 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf"] Jun 03 01:16:23.667383 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:16:23.667352 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df2fe68_e4d1_4247_a601_73d48fd5d1f5.slice/crio-ac228fa8ca803c94630cc311412f4300f58ce97ef425a185a09ff3f10f4ad2f1 WatchSource:0}: Error finding container ac228fa8ca803c94630cc311412f4300f58ce97ef425a185a09ff3f10f4ad2f1: Status 404 returned error can't find the container with id ac228fa8ca803c94630cc311412f4300f58ce97ef425a185a09ff3f10f4ad2f1 Jun 03 01:16:23.924388 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:23.924302 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:16:24.447243 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:24.447200 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" event={"ID":"8df2fe68-e4d1-4247-a601-73d48fd5d1f5","Type":"ContainerStarted","Data":"ac228fa8ca803c94630cc311412f4300f58ce97ef425a185a09ff3f10f4ad2f1"} Jun 03 01:16:27.459352 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:27.459317 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" event={"ID":"8df2fe68-e4d1-4247-a601-73d48fd5d1f5","Type":"ContainerStarted","Data":"0484b0c614a4462415d87434efe4398051e20c41a1802f46dae3e0424dedc221"} Jun 03 01:16:28.464097 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:28.464063 2556 generic.go:358] "Generic (PLEG): container finished" podID="8df2fe68-e4d1-4247-a601-73d48fd5d1f5" containerID="0484b0c614a4462415d87434efe4398051e20c41a1802f46dae3e0424dedc221" exitCode=0 Jun 03 01:16:28.464509 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:28.464118 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" event={"ID":"8df2fe68-e4d1-4247-a601-73d48fd5d1f5","Type":"ContainerDied","Data":"0484b0c614a4462415d87434efe4398051e20c41a1802f46dae3e0424dedc221"} Jun 03 01:16:30.471992 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:30.471956 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" event={"ID":"8df2fe68-e4d1-4247-a601-73d48fd5d1f5","Type":"ContainerStarted","Data":"3f4c16457c33d5065d2039b87f6b377d49ed68b88abebd39a69a1b0998d654a4"} Jun 03 01:16:30.490534 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:30.490483 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" podStartSLOduration=1.712830504 podStartE2EDuration="7.490454526s" podCreationTimestamp="2026-06-03 01:16:23 +0000 UTC" firstStartedPulling="2026-06-03 01:16:23.669070868 +0000 UTC m=+709.989282504" lastFinishedPulling="2026-06-03 01:16:29.446694888 +0000 UTC m=+715.766906526" observedRunningTime="2026-06-03 01:16:30.488538387 +0000 UTC m=+716.808750041" watchObservedRunningTime="2026-06-03 01:16:30.490454526 +0000 UTC m=+716.810666178" Jun 03 01:16:33.144041 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.144002 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm"] Jun 03 01:16:33.146568 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.146551 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.148974 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.148953 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 01:16:33.157945 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.157918 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm"] Jun 03 01:16:33.227401 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.227367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q2jb\" (UniqueName: \"kubernetes.io/projected/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-kube-api-access-4q2jb\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.227610 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.227423 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.227610 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.227520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.227610 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.227557 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.227780 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.227623 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.227780 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.227658 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.328788 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.328748 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.328788 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.328795 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.328992 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.328921 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.329037 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.329002 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4q2jb\" (UniqueName: \"kubernetes.io/projected/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-kube-api-access-4q2jb\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.329177 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.329151 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.329318 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.329197 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.329318 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.329227 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.329318 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.329270 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.329542 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.329519 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.331247 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.331227 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.331667 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.331646 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.336505 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.336484 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q2jb\" (UniqueName: \"kubernetes.io/projected/6ecdf5d5-3493-4dc8-b060-a6fed88550d8-kube-api-access-4q2jb\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm\" (UID: \"6ecdf5d5-3493-4dc8-b060-a6fed88550d8\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.458289 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.458199 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:33.535060 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.535031 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:33.535060 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.535066 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:33.552673 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.552649 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:33.586395 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:33.586317 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm"] Jun 03 01:16:33.588793 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:16:33.588761 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecdf5d5_3493_4dc8_b060_a6fed88550d8.slice/crio-ac79b008652bca868c7ce3f97193b6e77e5f49f787df2978b889a71287fd466c WatchSource:0}: Error finding container ac79b008652bca868c7ce3f97193b6e77e5f49f787df2978b889a71287fd466c: Status 404 returned error can't find the container with id ac79b008652bca868c7ce3f97193b6e77e5f49f787df2978b889a71287fd466c Jun 03 01:16:34.020331 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:34.020293 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:16:34.490528 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:34.490431 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" event={"ID":"6ecdf5d5-3493-4dc8-b060-a6fed88550d8","Type":"ContainerStarted","Data":"fa7986b247fb75c74103903b065df3621fd20aec267d0c9ce77445cb34887053"} Jun 03 01:16:34.490528 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:34.490498 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" event={"ID":"6ecdf5d5-3493-4dc8-b060-a6fed88550d8","Type":"ContainerStarted","Data":"ac79b008652bca868c7ce3f97193b6e77e5f49f787df2978b889a71287fd466c"} Jun 03 01:16:34.501838 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:34.501814 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-92xjf" Jun 03 01:16:35.495090 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:35.495051 2556 generic.go:358] "Generic (PLEG): container finished" podID="6ecdf5d5-3493-4dc8-b060-a6fed88550d8" containerID="fa7986b247fb75c74103903b065df3621fd20aec267d0c9ce77445cb34887053" exitCode=0 Jun 03 01:16:35.495559 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:35.495135 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" event={"ID":"6ecdf5d5-3493-4dc8-b060-a6fed88550d8","Type":"ContainerDied","Data":"fa7986b247fb75c74103903b065df3621fd20aec267d0c9ce77445cb34887053"} Jun 03 01:16:36.500022 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:36.499977 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" event={"ID":"6ecdf5d5-3493-4dc8-b060-a6fed88550d8","Type":"ContainerStarted","Data":"f562099f2a1814a7d726f40050238968950e92f8de68bc0bee3076e20bd3efe1"} Jun 03 01:16:36.518618 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:36.518566 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" podStartSLOduration=3.334977106 podStartE2EDuration="3.518548276s" podCreationTimestamp="2026-06-03 01:16:33 +0000 UTC" firstStartedPulling="2026-06-03 01:16:35.495632388 +0000 UTC m=+721.815844019" lastFinishedPulling="2026-06-03 01:16:35.679203555 +0000 UTC m=+721.999415189" observedRunningTime="2026-06-03 01:16:36.517147539 +0000 UTC m=+722.837359191" watchObservedRunningTime="2026-06-03 01:16:36.518548276 +0000 UTC m=+722.838759930" Jun 03 01:16:40.723126 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:40.723088 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:16:43.458512 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:43.458463 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:43.458512 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:43.458517 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:43.470705 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:43.470677 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:43.535380 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:43.535351 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm" Jun 03 01:16:46.445810 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.445780 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m"] Jun 03 01:16:46.458257 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.458229 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.460101 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.460075 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m"] Jun 03 01:16:46.460862 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.460842 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 01:16:46.538691 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.538663 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d15d3-4610-4116-9bf4-325ea11eab66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.538848 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.538697 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ptpb\" (UniqueName: \"kubernetes.io/projected/2d7d15d3-4610-4116-9bf4-325ea11eab66-kube-api-access-6ptpb\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.538848 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.538755 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.538848 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.538795 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.538848 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.538835 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.538992 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.538855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.639488 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.639434 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d15d3-4610-4116-9bf4-325ea11eab66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.639629 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.639495 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6ptpb\" (UniqueName: \"kubernetes.io/projected/2d7d15d3-4610-4116-9bf4-325ea11eab66-kube-api-access-6ptpb\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.639629 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.639534 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.639629 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.639560 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.639629 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.639609 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.639829 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.639637 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.640019 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.639985 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.640019 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.640017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.640160 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.640042 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.641803 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.641785 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7d15d3-4610-4116-9bf4-325ea11eab66-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.641968 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.641953 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7d15d3-4610-4116-9bf4-325ea11eab66-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.646833 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.646807 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ptpb\" (UniqueName: \"kubernetes.io/projected/2d7d15d3-4610-4116-9bf4-325ea11eab66-kube-api-access-6ptpb\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m\" (UID: \"2d7d15d3-4610-4116-9bf4-325ea11eab66\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.769929 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.769899 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:46.917507 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:46.917464 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m"] Jun 03 01:16:46.919765 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:16:46.919738 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7d15d3_4610_4116_9bf4_325ea11eab66.slice/crio-1e020f50b4d8fffeee34c5eb0a756d89a45b31401b3a305b51549979993736ca WatchSource:0}: Error finding container 1e020f50b4d8fffeee34c5eb0a756d89a45b31401b3a305b51549979993736ca: Status 404 returned error can't find the container with id 1e020f50b4d8fffeee34c5eb0a756d89a45b31401b3a305b51549979993736ca Jun 03 01:16:47.539307 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:47.539273 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" event={"ID":"2d7d15d3-4610-4116-9bf4-325ea11eab66","Type":"ContainerStarted","Data":"03a05e81398c7a381abab6980b07859946a5f225fd11fd2a2cdf79fe5b434e9d"} Jun 03 01:16:47.539307 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:47.539309 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" event={"ID":"2d7d15d3-4610-4116-9bf4-325ea11eab66","Type":"ContainerStarted","Data":"1e020f50b4d8fffeee34c5eb0a756d89a45b31401b3a305b51549979993736ca"} Jun 03 01:16:48.125163 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:48.125127 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:16:48.544197 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:48.544160 2556 generic.go:358] "Generic (PLEG): container finished" podID="2d7d15d3-4610-4116-9bf4-325ea11eab66" containerID="03a05e81398c7a381abab6980b07859946a5f225fd11fd2a2cdf79fe5b434e9d" exitCode=0 Jun 03 01:16:48.544603 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:48.544210 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" event={"ID":"2d7d15d3-4610-4116-9bf4-325ea11eab66","Type":"ContainerDied","Data":"03a05e81398c7a381abab6980b07859946a5f225fd11fd2a2cdf79fe5b434e9d"} Jun 03 01:16:49.549486 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:49.549431 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" event={"ID":"2d7d15d3-4610-4116-9bf4-325ea11eab66","Type":"ContainerStarted","Data":"8f8707ff23d228d9978f13e7bded0b27d1cfc7d446976f816bdad951b871a711"} Jun 03 01:16:49.569560 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:49.569510 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" podStartSLOduration=3.393764597 podStartE2EDuration="3.569492827s" podCreationTimestamp="2026-06-03 01:16:46 +0000 UTC" firstStartedPulling="2026-06-03 01:16:48.544762627 +0000 UTC m=+734.864974257" lastFinishedPulling="2026-06-03 01:16:48.720490836 +0000 UTC m=+735.040702487" observedRunningTime="2026-06-03 01:16:49.567407705 +0000 UTC m=+735.887619359" watchObservedRunningTime="2026-06-03 01:16:49.569492827 +0000 UTC m=+735.889704483" Jun 03 01:16:56.770579 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:56.770537 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:56.770579 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:56.770581 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:56.783042 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:56.783018 2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:16:57.586386 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:16:57.586358 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m" Jun 03 01:17:06.444179 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.444139 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt"] Jun 03 01:17:06.447283 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.447262 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.449727 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.449709 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 01:17:06.456973 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.456952 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt"] Jun 03 01:17:06.506232 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.506202 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab14014-cc9d-4635-8a57-bd87d523c215-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.506361 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.506244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw4x7\" (UniqueName: \"kubernetes.io/projected/7ab14014-cc9d-4635-8a57-bd87d523c215-kube-api-access-cw4x7\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.506361 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.506277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.506361 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.506314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.506361 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.506336 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.506555 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.506418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607242 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607209 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607521 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607484 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607650 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607547 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607650 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607586 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab14014-cc9d-4635-8a57-bd87d523c215-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607650 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607627 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cw4x7\" (UniqueName: \"kubernetes.io/projected/7ab14014-cc9d-4635-8a57-bd87d523c215-kube-api-access-cw4x7\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607816 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607816 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607671 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607816 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607733 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.607978 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.607858 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.610189 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.610164 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7ab14014-cc9d-4635-8a57-bd87d523c215-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.610284 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.610228 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab14014-cc9d-4635-8a57-bd87d523c215-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.615170 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.615145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw4x7\" (UniqueName: \"kubernetes.io/projected/7ab14014-cc9d-4635-8a57-bd87d523c215-kube-api-access-cw4x7\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt\" (UID: \"7ab14014-cc9d-4635-8a57-bd87d523c215\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.757434 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.757363 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" Jun 03 01:17:06.884490 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:06.884439 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt"] Jun 03 01:17:06.887387 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:17:06.887359 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab14014_cc9d_4635_8a57_bd87d523c215.slice/crio-2940ed36ef05140a93d688853f0e24ac5906f53aed6c6ac1c59c7430053d6d6c WatchSource:0}: Error finding container 2940ed36ef05140a93d688853f0e24ac5906f53aed6c6ac1c59c7430053d6d6c: Status 404 returned error can't find the container with id 2940ed36ef05140a93d688853f0e24ac5906f53aed6c6ac1c59c7430053d6d6c Jun 03 01:17:07.608623 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:07.608582 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" event={"ID":"7ab14014-cc9d-4635-8a57-bd87d523c215","Type":"ContainerStarted","Data":"0fde890573037ee05f90b766297f525b1b4501b9bafdef82c2c4862b25fc0e18"} Jun 03 01:17:07.608623 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:07.608627 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt" event={"ID":"7ab14014-cc9d-4635-8a57-bd87d523c215","Type":"ContainerStarted","Data":"2940ed36ef05140a93d688853f0e24ac5906f53aed6c6ac1c59c7430053d6d6c"} Jun 03 01:17:08.225296 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:17:08.225238 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-w8j59"] Jun 03 01:22:48.938095 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:48.938058 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt_7ab14014-cc9d-4635-8a57-bd87d523c215/storage-initializer/0.log" Jun 03 01:22:54.600151 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:54.600113 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86cc4fb5f5-hdk92_0e4d0386-f532-43c2-86d4-d56ae717d29e/nginx/0.log" Jun 03 01:22:54.709602 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:54.709570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-tnlgk_f2694d71-fb23-47cc-b8ce-39e98abe0ee2/manager/0.log" Jun 03 01:22:54.841484 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:54.841445 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-zjp64_3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae/manager/0.log" Jun 03 01:22:55.172569 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:55.172542 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-f4qsk_b21ce213-8e70-41ce-86bc-6c42bb1b4aeb/server/0.log" Jun 03 01:22:55.548627 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:55.548598 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-ch4f4_1291665d-2a45-4e7a-b4e4-be5724cc200f/manager/0.log" Jun 03 01:22:55.553079 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:55.553061 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-ch4f4_1291665d-2a45-4e7a-b4e4-be5724cc200f/copy-manifests/0.log" Jun 03 01:22:57.816328 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:57.816304 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-w8j59_f45b88a1-33d0-42f8-84bf-73a469626d2b/limitador/0.log" Jun 03 01:22:57.928832 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:57.928800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-l5wzz_c1a877ab-03d0-4c5f-a14e-f67255eb6725/manager/0.log" Jun 03 01:22:58.394764 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:58.394730 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-b42q8_17645d81-f1d7-4b61-a419-29565809190d/discovery/0.log" Jun 03 01:22:58.613145 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:58.613118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db4bc68bb-h6bf5_5fd05112-3fc2-402a-b4b5-7ca1c9242f0e/kube-auth-proxy/0.log" Jun 03 01:22:58.835083 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:58.835040 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-x5vf7_f670e1cc-2aac-47d6-9ddc-034cbcd057f5/payload-processing/0.log" Jun 03 01:22:59.416723 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:59.416694 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-92xjf_8df2fe68-e4d1-4247-a601-73d48fd5d1f5/storage-initializer/0.log" Jun 03 01:22:59.424066 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:59.424046 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-92xjf_8df2fe68-e4d1-4247-a601-73d48fd5d1f5/main/0.log" Jun 03 01:22:59.539925 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:59.539899 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm_6ecdf5d5-3493-4dc8-b060-a6fed88550d8/main/0.log" Jun 03 01:22:59.545716 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:59.545684 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-wm8pm_6ecdf5d5-3493-4dc8-b060-a6fed88550d8/storage-initializer/0.log" Jun 03 01:22:59.793134 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:59.793105 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m_2d7d15d3-4610-4116-9bf4-325ea11eab66/main/0.log" Jun 03 01:22:59.799017 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:59.798994 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-5kt7m_2d7d15d3-4610-4116-9bf4-325ea11eab66/storage-initializer/0.log" Jun 03 01:22:59.913208 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:22:59.913182 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-ml5lt_7ab14014-cc9d-4635-8a57-bd87d523c215/storage-initializer/0.log" Jun 03 01:23:07.220153 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:07.220125 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hxtfb_2f3e6dc3-cb4b-4e41-b5d0-63213d63bb88/global-pull-secret-syncer/0.log" Jun 03 01:23:07.301810 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:07.301778 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6sncv_6f34b3d0-c8f9-4b57-8143-be40b45792bc/konnectivity-agent/0.log" Jun 03 01:23:07.392767 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:07.392737 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-82.ec2.internal_1414ae1b4372e7dbb3b03843f08a2ec9/haproxy/0.log" Jun 03 01:23:11.769994 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:11.769964 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-w8j59_f45b88a1-33d0-42f8-84bf-73a469626d2b/limitador/0.log" Jun 03 01:23:11.798880 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:11.798813 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-l5wzz_c1a877ab-03d0-4c5f-a14e-f67255eb6725/manager/0.log" Jun 03 01:23:13.423820 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:13.423786 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9nzl_81e82c8f-6611-4e6d-8754-a0a7b222bb4e/node-exporter/0.log" Jun 03 01:23:13.440715 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:13.440688 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9nzl_81e82c8f-6611-4e6d-8754-a0a7b222bb4e/kube-rbac-proxy/0.log" Jun 03 01:23:13.462651 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:13.462624 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t9nzl_81e82c8f-6611-4e6d-8754-a0a7b222bb4e/init-textfile/0.log" Jun 03 01:23:16.994436 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:16.994403 2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn"] Jun 03 01:23:16.996676 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:16.996658 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:16.999337 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:16.999314 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79wk\"/\"kube-root-ca.crt\"" Jun 03 01:23:16.999440 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:16.999316 2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d79wk\"/\"default-dockercfg-9nwgs\"" Jun 03 01:23:17.000601 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.000583 2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d79wk\"/\"openshift-service-ca.crt\"" Jun 03 01:23:17.008810 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.008785 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn"] Jun 03 01:23:17.094933 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.094891 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-podres\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.095091 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.094950 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-proc\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.095091 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.095021 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7xbg\" (UniqueName: \"kubernetes.io/projected/461a5774-11bb-4771-938a-b82a7adaade9-kube-api-access-d7xbg\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.095091 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.095052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-sys\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.095091 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.095070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-lib-modules\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196253 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196218 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-podres\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196421 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196266 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-proc\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196421 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196296 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7xbg\" (UniqueName: \"kubernetes.io/projected/461a5774-11bb-4771-938a-b82a7adaade9-kube-api-access-d7xbg\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196421 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196315 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-sys\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196421 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196332 2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-lib-modules\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196421 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-podres\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196675 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196431 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-sys\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196675 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196443 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-proc\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.196675 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.196493 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/461a5774-11bb-4771-938a-b82a7adaade9-lib-modules\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.204784 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.204759 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7xbg\" (UniqueName: \"kubernetes.io/projected/461a5774-11bb-4771-938a-b82a7adaade9-kube-api-access-d7xbg\") pod \"perf-node-gather-daemonset-ttrkn\" (UID: \"461a5774-11bb-4771-938a-b82a7adaade9\") " pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.306535 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.306502 2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.426584 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.426550 2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn"] Jun 03 01:23:17.429740 ip-10-0-132-82 kubenswrapper[2556]: W0603 01:23:17.429716 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod461a5774_11bb_4771_938a_b82a7adaade9.slice/crio-34d9910067662492bf1edd1e91dc65ddc2787a22ccc1a18930f3f4f2f6b9bea4 WatchSource:0}: Error finding container 34d9910067662492bf1edd1e91dc65ddc2787a22ccc1a18930f3f4f2f6b9bea4: Status 404 returned error can't find the container with id 34d9910067662492bf1edd1e91dc65ddc2787a22ccc1a18930f3f4f2f6b9bea4 Jun 03 01:23:17.431232 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.431217 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 01:23:17.821303 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.821269 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mzdpl_e1216639-c507-49b3-b4cb-e818dfbc9653/dns/0.log" Jun 03 01:23:17.838515 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.838489 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mzdpl_e1216639-c507-49b3-b4cb-e818dfbc9653/kube-rbac-proxy/0.log" Jun 03 01:23:17.851585 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.851557 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" event={"ID":"461a5774-11bb-4771-938a-b82a7adaade9","Type":"ContainerStarted","Data":"74f09b2b751e1bc07591a85a74b74e143129cb2e30b9c1874cd8c67e3a6b0104"} Jun 03 01:23:17.851733 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.851590 2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" event={"ID":"461a5774-11bb-4771-938a-b82a7adaade9","Type":"ContainerStarted","Data":"34d9910067662492bf1edd1e91dc65ddc2787a22ccc1a18930f3f4f2f6b9bea4"} Jun 03 01:23:17.851733 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.851675 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:17.867680 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.867638 2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" podStartSLOduration=1.867625238 podStartE2EDuration="1.867625238s" podCreationTimestamp="2026-06-03 01:23:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 01:23:17.865898207 +0000 UTC m=+1124.186109860" watchObservedRunningTime="2026-06-03 01:23:17.867625238 +0000 UTC m=+1124.187836891" Jun 03 01:23:17.928141 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:17.928114 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-m922r_df15ae61-4fab-44fc-98dd-67bce5d2ba3f/dns-node-resolver/0.log" Jun 03 01:23:18.466049 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:18.466020 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p8gv9_ba7507f8-ceb8-45a7-a278-4f008706579b/node-ca/0.log" Jun 03 01:23:19.387738 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:19.387709 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-b42q8_17645d81-f1d7-4b61-a419-29565809190d/discovery/0.log" Jun 03 01:23:19.426830 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:19.426801 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db4bc68bb-h6bf5_5fd05112-3fc2-402a-b4b5-7ca1c9242f0e/kube-auth-proxy/0.log" Jun 03 01:23:19.473687 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:19.473661 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-x5vf7_f670e1cc-2aac-47d6-9ddc-034cbcd057f5/payload-processing/0.log" Jun 03 01:23:19.987316 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:19.987284 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4nrbl_01ce2775-bfc8-4e01-a60e-21bf86b70fb0/serve-healthcheck-canary/0.log" Jun 03 01:23:20.608878 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:20.608842 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x4fl8_2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11/kube-rbac-proxy/0.log" Jun 03 01:23:20.625709 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:20.625678 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x4fl8_2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11/exporter/0.log" Jun 03 01:23:20.645181 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:20.645154 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x4fl8_2fb2cf3a-ad68-4b1a-b09b-d7b3b00b7c11/extractor/0.log" Jun 03 01:23:22.643335 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:22.643302 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86cc4fb5f5-hdk92_0e4d0386-f532-43c2-86d4-d56ae717d29e/nginx/0.log" Jun 03 01:23:22.665080 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:22.665055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-tnlgk_f2694d71-fb23-47cc-b8ce-39e98abe0ee2/manager/0.log" Jun 03 01:23:22.706277 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:22.706248 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-zjp64_3f6dbfa4-b684-4597-8fc4-4ec6f4c5c4ae/manager/0.log" Jun 03 01:23:22.783290 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:22.783256 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-f4qsk_b21ce213-8e70-41ce-86bc-6c42bb1b4aeb/server/0.log" Jun 03 01:23:23.009151 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:23.009074 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-ch4f4_1291665d-2a45-4e7a-b4e4-be5724cc200f/manager/0.log" Jun 03 01:23:23.025159 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:23.025138 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85b884ccf6-ch4f4_1291665d-2a45-4e7a-b4e4-be5724cc200f/copy-manifests/0.log" Jun 03 01:23:23.864798 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:23.864767 2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d79wk/perf-node-gather-daemonset-ttrkn" Jun 03 01:23:24.374868 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:24.374830 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-4vff4_4d1b77bf-ef64-41c5-a134-47c45b609fc3/openshift-lws-operator/0.log" Jun 03 01:23:30.692374 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:30.692337 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z279_6f1f69d3-8e71-4789-98e5-e0ca691d8929/kube-multus-additional-cni-plugins/0.log" Jun 03 01:23:30.711423 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:30.711387 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z279_6f1f69d3-8e71-4789-98e5-e0ca691d8929/egress-router-binary-copy/0.log" Jun 03 01:23:30.730337 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:30.730317 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z279_6f1f69d3-8e71-4789-98e5-e0ca691d8929/cni-plugins/0.log" Jun 03 01:23:30.749869 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:30.749840 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z279_6f1f69d3-8e71-4789-98e5-e0ca691d8929/bond-cni-plugin/0.log" Jun 03 01:23:30.768550 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:30.768519 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z279_6f1f69d3-8e71-4789-98e5-e0ca691d8929/routeoverride-cni/0.log" Jun 03 01:23:30.789034 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:30.789008 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z279_6f1f69d3-8e71-4789-98e5-e0ca691d8929/whereabouts-cni-bincopy/0.log" Jun 03 01:23:30.808565 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:30.808544 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5z279_6f1f69d3-8e71-4789-98e5-e0ca691d8929/whereabouts-cni/0.log" Jun 03 01:23:31.055492 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:31.055444 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pl285_eb15c480-bbd4-416a-97fc-7827fcc384a9/kube-multus/0.log" Jun 03 01:23:31.101024 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:31.100997 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vf9xt_85de7c04-6c45-4a09-8489-0f99197af1b2/network-metrics-daemon/0.log" Jun 03 01:23:31.116711 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:31.116688 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vf9xt_85de7c04-6c45-4a09-8489-0f99197af1b2/kube-rbac-proxy/0.log" Jun 03 01:23:32.705519 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:32.705423 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/ovn-controller/0.log" Jun 03 01:23:32.732745 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:32.732714 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/ovn-acl-logging/0.log" Jun 03 01:23:32.757379 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:32.757340 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/kube-rbac-proxy-node/0.log" Jun 03 01:23:32.776732 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:32.776712 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 01:23:32.793640 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:32.793620 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/northd/0.log" Jun 03 01:23:32.812323 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:32.812305 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/nbdb/0.log" Jun 03 01:23:32.830016 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:32.829990 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/sbdb/0.log" Jun 03 01:23:33.002366 ip-10-0-132-82 kubenswrapper[2556]: I0603 01:23:33.002278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cnmxp_50df6db2-833b-483d-9b13-f40f29e98884/ovnkube-controller/0.log"