Jun 03 17:45:19.343815 ip-10-0-128-111 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 17:45:19.343826 ip-10-0-128-111 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 17:45:19.343833 ip-10-0-128-111 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 17:45:19.344127 ip-10-0-128-111 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 17:45:28.798956 ip-10-0-128-111 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 17:45:28.798967 ip-10-0-128-111 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7212a99d499945bc85ec2906ce61ed42 -- Jun 03 17:47:40.167673 ip-10-0-128-111 systemd[1]: Starting Kubernetes Kubelet... Jun 03 17:47:40.603309 ip-10-0-128-111 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 17:47:40.603309 ip-10-0-128-111 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 17:47:40.603309 ip-10-0-128-111 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 17:47:40.603309 ip-10-0-128-111 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 17:47:40.603309 ip-10-0-128-111 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 17:47:40.604166 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.604078 2570 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 17:47:40.609619 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609590 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:47:40.609619 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609615 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:47:40.609619 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609621 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:47:40.609619 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609624 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609628 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609631 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609634 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609636 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609640 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609642 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609645 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609648 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609651 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609653 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609656 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609659 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609662 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609664 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609667 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609670 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609672 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609674 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609677 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:47:40.609799 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609683 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609687 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609690 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609692 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609695 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609698 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609702 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609706 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609712 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609716 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609719 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609722 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609725 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609727 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609730 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609733 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609736 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609739 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609741 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:47:40.610285 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609744 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609746 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609749 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609751 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609754 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609756 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609759 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609762 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609764 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609767 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609770 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609772 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609775 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609777 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609780 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609783 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609785 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609788 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609790 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609793 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:47:40.610775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609795 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609798 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609800 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609803 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609805 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609808 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609811 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609814 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609817 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609819 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609822 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609824 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609827 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609830 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609832 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609835 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609839 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609843 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609845 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609848 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:47:40.611265 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609851 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609854 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609856 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.609859 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610264 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610269 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610272 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610275 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610278 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610280 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610283 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610286 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610289 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610292 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610294 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610297 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610300 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610302 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610305 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:47:40.611775 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610308 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610311 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610314 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610316 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610319 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610322 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610324 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610327 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610329 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610333 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610335 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610338 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610340 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610343 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610347 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610350 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610354 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610357 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610360 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610363 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:47:40.612249 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610366 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610369 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610372 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610374 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610377 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610380 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610382 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610401 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610404 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610408 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610410 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610413 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610416 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610419 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610422 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610424 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610427 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610430 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610432 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610435 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:47:40.612801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610437 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610440 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610444 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610446 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610449 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610451 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610454 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610457 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610460 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610462 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610464 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610467 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610471 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610473 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610476 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610478 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610481 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610484 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610486 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610489 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:47:40.613299 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610492 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610495 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610498 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610501 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610503 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610506 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610509 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610512 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610514 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610516 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.610519 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611127 2570 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611135 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611143 2570 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611148 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611153 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611156 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611161 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611165 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611169 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611171 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 17:47:40.613830 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611175 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611179 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611182 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611185 2570 flags.go:64] FLAG: --cgroup-root="" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611188 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611190 2570 flags.go:64] FLAG: --client-ca-file="" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611193 2570 flags.go:64] FLAG: --cloud-config="" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611196 2570 flags.go:64] FLAG: --cloud-provider="external" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611199 2570 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611204 2570 flags.go:64] FLAG: --cluster-domain="" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611206 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611210 2570 flags.go:64] FLAG: --config-dir="" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611213 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611216 2570 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611220 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611223 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611226 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611229 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611232 2570 flags.go:64] FLAG: --contention-profiling="false" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611235 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611238 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611241 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611244 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611248 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611251 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 17:47:40.614341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611254 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611257 2570 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611261 2570 flags.go:64] FLAG: --enable-server="true" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611264 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611269 2570 flags.go:64] FLAG: --event-burst="100" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611272 2570 flags.go:64] FLAG: --event-qps="50" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611275 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611278 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611282 2570 flags.go:64] FLAG: --eviction-hard="" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611285 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611289 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611292 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611295 2570 flags.go:64] FLAG: --eviction-soft="" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611298 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611301 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611304 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611307 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611310 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611313 2570 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611316 2570 flags.go:64] FLAG: --feature-gates="" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611320 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611323 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611326 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611329 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611332 2570 flags.go:64] FLAG: --healthz-port="10248" Jun 03 17:47:40.614993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611335 2570 flags.go:64] FLAG: --help="false" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611338 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611341 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611344 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611348 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611351 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611354 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611358 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611361 2570 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611364 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611367 2570 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611370 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611373 2570 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611376 2570 flags.go:64] FLAG: --kube-reserved="" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611379 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611382 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611399 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611402 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611405 2570 flags.go:64] FLAG: --lock-file="" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611408 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611411 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611414 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611419 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 17:47:40.615662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611422 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611425 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611428 2570 flags.go:64] FLAG: --logging-format="text" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611431 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611434 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611437 2570 flags.go:64] FLAG: --manifest-url="" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611440 2570 flags.go:64] FLAG: --manifest-url-header="" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611445 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611448 2570 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611452 2570 flags.go:64] FLAG: --max-pods="110" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611455 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611458 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611461 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611464 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611467 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611470 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611475 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611482 2570 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611485 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611488 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611492 2570 flags.go:64] FLAG: --pod-cidr="" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611495 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611500 2570 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611503 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 17:47:40.616218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611506 2570 flags.go:64] FLAG: --pods-per-core="0" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611509 2570 flags.go:64] FLAG: --port="10250" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611511 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611514 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0895b327027d3be81" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611518 2570 flags.go:64] FLAG: --qos-reserved="" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611520 2570 flags.go:64] FLAG: --read-only-port="10255" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611523 2570 flags.go:64] FLAG: --register-node="true" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611526 2570 flags.go:64] FLAG: --register-schedulable="true" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611529 2570 flags.go:64] FLAG: --register-with-taints="" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611533 2570 flags.go:64] FLAG: --registry-burst="10" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611536 2570 flags.go:64] FLAG: --registry-qps="5" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611538 2570 flags.go:64] FLAG: --reserved-cpus="" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611541 2570 flags.go:64] FLAG: --reserved-memory="" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611545 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611551 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611554 2570 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611557 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611560 2570 flags.go:64] FLAG: --runonce="false" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611563 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611566 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611568 2570 flags.go:64] FLAG: --seccomp-default="false" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611571 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611574 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611577 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611581 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611585 2570 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 17:47:40.616871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611588 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611591 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611593 2570 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611597 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611600 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611603 2570 flags.go:64] FLAG: --system-cgroups="" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611605 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611610 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611613 2570 flags.go:64] FLAG: --tls-cert-file="" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611616 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611620 2570 flags.go:64] FLAG: --tls-min-version="" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611623 2570 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611626 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611628 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611631 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611634 2570 flags.go:64] FLAG: --v="2" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611638 2570 flags.go:64] FLAG: --version="false" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611642 2570 flags.go:64] FLAG: --vmodule="" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611645 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.611649 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611750 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611754 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611757 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611760 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:47:40.617606 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611764 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611767 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611769 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611772 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611774 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611777 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611781 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611784 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611787 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611790 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611792 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611795 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611798 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611801 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611804 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611806 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611809 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611811 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611814 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611816 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:47:40.618221 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611819 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611821 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611824 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611826 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611829 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611831 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611834 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611836 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611840 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611842 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611845 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611848 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611850 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611853 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611855 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611858 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611862 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611865 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611872 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611875 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:47:40.618752 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611877 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611880 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611882 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611885 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611887 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611890 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611893 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611895 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611898 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611900 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611902 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611905 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611907 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611910 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611913 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611915 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611917 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611921 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611925 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:47:40.619250 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611928 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611932 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611935 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611938 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611941 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611944 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611946 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611949 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611951 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611954 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611956 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611961 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611963 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611966 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611969 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611972 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611974 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611977 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611979 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611982 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:47:40.619732 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611985 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611987 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.611990 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.612642 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.618818 2570 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.618836 2570 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618885 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618890 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618895 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618899 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618902 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618906 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618909 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618912 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618914 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:47:40.620326 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618917 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618920 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618923 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618925 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618929 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618932 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618935 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618937 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618940 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618942 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618946 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618948 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618951 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618954 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618957 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618960 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618962 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618965 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618968 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618971 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:47:40.620773 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618974 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618976 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618980 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618982 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618985 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618988 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618990 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618993 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618996 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.618998 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619000 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619003 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619005 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619008 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619011 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619013 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619016 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619019 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619021 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619024 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:47:40.621274 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619027 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619029 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619032 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619034 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619037 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619040 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619043 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619045 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619048 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619051 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619054 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619056 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619059 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619061 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619064 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619067 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619070 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619072 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619075 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:47:40.621787 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619078 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619080 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619084 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619087 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619090 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619093 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619095 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619098 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619100 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619103 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619105 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619108 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619110 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619113 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619115 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619118 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619120 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:47:40.622258 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619123 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.619129 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619229 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619233 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619236 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619239 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619242 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619245 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619247 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619250 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619253 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619256 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619259 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619262 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619265 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619267 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 17:47:40.622738 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619270 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619272 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619275 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619277 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619280 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619282 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619285 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619287 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619290 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619292 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619296 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619299 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619302 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619304 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619307 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619310 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619312 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619315 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619318 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619320 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 17:47:40.623156 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619322 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619325 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619327 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619330 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619333 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619335 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619338 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619340 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619343 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619347 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619351 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619354 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619357 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619360 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619363 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619366 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619369 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619372 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619375 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 17:47:40.623684 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619377 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619380 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619383 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619403 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619406 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619409 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619412 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619415 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619417 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619420 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619422 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619425 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619427 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619430 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619432 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619435 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619438 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619440 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619443 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619445 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 17:47:40.624172 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619448 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619451 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619453 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619456 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619459 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619462 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619464 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619466 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619469 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619472 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619474 2570 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619477 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:40.619479 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.619484 2570 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.620240 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 17:47:40.624710 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.622640 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 17:47:40.625109 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.623636 2570 server.go:1019] "Starting client certificate rotation" Jun 03 17:47:40.625109 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.623730 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 17:47:40.625109 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.623766 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 17:47:40.650636 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.650616 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 17:47:40.652354 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.652326 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 17:47:40.668195 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.668174 2570 log.go:25] "Validated CRI v1 runtime API" Jun 03 17:47:40.673806 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.673790 2570 log.go:25] "Validated CRI v1 image API" Jun 03 17:47:40.675732 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.675697 2570 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 17:47:40.678136 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.678117 2570 fs.go:135] Filesystem UUIDs: map[677acf50-a792-42f7-9b3f-bfa78354e068:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 916b541f-466b-4794-9c3c-43e61b2cc9a1:/dev/nvme0n1p4] Jun 03 17:47:40.678188 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.678136 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 17:47:40.681419 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.681399 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 17:47:40.682798 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.682692 2570 manager.go:217] Machine: {Timestamp:2026-06-03 17:47:40.682176489 +0000 UTC m=+0.400074561 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100860 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26429f61c23ca8603040197b13ce08 SystemUUID:ec26429f-61c2-3ca8-6030-40197b13ce08 BootID:7212a99d-4999-45bc-85ec-2906ce61ed42 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:66:19:fe:f7:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:66:19:fe:f7:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:de:6d:76:bc:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 17:47:40.683307 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.683295 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 17:47:40.683414 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.683382 2570 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 17:47:40.686271 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.686244 2570 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 17:47:40.686468 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.686272 2570 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-111.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 17:47:40.686564 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.686482 2570 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 17:47:40.686564 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.686495 2570 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 17:47:40.686564 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.686506 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 17:47:40.687286 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.687274 2570 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 17:47:40.688771 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.688757 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 03 17:47:40.688900 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.688889 2570 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 17:47:40.691188 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.691177 2570 kubelet.go:491] "Attempting to sync node with API server" Jun 03 17:47:40.691254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.691196 2570 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 17:47:40.691254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.691214 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 17:47:40.691254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.691229 2570 kubelet.go:397] "Adding apiserver pod source" Jun 03 17:47:40.691254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.691244 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 17:47:40.692610 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.692594 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 17:47:40.692684 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.692619 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 17:47:40.695797 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.695782 2570 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 17:47:40.697797 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.697784 2570 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 17:47:40.700341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700318 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 17:47:40.700341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700335 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 17:47:40.700341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700341 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 17:47:40.700341 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700347 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700356 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700362 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700368 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700374 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700381 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700401 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700415 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 17:47:40.700544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.700421 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 17:47:40.701229 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.701215 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 17:47:40.701229 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.701227 2570 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 17:47:40.701314 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.701279 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 17:47:40.701444 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.701418 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 17:47:40.704718 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.704699 2570 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 17:47:40.704794 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.704745 2570 server.go:1295] "Started kubelet" Jun 03 17:47:40.704846 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.704800 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 17:47:40.705257 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.705190 2570 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 17:47:40.705350 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.705272 2570 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 17:47:40.705679 ip-10-0-128-111 systemd[1]: Started Kubernetes Kubelet. Jun 03 17:47:40.706357 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.706333 2570 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 17:47:40.707777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.707764 2570 server.go:317] "Adding debug handlers to kubelet server" Jun 03 17:47:40.712955 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.712937 2570 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 17:47:40.713377 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.713354 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 17:47:40.713849 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.713835 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 17:47:40.714016 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.713996 2570 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 17:47:40.714016 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714015 2570 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 17:47:40.714182 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714115 2570 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 17:47:40.714232 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714200 2570 reconstruct.go:97] "Volume reconstruction finished" Jun 03 17:47:40.714232 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714208 2570 reconciler.go:26] "Reconciler: start to sync state" Jun 03 17:47:40.714616 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.714596 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:40.714712 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714669 2570 factory.go:55] Registering systemd factory Jun 03 17:47:40.714712 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714684 2570 factory.go:223] Registration of the systemd container factory successfully Jun 03 17:47:40.714960 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714940 2570 factory.go:153] Registering CRI-O factory Jun 03 17:47:40.714960 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.714962 2570 factory.go:223] Registration of the crio container factory successfully Jun 03 17:47:40.715128 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.715006 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 17:47:40.715128 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.715023 2570 factory.go:103] Registering Raw factory Jun 03 17:47:40.715128 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.715040 2570 manager.go:1196] Started watching for new ooms in manager Jun 03 17:47:40.715446 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.715435 2570 manager.go:319] Starting recovery of all containers Jun 03 17:47:40.717046 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.717020 2570 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 17:47:40.717159 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.717094 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-111.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 17:47:40.717159 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.717110 2570 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-111.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 17:47:40.718222 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.717165 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-111.ec2.internal.18b5a36011bd7a87 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-111.ec2.internal,UID:ip-10-0-128-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-111.ec2.internal,},FirstTimestamp:2026-06-03 17:47:40.704717447 +0000 UTC m=+0.422615522,LastTimestamp:2026-06-03 17:47:40.704717447 +0000 UTC m=+0.422615522,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-111.ec2.internal,}" Jun 03 17:47:40.726213 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.726185 2570 manager.go:324] Recovery completed Jun 03 17:47:40.727529 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.727506 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zt7q4" Jun 03 17:47:40.731184 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.731069 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:47:40.733168 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.733153 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:47:40.733252 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.733184 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:47:40.733252 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.733201 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:47:40.733732 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.733716 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 17:47:40.733732 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.733730 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 17:47:40.733820 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.733746 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 03 17:47:40.734470 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.734455 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zt7q4" Jun 03 17:47:40.735426 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.735332 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-111.ec2.internal.18b5a360136f9907 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-111.ec2.internal,UID:ip-10-0-128-111.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-111.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-111.ec2.internal,},FirstTimestamp:2026-06-03 17:47:40.733167879 +0000 UTC m=+0.451065956,LastTimestamp:2026-06-03 17:47:40.733167879 +0000 UTC m=+0.451065956,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-111.ec2.internal,}" Jun 03 17:47:40.735922 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.735909 2570 policy_none.go:49] "None policy: Start" Jun 03 17:47:40.735975 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.735927 2570 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 17:47:40.735975 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.735938 2570 state_mem.go:35] "Initializing new in-memory state store" Jun 03 17:47:40.774434 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.770937 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 17:47:40.774434 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.772066 2570 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 17:47:40.774434 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.772083 2570 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 17:47:40.774434 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.772100 2570 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 17:47:40.774434 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.772106 2570 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 17:47:40.774434 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.772185 2570 kubelet.go:2475] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 03 17:47:40.775027 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775014 2570 manager.go:341] "Starting Device Plugin manager" Jun 03 17:47:40.775123 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.775063 2570 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 17:47:40.775123 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775078 2570 server.go:85] "Starting device plugin registration server" Jun 03 17:47:40.775211 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775154 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:47:40.775354 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775342 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 17:47:40.775605 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775356 2570 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 17:47:40.775605 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775442 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 17:47:40.775605 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775515 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 17:47:40.775605 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.775523 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 17:47:40.776179 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.776158 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 17:47:40.776270 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.776193 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:40.873136 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.873027 2570 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal"] Jun 03 17:47:40.873136 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.873128 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:47:40.875099 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.875080 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:47:40.875181 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.875118 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:47:40.875181 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.875129 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:47:40.875583 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.875564 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:47:40.876265 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876249 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:47:40.876265 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876252 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:47:40.876430 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876281 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:47:40.876430 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876296 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:47:40.876430 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876323 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.876430 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876418 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.876630 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876448 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:47:40.876950 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876932 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:47:40.877050 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876963 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:47:40.877050 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876974 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:47:40.877050 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876975 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:47:40.877050 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.876993 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:47:40.877050 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.877002 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:47:40.877999 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.877987 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.878047 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.878013 2570 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 17:47:40.878634 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.878621 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientMemory" Jun 03 17:47:40.878708 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.878644 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 17:47:40.878708 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.878653 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeHasSufficientPID" Jun 03 17:47:40.885766 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.885752 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.885835 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.885770 2570 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-111.ec2.internal\": node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:40.901043 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.901022 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-111.ec2.internal\" not found" node="ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.903191 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.903175 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:40.905548 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:40.905532 2570 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-111.ec2.internal\" not found" node="ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.915503 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.915483 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bfe4fc6759c973c3d69648ff34e1ad6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal\" (UID: \"bfe4fc6759c973c3d69648ff34e1ad6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.915566 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.915507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfe4fc6759c973c3d69648ff34e1ad6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal\" (UID: \"bfe4fc6759c973c3d69648ff34e1ad6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:40.915566 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:40.915526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4df10d4b37f7728e83844c976cd0de4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-111.ec2.internal\" (UID: \"e4df10d4b37f7728e83844c976cd0de4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.004058 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.004025 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.016456 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.016426 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bfe4fc6759c973c3d69648ff34e1ad6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal\" (UID: \"bfe4fc6759c973c3d69648ff34e1ad6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.016581 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.016467 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfe4fc6759c973c3d69648ff34e1ad6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal\" (UID: \"bfe4fc6759c973c3d69648ff34e1ad6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.016581 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.016515 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bfe4fc6759c973c3d69648ff34e1ad6d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal\" (UID: \"bfe4fc6759c973c3d69648ff34e1ad6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.016581 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.016568 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfe4fc6759c973c3d69648ff34e1ad6d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal\" (UID: \"bfe4fc6759c973c3d69648ff34e1ad6d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.016681 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.016594 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4df10d4b37f7728e83844c976cd0de4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-111.ec2.internal\" (UID: \"e4df10d4b37f7728e83844c976cd0de4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.016681 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.016622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e4df10d4b37f7728e83844c976cd0de4-config\") pod \"kube-apiserver-proxy-ip-10-0-128-111.ec2.internal\" (UID: \"e4df10d4b37f7728e83844c976cd0de4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.105020 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.104984 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.203869 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.203779 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.205110 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.205093 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.209528 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.209513 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" Jun 03 17:47:41.305424 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.305361 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.405878 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.405828 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.506421 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.506325 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.557442 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.557382 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:47:41.606939 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.606916 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.623465 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.623438 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 17:47:41.623613 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.623588 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 17:47:41.623613 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.623588 2570 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 17:47:41.689690 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:41.689655 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe4fc6759c973c3d69648ff34e1ad6d.slice/crio-d71aff3168425220818f90a1a2f78cf409ca78817c758a139fb1cc880c631255 WatchSource:0}: Error finding container d71aff3168425220818f90a1a2f78cf409ca78817c758a139fb1cc880c631255: Status 404 returned error can't find the container with id d71aff3168425220818f90a1a2f78cf409ca78817c758a139fb1cc880c631255 Jun 03 17:47:41.689911 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:41.689898 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4df10d4b37f7728e83844c976cd0de4.slice/crio-d099a0c578d68543b197d293188831006b3e93a5ae2bb15bf8039bff24463a80 WatchSource:0}: Error finding container d099a0c578d68543b197d293188831006b3e93a5ae2bb15bf8039bff24463a80: Status 404 returned error can't find the container with id d099a0c578d68543b197d293188831006b3e93a5ae2bb15bf8039bff24463a80 Jun 03 17:47:41.695093 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.694699 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 17:47:41.707317 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.707299 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.714166 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.714143 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 17:47:41.723154 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.723136 2570 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 17:47:41.736004 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.735974 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 17:42:40 +0000 UTC" deadline="2027-10-28 02:52:22.661578198 +0000 UTC" Jun 03 17:47:41.736004 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.735999 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12273h4m40.925581909s" Jun 03 17:47:41.746654 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.746633 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbvtb" Jun 03 17:47:41.757630 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.757586 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xbvtb" Jun 03 17:47:41.775578 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.775524 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" event={"ID":"bfe4fc6759c973c3d69648ff34e1ad6d","Type":"ContainerStarted","Data":"d71aff3168425220818f90a1a2f78cf409ca78817c758a139fb1cc880c631255"} Jun 03 17:47:41.776338 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.776318 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" event={"ID":"e4df10d4b37f7728e83844c976cd0de4","Type":"ContainerStarted","Data":"d099a0c578d68543b197d293188831006b3e93a5ae2bb15bf8039bff24463a80"} Jun 03 17:47:41.807505 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.807483 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.908003 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:41.907963 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:41.938878 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:41.938859 2570 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:47:42.008876 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.008792 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:42.109442 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.109379 2570 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-128-111.ec2.internal\" not found" Jun 03 17:47:42.195651 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.195621 2570 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:47:42.214583 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.214556 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" Jun 03 17:47:42.223704 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.223685 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 17:47:42.224673 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.224659 2570 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" Jun 03 17:47:42.237173 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.237157 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 17:47:42.651078 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.651047 2570 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:47:42.692846 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.692809 2570 apiserver.go:52] "Watching apiserver" Jun 03 17:47:42.699112 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.699086 2570 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 17:47:42.699500 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.699476 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8qwfz","openshift-network-operator/iptables-alerter-4245h","openshift-ovn-kubernetes/ovnkube-node-cbbpw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2","openshift-cluster-node-tuning-operator/tuned-cpmqf","openshift-image-registry/node-ca-6r2b2","openshift-multus/multus-additional-cni-plugins-pj5bw","openshift-network-diagnostics/network-check-target-sjdwg","kube-system/konnectivity-agent-dphts","kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal","openshift-multus/multus-kzmmh"] Jun 03 17:47:42.701342 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.701080 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.702588 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.702564 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.703643 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.703621 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 17:47:42.703751 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.703670 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zl25j\"" Jun 03 17:47:42.703816 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.703621 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:47:42.703934 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.703917 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 17:47:42.705195 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.705174 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 17:47:42.706069 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.705426 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bn2kt\"" Jun 03 17:47:42.706069 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.705609 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 17:47:42.706069 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.705750 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 17:47:42.706069 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.705887 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 17:47:42.706069 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.706030 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 17:47:42.706352 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.706215 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 17:47:42.706581 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.706559 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.707927 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.707678 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.707927 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.707772 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:42.707927 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.707837 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:42.708562 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.708543 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 17:47:42.708653 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.708552 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 17:47:42.708653 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.708616 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 17:47:42.708751 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.708684 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wmbzn\"" Jun 03 17:47:42.709529 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.709512 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.709662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.709628 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 17:47:42.710075 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.710058 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 17:47:42.710230 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.710163 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-96p2j\"" Jun 03 17:47:42.710230 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.710179 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 17:47:42.710230 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.710164 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 17:47:42.712527 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.712076 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 17:47:42.712527 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.712153 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b7qt\"" Jun 03 17:47:42.712527 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.712208 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.712527 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.712268 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 17:47:42.712527 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.712304 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 17:47:42.714086 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.714067 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.714293 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.714262 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:42.714414 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.714373 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rsxfp\"" Jun 03 17:47:42.715510 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.714827 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:42.715510 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.715203 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:47:42.716314 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.716047 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 17:47:42.716314 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.716273 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 17:47:42.716980 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.716958 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v6jbx\"" Jun 03 17:47:42.717783 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.717353 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 17:47:42.717997 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.717969 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:42.721099 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.721080 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 17:47:42.721224 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.721200 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 17:47:42.721303 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.721125 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b2ggs\"" Jun 03 17:47:42.726151 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726130 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-var-lib-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.726249 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726165 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-env-overrides\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.726249 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726190 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysctl-d\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.726249 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-cni-netd\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.726437 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-os-release\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.726437 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726329 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-modprobe-d\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.726437 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726379 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-etc-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.726437 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726427 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-cni-binary-copy\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726477 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726500 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad544606-0cbc-4202-8d14-39fa80b7eea6-agent-certs\") pod \"konnectivity-agent-dphts\" (UID: \"ad544606-0cbc-4202-8d14-39fa80b7eea6\") " pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726522 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-cnibin\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726545 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-kubelet\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysconfig\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726592 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726617 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-node-log\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.726647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cae23931-e01c-415e-800d-321d8cc77390-ovn-node-metrics-cert\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726661 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad544606-0cbc-4202-8d14-39fa80b7eea6-konnectivity-ca\") pod \"konnectivity-agent-dphts\" (UID: \"ad544606-0cbc-4202-8d14-39fa80b7eea6\") " pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726685 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-cni-multus\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726735 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-conf-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-run\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-socket-dir-parent\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-daemon-config\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726878 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-var-lib-kubelet\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99e212e9-f032-4df6-8642-428e76496dfd-etc-tuned\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-cni-binary-copy\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726972 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-iptables-alerter-script\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.726994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727010 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-netns\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727029 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-sys\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727055 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqzpb\" (UniqueName: \"kubernetes.io/projected/99e212e9-f032-4df6-8642-428e76496dfd-kube-api-access-lqzpb\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727075 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-slash\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-ovnkube-script-lib\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.727108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvftn\" (UniqueName: \"kubernetes.io/projected/cae23931-e01c-415e-800d-321d8cc77390-kube-api-access-dvftn\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-device-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727160 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv9f8\" (UniqueName: \"kubernetes.io/projected/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-kube-api-access-gv9f8\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-cnibin\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727205 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e8bbba-7978-4536-8e7b-42b4764c0105-host\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-cni-bin\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727249 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-multus-certs\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727271 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727300 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727328 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-cni-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-ovn\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727400 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b1e8bbba-7978-4536-8e7b-42b4764c0105-serviceca\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-cni-bin\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727447 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysctl-conf\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727467 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-host\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727504 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gzx2\" (UniqueName: \"kubernetes.io/projected/b2fbf7b7-252b-4db4-958a-b9c2883808b9-kube-api-access-4gzx2\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:42.727965 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-systemd-units\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-run-netns\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-ovnkube-config\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727650 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-socket-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-sys-fs\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz4bm\" (UniqueName: \"kubernetes.io/projected/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-kube-api-access-vz4bm\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scsqv\" (UniqueName: \"kubernetes.io/projected/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-kube-api-access-scsqv\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727823 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-system-cni-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727848 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-kubernetes\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727874 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-systemd\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727906 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99e212e9-f032-4df6-8642-428e76496dfd-tmp\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.727929 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-kubelet\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728005 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4w7t\" (UniqueName: \"kubernetes.io/projected/355a496a-311c-48ac-b015-53aa82b57375-kube-api-access-w4w7t\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728031 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqbsl\" (UniqueName: \"kubernetes.io/projected/b1e8bbba-7978-4536-8e7b-42b4764c0105-kube-api-access-kqbsl\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728052 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-hostroot\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.728612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-k8s-cni-cncf-io\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728105 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-host-slash\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-log-socket\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-etc-kubernetes\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728253 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-lib-modules\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728274 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-systemd\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728296 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-registration-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728320 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-system-cni-dir\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.729329 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.728356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-os-release\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.758343 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.758266 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 17:42:41 +0000 UTC" deadline="2028-01-09 04:32:09.545188661 +0000 UTC" Jun 03 17:47:42.758343 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.758297 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14026h44m26.786895032s" Jun 03 17:47:42.815864 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.815831 2570 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 17:47:42.830157 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830120 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-sys-fs\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.830324 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830174 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vz4bm\" (UniqueName: \"kubernetes.io/projected/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-kube-api-access-vz4bm\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.830324 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830207 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scsqv\" (UniqueName: \"kubernetes.io/projected/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-kube-api-access-scsqv\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.830324 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830257 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-system-cni-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.830324 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830281 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-kubernetes\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.830324 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830309 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-systemd\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.830592 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830428 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99e212e9-f032-4df6-8642-428e76496dfd-tmp\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.830592 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830486 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-kubelet\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.830592 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830525 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w4w7t\" (UniqueName: \"kubernetes.io/projected/355a496a-311c-48ac-b015-53aa82b57375-kube-api-access-w4w7t\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.830592 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830580 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kqbsl\" (UniqueName: \"kubernetes.io/projected/b1e8bbba-7978-4536-8e7b-42b4764c0105-kube-api-access-kqbsl\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.830786 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830608 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-hostroot\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.830786 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830665 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-k8s-cni-cncf-io\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.830786 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830709 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-host-slash\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.830786 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830745 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-log-socket\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.830977 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830813 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.830977 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830858 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.830977 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830909 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:42.831141 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830978 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-k8s-cni-cncf-io\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.831141 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830998 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-sys-fs\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.831141 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830983 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-etc-kubernetes\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.831141 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831036 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-etc-kubernetes\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.831141 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831048 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-lib-modules\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.831141 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831093 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-systemd\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.831447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831145 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-registration-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.831447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831158 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-lib-modules\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.831447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831186 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-system-cni-dir\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.831447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831222 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-os-release\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.831447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831278 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-var-lib-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.831447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831306 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-env-overrides\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.831447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831421 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-hostroot\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.831777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831451 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysctl-d\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.831777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831486 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-cni-netd\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.831777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831546 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-cni-netd\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.831777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831617 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-host-slash\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.831777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831669 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-log-socket\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.831777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831715 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.832048 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831789 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-system-cni-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.832048 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831915 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-kubernetes\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.832048 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.831996 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-systemd\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.832189 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832058 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-os-release\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.832189 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832101 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-modprobe-d\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.832189 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832129 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-etc-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.832189 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832161 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.832189 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832182 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-cni-binary-copy\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.832439 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832202 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.832439 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832225 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad544606-0cbc-4202-8d14-39fa80b7eea6-agent-certs\") pod \"konnectivity-agent-dphts\" (UID: \"ad544606-0cbc-4202-8d14-39fa80b7eea6\") " pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:42.832439 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832245 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-cnibin\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.832439 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832265 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-kubelet\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.832439 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.830936 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-kubelet\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.832678 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832550 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.832678 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832597 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-registration-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.832678 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832628 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-systemd\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.832678 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832629 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-system-cni-dir\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.832678 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832635 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 17:47:42.832902 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832710 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-cnibin\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.832902 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832738 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-os-release\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.832902 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832769 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.832902 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832814 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-etc-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.832902 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832844 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-modprobe-d\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.832902 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832851 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-kubelet\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.832902 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832888 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.833191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832925 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-os-release\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.833191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.832983 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-var-lib-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.833191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833067 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysctl-d\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.833191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833151 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysconfig\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.833363 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833255 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-cni-binary-copy\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.833363 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833266 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysconfig\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.833363 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833276 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-env-overrides\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.833363 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833316 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:42.833582 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833436 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-node-log\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.833582 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.833492 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:42.833582 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833501 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cae23931-e01c-415e-800d-321d8cc77390-ovn-node-metrics-cert\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.833582 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833537 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad544606-0cbc-4202-8d14-39fa80b7eea6-konnectivity-ca\") pod \"konnectivity-agent-dphts\" (UID: \"ad544606-0cbc-4202-8d14-39fa80b7eea6\") " pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:42.833764 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.833600 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs podName:b2fbf7b7-252b-4db4-958a-b9c2883808b9 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:43.333539058 +0000 UTC m=+3.051437142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs") pod "network-metrics-daemon-8qwfz" (UID: "b2fbf7b7-252b-4db4-958a-b9c2883808b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:42.833764 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833642 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-cni-multus\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.833764 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833668 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-conf-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.833764 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833697 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-run\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.833764 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833726 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-socket-dir-parent\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.833764 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833757 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-daemon-config\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833788 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-var-lib-kubelet\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833813 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99e212e9-f032-4df6-8642-428e76496dfd-etc-tuned\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833841 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-cni-binary-copy\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833871 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-iptables-alerter-script\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833901 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833930 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-netns\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833958 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-sys\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.833983 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqzpb\" (UniqueName: \"kubernetes.io/projected/99e212e9-f032-4df6-8642-428e76496dfd-kube-api-access-lqzpb\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834014 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-slash\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834044 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-ovnkube-script-lib\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834058 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad544606-0cbc-4202-8d14-39fa80b7eea6-konnectivity-ca\") pod \"konnectivity-agent-dphts\" (UID: \"ad544606-0cbc-4202-8d14-39fa80b7eea6\") " pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834072 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dvftn\" (UniqueName: \"kubernetes.io/projected/cae23931-e01c-415e-800d-321d8cc77390-kube-api-access-dvftn\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.834102 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834102 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-device-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834128 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gv9f8\" (UniqueName: \"kubernetes.io/projected/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-kube-api-access-gv9f8\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834134 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-node-log\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834156 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-cnibin\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834203 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e8bbba-7978-4536-8e7b-42b4764c0105-host\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834233 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-cni-bin\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834262 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-multus-certs\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834286 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834319 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834350 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-cni-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834383 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-ovn\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834429 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b1e8bbba-7978-4536-8e7b-42b4764c0105-serviceca\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834460 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-cni-bin\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834490 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysctl-conf\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834541 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-host\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834565 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-socket-dir-parent\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834581 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-host\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834594 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4gzx2\" (UniqueName: \"kubernetes.io/projected/b2fbf7b7-252b-4db4-958a-b9c2883808b9-kube-api-access-4gzx2\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:42.834719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834647 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-systemd-units\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834677 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-run-netns\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834704 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-iptables-alerter-script\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834768 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834798 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1e8bbba-7978-4536-8e7b-42b4764c0105-host\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834850 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-netns\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834881 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-cni-multus\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834906 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-sys\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834943 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-conf-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834997 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-run\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835003 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-slash\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835285 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-daemon-config\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835348 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-ovnkube-config\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835372 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-var-lib-kubelet\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835446 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-run-multus-certs\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835495 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-cni-bin\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.835537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835546 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-openvswitch\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.836233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835623 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-ovnkube-script-lib\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.836233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835693 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-device-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.836233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.835697 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355a496a-311c-48ac-b015-53aa82b57375-cnibin\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.836233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.836007 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/355a496a-311c-48ac-b015-53aa82b57375-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.836233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.836105 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-multus-cni-dir\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.836233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.836165 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-run-ovn\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.836532 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.836234 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-cni-binary-copy\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.836532 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.836359 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99e212e9-f032-4df6-8642-428e76496dfd-etc-sysctl-conf\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.836532 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.834708 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cae23931-e01c-415e-800d-321d8cc77390-ovnkube-config\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.836670 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.836588 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b1e8bbba-7978-4536-8e7b-42b4764c0105-serviceca\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.837164 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.837105 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad544606-0cbc-4202-8d14-39fa80b7eea6-agent-certs\") pod \"konnectivity-agent-dphts\" (UID: \"ad544606-0cbc-4202-8d14-39fa80b7eea6\") " pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:42.837368 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.837352 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-host-var-lib-cni-bin\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.837553 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.837530 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-systemd-units\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.837684 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.837662 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-socket-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.837770 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.837751 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cae23931-e01c-415e-800d-321d8cc77390-host-run-netns\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.837873 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.837856 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.838154 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99e212e9-f032-4df6-8642-428e76496dfd-etc-tuned\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.838176 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.838216 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.838231 2570 projected.go:194] Error preparing data for projected volume kube-api-access-6vpps for pod openshift-network-diagnostics/network-check-target-sjdwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:42.838304 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps podName:27eeb238-3d08-4a69-93ed-647589658ac7 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:43.338286671 +0000 UTC m=+3.056184746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6vpps" (UniqueName: "kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps") pod "network-check-target-sjdwg" (UID: "27eeb238-3d08-4a69-93ed-647589658ac7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.838447 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-socket-dir\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.837695 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99e212e9-f032-4df6-8642-428e76496dfd-tmp\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:42.838541 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.838495 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cae23931-e01c-415e-800d-321d8cc77390-ovn-node-metrics-cert\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.839105 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.839055 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.841113 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.840613 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4w7t\" (UniqueName: \"kubernetes.io/projected/355a496a-311c-48ac-b015-53aa82b57375-kube-api-access-w4w7t\") pod \"multus-additional-cni-plugins-pj5bw\" (UID: \"355a496a-311c-48ac-b015-53aa82b57375\") " pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:42.841513 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.841283 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scsqv\" (UniqueName: \"kubernetes.io/projected/a36482c6-7bcf-489e-ba9c-a73fd1d0be1c-kube-api-access-scsqv\") pod \"iptables-alerter-4245h\" (UID: \"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c\") " pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:42.841725 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.841703 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqbsl\" (UniqueName: \"kubernetes.io/projected/b1e8bbba-7978-4536-8e7b-42b4764c0105-kube-api-access-kqbsl\") pod \"node-ca-6r2b2\" (UID: \"b1e8bbba-7978-4536-8e7b-42b4764c0105\") " pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:42.842260 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.842234 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz4bm\" (UniqueName: \"kubernetes.io/projected/d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d-kube-api-access-vz4bm\") pod \"multus-kzmmh\" (UID: \"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d\") " pod="openshift-multus/multus-kzmmh" Jun 03 17:47:42.845624 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.845604 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gzx2\" (UniqueName: \"kubernetes.io/projected/b2fbf7b7-252b-4db4-958a-b9c2883808b9-kube-api-access-4gzx2\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:42.846733 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.846691 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv9f8\" (UniqueName: \"kubernetes.io/projected/41fe2ecb-948f-4163-bb4d-4e4452e6fa14-kube-api-access-gv9f8\") pod \"aws-ebs-csi-driver-node-n6ml2\" (UID: \"41fe2ecb-948f-4163-bb4d-4e4452e6fa14\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:42.847881 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.847843 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvftn\" (UniqueName: \"kubernetes.io/projected/cae23931-e01c-415e-800d-321d8cc77390-kube-api-access-dvftn\") pod \"ovnkube-node-cbbpw\" (UID: \"cae23931-e01c-415e-800d-321d8cc77390\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:42.848725 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:42.848687 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqzpb\" (UniqueName: \"kubernetes.io/projected/99e212e9-f032-4df6-8642-428e76496dfd-kube-api-access-lqzpb\") pod \"tuned-cpmqf\" (UID: \"99e212e9-f032-4df6-8642-428e76496dfd\") " pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:43.017228 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.017147 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4245h" Jun 03 17:47:43.023714 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.023687 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:47:43.033362 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.033337 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6r2b2" Jun 03 17:47:43.039058 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.039031 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kzmmh" Jun 03 17:47:43.047701 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.047674 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" Jun 03 17:47:43.056426 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.056400 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" Jun 03 17:47:43.064095 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.064072 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" Jun 03 17:47:43.070812 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.070780 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dphts" Jun 03 17:47:43.265174 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.265147 2570 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 17:47:43.342664 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.342585 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:43.342664 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.342641 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:43.342863 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:43.342740 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:47:43.342863 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:43.342754 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:47:43.342863 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:43.342754 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:43.342863 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:43.342811 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs podName:b2fbf7b7-252b-4db4-958a-b9c2883808b9 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:44.342797462 +0000 UTC m=+4.060695521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs") pod "network-metrics-daemon-8qwfz" (UID: "b2fbf7b7-252b-4db4-958a-b9c2883808b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:43.342863 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:43.342763 2570 projected.go:194] Error preparing data for projected volume kube-api-access-6vpps for pod openshift-network-diagnostics/network-check-target-sjdwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:43.343056 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:43.342900 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps podName:27eeb238-3d08-4a69-93ed-647589658ac7 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:44.342883188 +0000 UTC m=+4.060781270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vpps" (UniqueName: "kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps") pod "network-check-target-sjdwg" (UID: "27eeb238-3d08-4a69-93ed-647589658ac7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:43.592421 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:43.592369 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355a496a_311c_48ac_b015_53aa82b57375.slice/crio-997b5a3483473ab5264eb8220a8ab3915164acd786b6eea2840ab0d7df5ee41b WatchSource:0}: Error finding container 997b5a3483473ab5264eb8220a8ab3915164acd786b6eea2840ab0d7df5ee41b: Status 404 returned error can't find the container with id 997b5a3483473ab5264eb8220a8ab3915164acd786b6eea2840ab0d7df5ee41b Jun 03 17:47:43.598362 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:43.598340 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e8bbba_7978_4536_8e7b_42b4764c0105.slice/crio-3224f573ecd5bf95868b13b09468ff898a27599dd87dbda6a0f91024860debf4 WatchSource:0}: Error finding container 3224f573ecd5bf95868b13b09468ff898a27599dd87dbda6a0f91024860debf4: Status 404 returned error can't find the container with id 3224f573ecd5bf95868b13b09468ff898a27599dd87dbda6a0f91024860debf4 Jun 03 17:47:43.600229 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:43.599983 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad544606_0cbc_4202_8d14_39fa80b7eea6.slice/crio-6ff4f79a4c3d1cf97fc385f3ec56dad01b2f443f2b167d606155e0ab954e002f WatchSource:0}: Error finding container 6ff4f79a4c3d1cf97fc385f3ec56dad01b2f443f2b167d606155e0ab954e002f: Status 404 returned error can't find the container with id 6ff4f79a4c3d1cf97fc385f3ec56dad01b2f443f2b167d606155e0ab954e002f Jun 03 17:47:43.600943 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:43.600919 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41fe2ecb_948f_4163_bb4d_4e4452e6fa14.slice/crio-11801ac10513128110c316fd180f1ecfe80eeec350ef158d6ecc28347b067325 WatchSource:0}: Error finding container 11801ac10513128110c316fd180f1ecfe80eeec350ef158d6ecc28347b067325: Status 404 returned error can't find the container with id 11801ac10513128110c316fd180f1ecfe80eeec350ef158d6ecc28347b067325 Jun 03 17:47:43.603455 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:43.603431 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e212e9_f032_4df6_8642_428e76496dfd.slice/crio-90290fce631b3ad153bd1be5d715f0356a55b7cc685a47887013722f7c62f660 WatchSource:0}: Error finding container 90290fce631b3ad153bd1be5d715f0356a55b7cc685a47887013722f7c62f660: Status 404 returned error can't find the container with id 90290fce631b3ad153bd1be5d715f0356a55b7cc685a47887013722f7c62f660 Jun 03 17:47:43.605354 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:43.605180 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae23931_e01c_415e_800d_321d8cc77390.slice/crio-c9ae39116689494714b92b84ba7050cd82a2a1ec71b59e28fc432be6c2955788 WatchSource:0}: Error finding container c9ae39116689494714b92b84ba7050cd82a2a1ec71b59e28fc432be6c2955788: Status 404 returned error can't find the container with id c9ae39116689494714b92b84ba7050cd82a2a1ec71b59e28fc432be6c2955788 Jun 03 17:47:43.608801 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:47:43.608259 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36482c6_7bcf_489e_ba9c_a73fd1d0be1c.slice/crio-f0ab508dd1ae139b7fa0203c7402b63a08b5938b1bd063cc66cac831abec3a6e WatchSource:0}: Error finding container f0ab508dd1ae139b7fa0203c7402b63a08b5938b1bd063cc66cac831abec3a6e: Status 404 returned error can't find the container with id f0ab508dd1ae139b7fa0203c7402b63a08b5938b1bd063cc66cac831abec3a6e Jun 03 17:47:43.759476 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.759289 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 17:42:41 +0000 UTC" deadline="2028-02-19 11:11:07.465571424 +0000 UTC" Jun 03 17:47:43.759476 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.759470 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15017h23m23.706104577s" Jun 03 17:47:43.779936 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.779907 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" event={"ID":"41fe2ecb-948f-4163-bb4d-4e4452e6fa14","Type":"ContainerStarted","Data":"11801ac10513128110c316fd180f1ecfe80eeec350ef158d6ecc28347b067325"} Jun 03 17:47:43.781017 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.780989 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerStarted","Data":"997b5a3483473ab5264eb8220a8ab3915164acd786b6eea2840ab0d7df5ee41b"} Jun 03 17:47:43.782513 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.782491 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" event={"ID":"e4df10d4b37f7728e83844c976cd0de4","Type":"ContainerStarted","Data":"de93603a56d7d05a31f51c95b995bb35a0b26a534f73d9219e67604fe27ebfe1"} Jun 03 17:47:43.783757 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.783738 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4245h" event={"ID":"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c","Type":"ContainerStarted","Data":"f0ab508dd1ae139b7fa0203c7402b63a08b5938b1bd063cc66cac831abec3a6e"} Jun 03 17:47:43.785975 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.785953 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dphts" event={"ID":"ad544606-0cbc-4202-8d14-39fa80b7eea6","Type":"ContainerStarted","Data":"6ff4f79a4c3d1cf97fc385f3ec56dad01b2f443f2b167d606155e0ab954e002f"} Jun 03 17:47:43.786831 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.786809 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6r2b2" event={"ID":"b1e8bbba-7978-4536-8e7b-42b4764c0105","Type":"ContainerStarted","Data":"3224f573ecd5bf95868b13b09468ff898a27599dd87dbda6a0f91024860debf4"} Jun 03 17:47:43.788404 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.788373 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzmmh" event={"ID":"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d","Type":"ContainerStarted","Data":"c5d05f2bddca012c3c1dc5567dd0334e27ad72587f474050676f9259222ada9c"} Jun 03 17:47:43.789471 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.789447 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"c9ae39116689494714b92b84ba7050cd82a2a1ec71b59e28fc432be6c2955788"} Jun 03 17:47:43.790634 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:43.790609 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" event={"ID":"99e212e9-f032-4df6-8642-428e76496dfd","Type":"ContainerStarted","Data":"90290fce631b3ad153bd1be5d715f0356a55b7cc685a47887013722f7c62f660"} Jun 03 17:47:44.349894 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:44.349754 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:44.349894 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:44.349823 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:44.350133 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.349921 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:47:44.350133 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.349943 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:47:44.350133 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.349946 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:44.350133 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.349956 2570 projected.go:194] Error preparing data for projected volume kube-api-access-6vpps for pod openshift-network-diagnostics/network-check-target-sjdwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:44.350133 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.350020 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs podName:b2fbf7b7-252b-4db4-958a-b9c2883808b9 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:46.349983738 +0000 UTC m=+6.067881800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs") pod "network-metrics-daemon-8qwfz" (UID: "b2fbf7b7-252b-4db4-958a-b9c2883808b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:44.350133 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.350043 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps podName:27eeb238-3d08-4a69-93ed-647589658ac7 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:46.350029319 +0000 UTC m=+6.067927385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vpps" (UniqueName: "kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps") pod "network-check-target-sjdwg" (UID: "27eeb238-3d08-4a69-93ed-647589658ac7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:44.785816 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:44.785745 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:44.786369 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.785916 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:44.786369 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:44.785956 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:44.786369 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:44.786124 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:44.807725 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:44.807690 2570 generic.go:358] "Generic (PLEG): container finished" podID="bfe4fc6759c973c3d69648ff34e1ad6d" containerID="e097b63c7a9ffb1100dc39f62ce34cd456972a4c95e265c6e19b73871412c5ce" exitCode=0 Jun 03 17:47:44.808240 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:44.808218 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" event={"ID":"bfe4fc6759c973c3d69648ff34e1ad6d","Type":"ContainerDied","Data":"e097b63c7a9ffb1100dc39f62ce34cd456972a4c95e265c6e19b73871412c5ce"} Jun 03 17:47:44.822266 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:44.821127 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-111.ec2.internal" podStartSLOduration=2.82111317 podStartE2EDuration="2.82111317s" podCreationTimestamp="2026-06-03 17:47:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:47:43.796555217 +0000 UTC m=+3.514453298" watchObservedRunningTime="2026-06-03 17:47:44.82111317 +0000 UTC m=+4.539011252" Jun 03 17:47:45.820753 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:45.820108 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" event={"ID":"bfe4fc6759c973c3d69648ff34e1ad6d","Type":"ContainerStarted","Data":"3991dcc17a68a44c161fa0dd15e17b9eec4c988d35b60079b1452f850af96532"} Jun 03 17:47:46.367028 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:46.366983 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:46.367213 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:46.367044 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:46.367213 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.367164 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:46.367322 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.367226 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs podName:b2fbf7b7-252b-4db4-958a-b9c2883808b9 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:50.367207169 +0000 UTC m=+10.085105232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs") pod "network-metrics-daemon-8qwfz" (UID: "b2fbf7b7-252b-4db4-958a-b9c2883808b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:46.367659 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.367641 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:47:46.367755 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.367663 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:47:46.367755 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.367676 2570 projected.go:194] Error preparing data for projected volume kube-api-access-6vpps for pod openshift-network-diagnostics/network-check-target-sjdwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:46.367755 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.367720 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps podName:27eeb238-3d08-4a69-93ed-647589658ac7 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:50.367705068 +0000 UTC m=+10.085603129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vpps" (UniqueName: "kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps") pod "network-check-target-sjdwg" (UID: "27eeb238-3d08-4a69-93ed-647589658ac7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:46.773000 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:46.772912 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:46.773167 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.773052 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:46.773490 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:46.773466 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:46.773597 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:46.773566 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:48.773311 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:48.773274 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:48.773797 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:48.773435 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:48.773866 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:48.773824 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:48.773940 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:48.773911 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:50.397982 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:50.397936 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:50.398473 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:50.398007 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:50.398473 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.398110 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:50.398473 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.398125 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:47:50.398473 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.398153 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:47:50.398473 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.398167 2570 projected.go:194] Error preparing data for projected volume kube-api-access-6vpps for pod openshift-network-diagnostics/network-check-target-sjdwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:50.398473 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.398181 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs podName:b2fbf7b7-252b-4db4-958a-b9c2883808b9 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:58.398160769 +0000 UTC m=+18.116058836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs") pod "network-metrics-daemon-8qwfz" (UID: "b2fbf7b7-252b-4db4-958a-b9c2883808b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:50.398473 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.398223 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps podName:27eeb238-3d08-4a69-93ed-647589658ac7 nodeName:}" failed. No retries permitted until 2026-06-03 17:47:58.398205748 +0000 UTC m=+18.116103808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vpps" (UniqueName: "kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps") pod "network-check-target-sjdwg" (UID: "27eeb238-3d08-4a69-93ed-647589658ac7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:50.773573 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:50.773539 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:50.773836 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.773649 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:50.773836 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:50.773695 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:50.773956 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:50.773777 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:52.772518 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:52.772475 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:52.772989 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:52.772487 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:52.772989 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:52.772635 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:52.772989 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:52.772711 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:54.772349 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:54.772308 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:54.772854 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:54.772312 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:54.772854 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:54.772460 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:54.772854 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:54.772572 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:55.924121 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:55.924039 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-111.ec2.internal" podStartSLOduration=13.924021592999999 podStartE2EDuration="13.924021593s" podCreationTimestamp="2026-06-03 17:47:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:47:45.833765447 +0000 UTC m=+5.551663528" watchObservedRunningTime="2026-06-03 17:47:55.924021593 +0000 UTC m=+15.641919674" Jun 03 17:47:55.924707 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:55.924177 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2slbp"] Jun 03 17:47:55.928774 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:55.928752 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:55.928912 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:55.928835 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:47:56.039164 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.039120 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70cb0120-e80c-4202-bd77-2f23e425711a-kubelet-config\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.039438 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.039192 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70cb0120-e80c-4202-bd77-2f23e425711a-dbus\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.039438 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.039233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.140512 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.140471 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.140701 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.140604 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70cb0120-e80c-4202-bd77-2f23e425711a-kubelet-config\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.140701 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:56.140648 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:56.140701 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.140672 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70cb0120-e80c-4202-bd77-2f23e425711a-dbus\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.140860 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:56.140729 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret podName:70cb0120-e80c-4202-bd77-2f23e425711a nodeName:}" failed. No retries permitted until 2026-06-03 17:47:56.640706674 +0000 UTC m=+16.358604756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret") pod "global-pull-secret-syncer-2slbp" (UID: "70cb0120-e80c-4202-bd77-2f23e425711a") : object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:56.140860 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.140745 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/70cb0120-e80c-4202-bd77-2f23e425711a-kubelet-config\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.140938 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.140891 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/70cb0120-e80c-4202-bd77-2f23e425711a-dbus\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.644738 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.644693 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:56.644920 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:56.644840 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:56.644920 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:56.644906 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret podName:70cb0120-e80c-4202-bd77-2f23e425711a nodeName:}" failed. No retries permitted until 2026-06-03 17:47:57.644888024 +0000 UTC m=+17.362786082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret") pod "global-pull-secret-syncer-2slbp" (UID: "70cb0120-e80c-4202-bd77-2f23e425711a") : object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:56.775899 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.775858 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:56.775899 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:56.775874 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:56.776134 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:56.775982 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:56.776134 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:56.776107 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:57.650971 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:57.650940 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:57.651430 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:57.651094 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:57.651430 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:57.651170 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret podName:70cb0120-e80c-4202-bd77-2f23e425711a nodeName:}" failed. No retries permitted until 2026-06-03 17:47:59.651151188 +0000 UTC m=+19.369049250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret") pod "global-pull-secret-syncer-2slbp" (UID: "70cb0120-e80c-4202-bd77-2f23e425711a") : object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:57.773214 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:57.773171 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:57.773404 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:57.773301 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:47:58.456044 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:58.455998 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:58.456216 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.456148 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:58.456216 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:58.456161 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:58.456321 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.456224 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs podName:b2fbf7b7-252b-4db4-958a-b9c2883808b9 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:14.456202139 +0000 UTC m=+34.174100221 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs") pod "network-metrics-daemon-8qwfz" (UID: "b2fbf7b7-252b-4db4-958a-b9c2883808b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:47:58.456321 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.456301 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:47:58.456321 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.456319 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:47:58.456531 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.456331 2570 projected.go:194] Error preparing data for projected volume kube-api-access-6vpps for pod openshift-network-diagnostics/network-check-target-sjdwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:58.456531 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.456400 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps podName:27eeb238-3d08-4a69-93ed-647589658ac7 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:14.456371201 +0000 UTC m=+34.174269262 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vpps" (UniqueName: "kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps") pod "network-check-target-sjdwg" (UID: "27eeb238-3d08-4a69-93ed-647589658ac7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:47:58.775175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:58.775146 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:47:58.775175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:58.775161 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:47:58.775649 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.775257 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:47:58.775649 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:58.775413 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:47:59.661944 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:59.661906 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:59.662131 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:59.662035 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:59.662131 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:59.662110 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret podName:70cb0120-e80c-4202-bd77-2f23e425711a nodeName:}" failed. No retries permitted until 2026-06-03 17:48:03.662092076 +0000 UTC m=+23.379990148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret") pod "global-pull-secret-syncer-2slbp" (UID: "70cb0120-e80c-4202-bd77-2f23e425711a") : object "kube-system"/"original-pull-secret" not registered Jun 03 17:47:59.773146 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:47:59.773120 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:47:59.773317 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:47:59.773246 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:00.773489 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:00.773366 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:00.773935 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:00.773512 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:00.773935 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:00.773895 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:00.774061 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:00.773980 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:01.773697 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.772372 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:01.773697 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:01.772740 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:01.849298 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.849258 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6r2b2" event={"ID":"b1e8bbba-7978-4536-8e7b-42b4764c0105","Type":"ContainerStarted","Data":"1f5a5cc19e6553f20b06ad5c72272782e455a9af722d2a57d71ff953dce0c8db"} Jun 03 17:48:01.857108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.857021 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kzmmh" event={"ID":"d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d","Type":"ContainerStarted","Data":"f3256653f68bb6e9bec24fe35da16beb98f59e88bdc75cd44597390e1db83592"} Jun 03 17:48:01.859057 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.859029 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"d708a60a19e473634f34847c051203ab0d984bb2bf880452341bb0af73252d85"} Jun 03 17:48:01.860359 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.860334 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" event={"ID":"99e212e9-f032-4df6-8642-428e76496dfd","Type":"ContainerStarted","Data":"c9901b1631d6d629de439b4020ad6a141d4b3872279e935c1da8fa0d3b416e29"} Jun 03 17:48:01.862222 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.862175 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6r2b2" podStartSLOduration=3.9544274980000003 podStartE2EDuration="21.862162836s" podCreationTimestamp="2026-06-03 17:47:40 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.601014784 +0000 UTC m=+3.318912856" lastFinishedPulling="2026-06-03 17:48:01.50875012 +0000 UTC m=+21.226648194" observedRunningTime="2026-06-03 17:48:01.862147731 +0000 UTC m=+21.580045814" watchObservedRunningTime="2026-06-03 17:48:01.862162836 +0000 UTC m=+21.580060917" Jun 03 17:48:01.863024 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.862998 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" event={"ID":"41fe2ecb-948f-4163-bb4d-4e4452e6fa14","Type":"ContainerStarted","Data":"d4bf39f5e6fb0e98e06b30f9de4b9911f51e3c3245aee59c642ec421806809c3"} Jun 03 17:48:01.864308 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.864283 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerStarted","Data":"d70def24526cef055c52bf44acfb4beca4e295fb1e9ed826d17998588074e1fd"} Jun 03 17:48:01.866110 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.866019 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dphts" event={"ID":"ad544606-0cbc-4202-8d14-39fa80b7eea6","Type":"ContainerStarted","Data":"6620bc7df0d0ecda2832b095ac4a22023ab9568fa802347ad1df7a9b8a29c7d8"} Jun 03 17:48:01.878310 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.878129 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-kzmmh" podStartSLOduration=3.852882968 podStartE2EDuration="21.878109508s" podCreationTimestamp="2026-06-03 17:47:40 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.608740957 +0000 UTC m=+3.326639016" lastFinishedPulling="2026-06-03 17:48:01.633967494 +0000 UTC m=+21.351865556" observedRunningTime="2026-06-03 17:48:01.877863111 +0000 UTC m=+21.595761194" watchObservedRunningTime="2026-06-03 17:48:01.878109508 +0000 UTC m=+21.596007590" Jun 03 17:48:01.910043 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.909875 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cpmqf" podStartSLOduration=2.883491191 podStartE2EDuration="20.909860965s" podCreationTimestamp="2026-06-03 17:47:41 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.607946183 +0000 UTC m=+3.325844247" lastFinishedPulling="2026-06-03 17:48:01.634315955 +0000 UTC m=+21.352214021" observedRunningTime="2026-06-03 17:48:01.891364734 +0000 UTC m=+21.609262818" watchObservedRunningTime="2026-06-03 17:48:01.909860965 +0000 UTC m=+21.627759046" Jun 03 17:48:01.932474 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:01.932431 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dphts" podStartSLOduration=3.26001277 podStartE2EDuration="20.932416056s" podCreationTimestamp="2026-06-03 17:47:41 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.605531774 +0000 UTC m=+3.323429833" lastFinishedPulling="2026-06-03 17:48:01.277935056 +0000 UTC m=+20.995833119" observedRunningTime="2026-06-03 17:48:01.931951954 +0000 UTC m=+21.649850035" watchObservedRunningTime="2026-06-03 17:48:01.932416056 +0000 UTC m=+21.650314137" Jun 03 17:48:02.712231 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.712197 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dphts" Jun 03 17:48:02.772685 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.772663 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:02.772815 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:02.772796 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:02.772880 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.772853 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:02.772978 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:02.772959 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:02.784267 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.784247 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 17:48:02.793010 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.792943 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T17:48:02.784261835Z","UUID":"2b0f757d-91ff-4090-8698-d3c150061bdd","Handler":null,"Name":"","Endpoint":""} Jun 03 17:48:02.795858 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.795839 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 17:48:02.795950 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.795864 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 17:48:02.870500 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.870465 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"a6f4473c65089aa2d7d5cf1ca44fd9fde465645001698a4ed9a66ce6f8b2f22c"} Jun 03 17:48:02.870500 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.870500 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"fe80de565267328db18da99829273ff379730953bb4917f87654841b73d36889"} Jun 03 17:48:02.870685 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.870512 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"22a6132c05a5b920e1329670ca12a7117a962e56a476be3090f692650b5078f8"} Jun 03 17:48:02.870685 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.870525 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"e3f661f1fc65b1ef61a1cea30707ed911c4cee9a49a333a2445b5b27abbd0662"} Jun 03 17:48:02.870685 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.870537 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"0eebe6acafe8cc2c00e3b3a2b679837e9c2f837e861bdcf53e9d455875148a02"} Jun 03 17:48:02.871837 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.871815 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" event={"ID":"41fe2ecb-948f-4163-bb4d-4e4452e6fa14","Type":"ContainerStarted","Data":"1f291523fcdcbb1c1be1c40cd3794f032777462f53319790e14dd8d6f91d80d5"} Jun 03 17:48:02.875662 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.875634 2570 generic.go:358] "Generic (PLEG): container finished" podID="355a496a-311c-48ac-b015-53aa82b57375" containerID="d70def24526cef055c52bf44acfb4beca4e295fb1e9ed826d17998588074e1fd" exitCode=0 Jun 03 17:48:02.875773 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:02.875663 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerDied","Data":"d70def24526cef055c52bf44acfb4beca4e295fb1e9ed826d17998588074e1fd"} Jun 03 17:48:03.693126 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:03.693096 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:03.693269 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:03.693249 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 17:48:03.693339 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:03.693329 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret podName:70cb0120-e80c-4202-bd77-2f23e425711a nodeName:}" failed. No retries permitted until 2026-06-03 17:48:11.69330826 +0000 UTC m=+31.411206335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret") pod "global-pull-secret-syncer-2slbp" (UID: "70cb0120-e80c-4202-bd77-2f23e425711a") : object "kube-system"/"original-pull-secret" not registered Jun 03 17:48:03.772528 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:03.772499 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:03.772704 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:03.772599 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:03.880049 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:03.879953 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" event={"ID":"41fe2ecb-948f-4163-bb4d-4e4452e6fa14","Type":"ContainerStarted","Data":"e8a73ac417639f398254097d3a2e4d4d10289947be1c08dddef707dac77d0ef3"} Jun 03 17:48:03.881556 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:03.881527 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4245h" event={"ID":"a36482c6-7bcf-489e-ba9c-a73fd1d0be1c","Type":"ContainerStarted","Data":"1f30e660dcee3e64d485ed6051bb9c5857368fe86be3e34e6f1c4560bc811da3"} Jun 03 17:48:03.897247 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:03.897205 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6ml2" podStartSLOduration=2.885918779 podStartE2EDuration="22.89719175s" podCreationTimestamp="2026-06-03 17:47:41 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.60643551 +0000 UTC m=+3.324333569" lastFinishedPulling="2026-06-03 17:48:03.617708475 +0000 UTC m=+23.335606540" observedRunningTime="2026-06-03 17:48:03.897010875 +0000 UTC m=+23.614908956" watchObservedRunningTime="2026-06-03 17:48:03.89719175 +0000 UTC m=+23.615089831" Jun 03 17:48:03.912454 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:03.912406 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4245h" podStartSLOduration=5.888956454 podStartE2EDuration="23.912381819s" podCreationTimestamp="2026-06-03 17:47:40 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.610343713 +0000 UTC m=+3.328241776" lastFinishedPulling="2026-06-03 17:48:01.63376907 +0000 UTC m=+21.351667141" observedRunningTime="2026-06-03 17:48:03.912365366 +0000 UTC m=+23.630263446" watchObservedRunningTime="2026-06-03 17:48:03.912381819 +0000 UTC m=+23.630279901" Jun 03 17:48:04.773086 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:04.773054 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:04.773277 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:04.773049 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:04.773277 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:04.773184 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:04.773277 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:04.773229 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:04.886046 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:04.886008 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"4ebf3b930af66615fd76451890ad8e44487b7c242f93e7cc952712793352a807"} Jun 03 17:48:05.349368 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:05.349334 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dphts" Jun 03 17:48:05.349951 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:05.349928 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dphts" Jun 03 17:48:05.773226 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:05.773192 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:05.773424 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:05.773308 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:05.889085 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:05.889050 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dphts" Jun 03 17:48:06.772883 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:06.772650 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:06.773047 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:06.772652 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:06.773047 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:06.772991 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:06.773171 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:06.773080 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:07.772814 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.772723 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:07.773293 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:07.772845 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:07.894532 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.894495 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" event={"ID":"cae23931-e01c-415e-800d-321d8cc77390","Type":"ContainerStarted","Data":"d10aa923c300fbb83262405f46eb6dee451dd838b3be9ad8c42dbff0179e3485"} Jun 03 17:48:07.894876 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.894825 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:48:07.894876 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.894858 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:48:07.897724 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.897695 2570 generic.go:358] "Generic (PLEG): container finished" podID="355a496a-311c-48ac-b015-53aa82b57375" containerID="99a73e11333e76d0b0d36cb3ecef7c9678d23e2f74c66198c5df03ebd09ca7d5" exitCode=0 Jun 03 17:48:07.897832 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.897746 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerDied","Data":"99a73e11333e76d0b0d36cb3ecef7c9678d23e2f74c66198c5df03ebd09ca7d5"} Jun 03 17:48:07.912484 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.912464 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:48:07.915772 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.915756 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:48:07.960494 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:07.960454 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" podStartSLOduration=9.866846387 podStartE2EDuration="27.960442239s" podCreationTimestamp="2026-06-03 17:47:40 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.607561017 +0000 UTC m=+3.325459093" lastFinishedPulling="2026-06-03 17:48:01.701156872 +0000 UTC m=+21.419054945" observedRunningTime="2026-06-03 17:48:07.931274348 +0000 UTC m=+27.649172429" watchObservedRunningTime="2026-06-03 17:48:07.960442239 +0000 UTC m=+27.678340337" Jun 03 17:48:08.776009 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:08.775982 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:08.776358 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:08.775983 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:08.776358 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:08.776078 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:08.776358 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:08.776143 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:08.900567 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:08.900535 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:48:09.303739 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.303512 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sjdwg"] Jun 03 17:48:09.303871 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.303759 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:09.303871 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:09.303844 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:09.309108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.309081 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8qwfz"] Jun 03 17:48:09.309223 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.309168 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:09.309273 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:09.309259 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:09.315452 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.315428 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2slbp"] Jun 03 17:48:09.315559 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.315519 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:09.315603 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:09.315589 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:09.512369 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.512334 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5h67z"] Jun 03 17:48:09.529060 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.529031 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.531702 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.531680 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ct62s\"" Jun 03 17:48:09.532145 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.532126 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 17:48:09.532271 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.532256 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 17:48:09.640195 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.640108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b30786e0-7861-4e43-a57e-2c9d4000c330-hosts-file\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.640195 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.640150 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhncs\" (UniqueName: \"kubernetes.io/projected/b30786e0-7861-4e43-a57e-2c9d4000c330-kube-api-access-vhncs\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.640195 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.640185 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30786e0-7861-4e43-a57e-2c9d4000c330-tmp-dir\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.740674 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.740648 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b30786e0-7861-4e43-a57e-2c9d4000c330-hosts-file\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.740836 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.740688 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vhncs\" (UniqueName: \"kubernetes.io/projected/b30786e0-7861-4e43-a57e-2c9d4000c330-kube-api-access-vhncs\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.740836 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.740728 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30786e0-7861-4e43-a57e-2c9d4000c330-tmp-dir\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.740836 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.740769 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b30786e0-7861-4e43-a57e-2c9d4000c330-hosts-file\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.741120 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.741103 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b30786e0-7861-4e43-a57e-2c9d4000c330-tmp-dir\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.751586 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.751563 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhncs\" (UniqueName: \"kubernetes.io/projected/b30786e0-7861-4e43-a57e-2c9d4000c330-kube-api-access-vhncs\") pod \"node-resolver-5h67z\" (UID: \"b30786e0-7861-4e43-a57e-2c9d4000c330\") " pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.837823 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.837791 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5h67z" Jun 03 17:48:09.846035 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:09.846004 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb30786e0_7861_4e43_a57e_2c9d4000c330.slice/crio-49a4e82528a9c5c0816b1b19a2a4a15a573eda7fd76635030eedd3d6e1e25a07 WatchSource:0}: Error finding container 49a4e82528a9c5c0816b1b19a2a4a15a573eda7fd76635030eedd3d6e1e25a07: Status 404 returned error can't find the container with id 49a4e82528a9c5c0816b1b19a2a4a15a573eda7fd76635030eedd3d6e1e25a07 Jun 03 17:48:09.903898 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.903835 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5h67z" event={"ID":"b30786e0-7861-4e43-a57e-2c9d4000c330","Type":"ContainerStarted","Data":"49a4e82528a9c5c0816b1b19a2a4a15a573eda7fd76635030eedd3d6e1e25a07"} Jun 03 17:48:09.906118 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.906093 2570 generic.go:358] "Generic (PLEG): container finished" podID="355a496a-311c-48ac-b015-53aa82b57375" containerID="42c77ef6b5b74f4470e6526cca8a36eb0539012af61d4a112d5adf896878f939" exitCode=0 Jun 03 17:48:09.906332 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:09.906295 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerDied","Data":"42c77ef6b5b74f4470e6526cca8a36eb0539012af61d4a112d5adf896878f939"} Jun 03 17:48:10.775715 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:10.775674 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:10.775857 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:10.775680 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:10.775857 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:10.775764 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:10.775976 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:10.775854 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:10.775976 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:10.775680 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:10.776061 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:10.775977 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:10.911254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:10.911174 2570 generic.go:358] "Generic (PLEG): container finished" podID="355a496a-311c-48ac-b015-53aa82b57375" containerID="dc36fcc0cadfcb7cd7100d7c02883f88b69c2a1ec70c5e442a0d59c240030bb7" exitCode=0 Jun 03 17:48:10.912062 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:10.911249 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerDied","Data":"dc36fcc0cadfcb7cd7100d7c02883f88b69c2a1ec70c5e442a0d59c240030bb7"} Jun 03 17:48:10.912733 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:10.912704 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5h67z" event={"ID":"b30786e0-7861-4e43-a57e-2c9d4000c330","Type":"ContainerStarted","Data":"00604ab4144646dae02a87a250a86fb0eebcaa66acff4c4579256453e9fc4723"} Jun 03 17:48:10.951035 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:10.950982 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-5h67z" podStartSLOduration=1.950961817 podStartE2EDuration="1.950961817s" podCreationTimestamp="2026-06-03 17:48:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:48:10.950484574 +0000 UTC m=+30.668382667" watchObservedRunningTime="2026-06-03 17:48:10.950961817 +0000 UTC m=+30.668859898" Jun 03 17:48:11.756478 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:11.756256 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:11.756643 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:11.756422 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 17:48:11.756643 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:11.756556 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret podName:70cb0120-e80c-4202-bd77-2f23e425711a nodeName:}" failed. No retries permitted until 2026-06-03 17:48:27.756536017 +0000 UTC m=+47.474434083 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret") pod "global-pull-secret-syncer-2slbp" (UID: "70cb0120-e80c-4202-bd77-2f23e425711a") : object "kube-system"/"original-pull-secret" not registered Jun 03 17:48:12.772863 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:12.772829 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:12.773305 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:12.772829 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:12.773305 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:12.772958 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sjdwg" podUID="27eeb238-3d08-4a69-93ed-647589658ac7" Jun 03 17:48:12.773305 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:12.772829 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:12.773305 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:12.773059 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8qwfz" podUID="b2fbf7b7-252b-4db4-958a-b9c2883808b9" Jun 03 17:48:12.773305 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:12.773134 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2slbp" podUID="70cb0120-e80c-4202-bd77-2f23e425711a" Jun 03 17:48:14.475199 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.475160 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:14.475724 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.475218 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:14.475724 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.475334 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:48:14.475724 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.475358 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 17:48:14.475724 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.475401 2570 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 17:48:14.475724 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.475418 2570 projected.go:194] Error preparing data for projected volume kube-api-access-6vpps for pod openshift-network-diagnostics/network-check-target-sjdwg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:48:14.475724 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.475420 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs podName:b2fbf7b7-252b-4db4-958a-b9c2883808b9 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:46.47538546 +0000 UTC m=+66.193283533 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs") pod "network-metrics-daemon-8qwfz" (UID: "b2fbf7b7-252b-4db4-958a-b9c2883808b9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 17:48:14.475724 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.475469 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps podName:27eeb238-3d08-4a69-93ed-647589658ac7 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:46.475451385 +0000 UTC m=+66.193349461 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6vpps" (UniqueName: "kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps") pod "network-check-target-sjdwg" (UID: "27eeb238-3d08-4a69-93ed-647589658ac7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 17:48:14.593772 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.593743 2570 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-128-111.ec2.internal" event="NodeReady" Jun 03 17:48:14.593971 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.593872 2570 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 17:48:14.631858 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.631824 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-96f4f4fdc-mg5vn"] Jun 03 17:48:14.665020 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.664960 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2"] Jun 03 17:48:14.665256 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.665235 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.667839 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.667793 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 17:48:14.667966 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.667868 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 03 17:48:14.667966 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.667928 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 03 17:48:14.668082 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.668058 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 03 17:48:14.668132 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.668106 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 17:48:14.668275 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.668243 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x28px\"" Jun 03 17:48:14.668481 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.668455 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 03 17:48:14.680855 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.680835 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl"] Jun 03 17:48:14.681001 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.680983 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.683482 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.683459 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:48:14.683597 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.683459 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 17:48:14.683597 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.683504 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 17:48:14.683692 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.683595 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-68z24\"" Jun 03 17:48:14.683742 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.683734 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 17:48:14.700961 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.700934 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz"] Jun 03 17:48:14.701097 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.701081 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:14.703338 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.703308 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 17:48:14.703482 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.703338 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 17:48:14.703482 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.703451 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c24zv\"" Jun 03 17:48:14.727083 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.727018 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b4f77bc5-s6k6q"] Jun 03 17:48:14.727213 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.727172 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" Jun 03 17:48:14.729854 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.729829 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 17:48:14.729970 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.729869 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 17:48:14.729970 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.729963 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wzkdk\"" Jun 03 17:48:14.750236 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.750209 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fkn9v"] Jun 03 17:48:14.750403 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.750373 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.753235 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.753195 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 17:48:14.753339 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.753241 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 17:48:14.753339 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.753324 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 17:48:14.753463 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.753450 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q6pk8\"" Jun 03 17:48:14.758342 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.758318 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 17:48:14.765894 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.765875 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hs2sn"] Jun 03 17:48:14.766041 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.766021 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.768494 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.768330 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 17:48:14.768494 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.768374 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 17:48:14.768494 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.768478 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rng6v\"" Jun 03 17:48:14.777316 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:14.777423 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777326 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.777423 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777346 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5964a09e-9c25-4188-9ec7-e3693cbec143-config\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.777525 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777466 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctgf\" (UniqueName: \"kubernetes.io/projected/5964a09e-9c25-4188-9ec7-e3693cbec143-kube-api-access-8ctgf\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.777525 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777494 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-default-certificate\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.777525 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5964a09e-9c25-4188-9ec7-e3693cbec143-serving-cert\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.777647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777536 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-stats-auth\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.777647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777553 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jkxv\" (UniqueName: \"kubernetes.io/projected/c7ce78f4-1229-4f88-a5c1-d5893b88355b-kube-api-access-9jkxv\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.777647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777594 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.777647 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.777619 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:14.789998 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.789974 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:14.790115 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.790013 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:14.790439 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.790422 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:14.790571 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.790552 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:14.792641 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.792617 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 17:48:14.792712 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.792654 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nmvqr\"" Jun 03 17:48:14.792769 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.792622 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 17:48:14.792817 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.792778 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 17:48:14.792914 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.792889 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xgvk6\"" Jun 03 17:48:14.792914 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.792899 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 17:48:14.793019 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.792998 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 17:48:14.793070 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793025 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4bvb\"" Jun 03 17:48:14.793868 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793847 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2"] Jun 03 17:48:14.793949 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793876 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz"] Jun 03 17:48:14.793949 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793892 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl"] Jun 03 17:48:14.793949 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793903 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-96f4f4fdc-mg5vn"] Jun 03 17:48:14.793949 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793917 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hs2sn"] Jun 03 17:48:14.793949 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793926 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fkn9v"] Jun 03 17:48:14.793949 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.793933 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4f77bc5-s6k6q"] Jun 03 17:48:14.878431 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878382 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-stats-auth\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.878588 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878443 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jkxv\" (UniqueName: \"kubernetes.io/projected/c7ce78f4-1229-4f88-a5c1-d5893b88355b-kube-api-access-9jkxv\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.878588 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878471 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37831fa4-a454-49e3-8011-f527ff168e84-ca-trust-extracted\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.878588 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878515 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.878588 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878544 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:14.878588 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878571 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:14.878850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878601 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9bkt\" (UniqueName: \"kubernetes.io/projected/c8398a03-f682-4db0-8c48-63eabcf67597-kube-api-access-d9bkt\") pod \"network-check-source-56d84b9f44-xwprz\" (UID: \"c8398a03-f682-4db0-8c48-63eabcf67597\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" Jun 03 17:48:14.878850 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.878622 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 17:48:14.878850 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.878697 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:15.378678347 +0000 UTC m=+35.096576428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : secret "router-metrics-certs-default" not found Jun 03 17:48:14.878850 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.878702 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 17:48:14.878850 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.878760 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert podName:de9ae2ff-4dc9-41e0-86df-d1316b1f6f74 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:15.378743628 +0000 UTC m=+35.096641694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-kbgxl" (UID: "de9ae2ff-4dc9-41e0-86df-d1316b1f6f74") : secret "networking-console-plugin-cert" not found Jun 03 17:48:14.878850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-bound-sa-token\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.878850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878830 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878868 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5964a09e-9c25-4188-9ec7-e3693cbec143-config\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.878973 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:15.378957837 +0000 UTC m=+35.096855926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : configmap references non-existent config key: service-ca.crt Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.878995 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-trusted-ca\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-installation-pull-secrets\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879071 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879090 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f7495e-7130-47a3-b642-2eaf0e0323ce-tmp-dir\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879117 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-image-registry-private-configuration\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c75l7\" (UniqueName: \"kubernetes.io/projected/c0f7495e-7130-47a3-b642-2eaf0e0323ce-kube-api-access-c75l7\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879170 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5gmw\" (UniqueName: \"kubernetes.io/projected/9b62338f-c99c-4ba4-85f2-943e89c1e108-kube-api-access-h5gmw\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:14.879198 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879197 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0f7495e-7130-47a3-b642-2eaf0e0323ce-config-volume\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879235 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879288 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctgf\" (UniqueName: \"kubernetes.io/projected/5964a09e-9c25-4188-9ec7-e3693cbec143-kube-api-access-8ctgf\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q69kw\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-kube-api-access-q69kw\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879318 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5964a09e-9c25-4188-9ec7-e3693cbec143-config\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879361 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-default-certificate\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879424 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5964a09e-9c25-4188-9ec7-e3693cbec143-serving-cert\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879452 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.879691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.879481 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-registry-certificates\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.882491 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.882460 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5964a09e-9c25-4188-9ec7-e3693cbec143-serving-cert\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.882663 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.882631 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-stats-auth\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.882752 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.882730 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-default-certificate\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.887534 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.887515 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jkxv\" (UniqueName: \"kubernetes.io/projected/c7ce78f4-1229-4f88-a5c1-d5893b88355b-kube-api-access-9jkxv\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:14.888478 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.888436 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctgf\" (UniqueName: \"kubernetes.io/projected/5964a09e-9c25-4188-9ec7-e3693cbec143-kube-api-access-8ctgf\") pod \"service-ca-operator-69877444c-9zgj2\" (UID: \"5964a09e-9c25-4188-9ec7-e3693cbec143\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.980642 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980556 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-trusted-ca\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.980642 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980603 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-installation-pull-secrets\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.980642 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980622 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.980642 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980640 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f7495e-7130-47a3-b642-2eaf0e0323ce-tmp-dir\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980665 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-image-registry-private-configuration\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980683 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c75l7\" (UniqueName: \"kubernetes.io/projected/c0f7495e-7130-47a3-b642-2eaf0e0323ce-kube-api-access-c75l7\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980699 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5gmw\" (UniqueName: \"kubernetes.io/projected/9b62338f-c99c-4ba4-85f2-943e89c1e108-kube-api-access-h5gmw\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980718 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0f7495e-7130-47a3-b642-2eaf0e0323ce-config-volume\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980744 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980799 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q69kw\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-kube-api-access-q69kw\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980837 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980861 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-registry-certificates\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.980967 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980889 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37831fa4-a454-49e3-8011-f527ff168e84-ca-trust-extracted\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.981364 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.980978 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9bkt\" (UniqueName: \"kubernetes.io/projected/c8398a03-f682-4db0-8c48-63eabcf67597-kube-api-access-d9bkt\") pod \"network-check-source-56d84b9f44-xwprz\" (UID: \"c8398a03-f682-4db0-8c48-63eabcf67597\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" Jun 03 17:48:14.981364 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.981001 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-bound-sa-token\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.981364 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.980744 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 17:48:14.981364 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.981055 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0f7495e-7130-47a3-b642-2eaf0e0323ce-tmp-dir\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.982318 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.982292 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls podName:c0f7495e-7130-47a3-b642-2eaf0e0323ce nodeName:}" failed. No retries permitted until 2026-06-03 17:48:15.482254243 +0000 UTC m=+35.200152317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls") pod "dns-default-fkn9v" (UID: "c0f7495e-7130-47a3-b642-2eaf0e0323ce") : secret "dns-default-metrics-tls" not found Jun 03 17:48:14.982614 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.982467 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-registry-certificates\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.982691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.982677 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-trusted-ca\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.982743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.982701 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 17:48:14.982791 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.982715 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4f77bc5-s6k6q: secret "image-registry-tls" not found Jun 03 17:48:14.982791 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.980946 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 17:48:14.982883 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.982809 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls podName:37831fa4-a454-49e3-8011-f527ff168e84 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:15.482790819 +0000 UTC m=+35.200688882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls") pod "image-registry-b4f77bc5-s6k6q" (UID: "37831fa4-a454-49e3-8011-f527ff168e84") : secret "image-registry-tls" not found Jun 03 17:48:14.983001 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:14.982983 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert podName:9b62338f-c99c-4ba4-85f2-943e89c1e108 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:15.48295988 +0000 UTC m=+35.200857951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert") pod "ingress-canary-hs2sn" (UID: "9b62338f-c99c-4ba4-85f2-943e89c1e108") : secret "canary-serving-cert" not found Jun 03 17:48:14.983252 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.983219 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37831fa4-a454-49e3-8011-f527ff168e84-ca-trust-extracted\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.989950 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.989763 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-bound-sa-token\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.989950 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.989814 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c75l7\" (UniqueName: \"kubernetes.io/projected/c0f7495e-7130-47a3-b642-2eaf0e0323ce-kube-api-access-c75l7\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.989950 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.989903 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5gmw\" (UniqueName: \"kubernetes.io/projected/9b62338f-c99c-4ba4-85f2-943e89c1e108-kube-api-access-h5gmw\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:14.990324 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.990302 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9bkt\" (UniqueName: \"kubernetes.io/projected/c8398a03-f682-4db0-8c48-63eabcf67597-kube-api-access-d9bkt\") pod \"network-check-source-56d84b9f44-xwprz\" (UID: \"c8398a03-f682-4db0-8c48-63eabcf67597\") " pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" Jun 03 17:48:14.991004 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.990968 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q69kw\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-kube-api-access-q69kw\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.991089 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.991040 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" Jun 03 17:48:14.994093 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.994067 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0f7495e-7130-47a3-b642-2eaf0e0323ce-config-volume\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:14.996001 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.995983 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-installation-pull-secrets\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:14.996105 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:14.996087 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-image-registry-private-configuration\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:15.037233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:15.037178 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" Jun 03 17:48:15.384125 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:15.384033 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:15.384125 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:15.384094 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:15.384345 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.384208 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 17:48:15.384345 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:15.384267 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:15.384345 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.384285 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:16.384264842 +0000 UTC m=+36.102162919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : secret "router-metrics-certs-default" not found Jun 03 17:48:15.384345 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.384339 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 17:48:15.384624 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.384349 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:16.384339088 +0000 UTC m=+36.102237162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : configmap references non-existent config key: service-ca.crt Jun 03 17:48:15.384624 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.384410 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert podName:de9ae2ff-4dc9-41e0-86df-d1316b1f6f74 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:16.384379667 +0000 UTC m=+36.102277740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-kbgxl" (UID: "de9ae2ff-4dc9-41e0-86df-d1316b1f6f74") : secret "networking-console-plugin-cert" not found Jun 03 17:48:15.485513 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:15.485472 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:15.485574 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.485625 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:15.485686 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.485705 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert podName:9b62338f-c99c-4ba4-85f2-943e89c1e108 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:16.48568531 +0000 UTC m=+36.203583371 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert") pod "ingress-canary-hs2sn" (UID: "9b62338f-c99c-4ba4-85f2-943e89c1e108") : secret "canary-serving-cert" not found Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.485726 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.485746 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4f77bc5-s6k6q: secret "image-registry-tls" not found Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.485759 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.485796 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls podName:37831fa4-a454-49e3-8011-f527ff168e84 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:16.485780006 +0000 UTC m=+36.203678080 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls") pod "image-registry-b4f77bc5-s6k6q" (UID: "37831fa4-a454-49e3-8011-f527ff168e84") : secret "image-registry-tls" not found Jun 03 17:48:15.486037 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:15.485813 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls podName:c0f7495e-7130-47a3-b642-2eaf0e0323ce nodeName:}" failed. No retries permitted until 2026-06-03 17:48:16.485805069 +0000 UTC m=+36.203703134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls") pod "dns-default-fkn9v" (UID: "c0f7495e-7130-47a3-b642-2eaf0e0323ce") : secret "dns-default-metrics-tls" not found Jun 03 17:48:16.394630 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.394591 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:16.394828 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.394655 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:16.394828 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.394686 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:16.394828 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.394740 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 17:48:16.394828 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.394811 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:18.394791386 +0000 UTC m=+38.112689445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : secret "router-metrics-certs-default" not found Jun 03 17:48:16.394828 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.394823 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 17:48:16.395080 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.394847 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:18.394832459 +0000 UTC m=+38.112730523 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : configmap references non-existent config key: service-ca.crt Jun 03 17:48:16.395080 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.394880 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert podName:de9ae2ff-4dc9-41e0-86df-d1316b1f6f74 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:18.394863359 +0000 UTC m=+38.112761428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-kbgxl" (UID: "de9ae2ff-4dc9-41e0-86df-d1316b1f6f74") : secret "networking-console-plugin-cert" not found Jun 03 17:48:16.495283 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.495245 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:16.495283 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.495291 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.495331 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.495411 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.495472 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls podName:c0f7495e-7130-47a3-b642-2eaf0e0323ce nodeName:}" failed. No retries permitted until 2026-06-03 17:48:18.49545854 +0000 UTC m=+38.213356599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls") pod "dns-default-fkn9v" (UID: "c0f7495e-7130-47a3-b642-2eaf0e0323ce") : secret "dns-default-metrics-tls" not found Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.495479 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.495481 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.495532 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert podName:9b62338f-c99c-4ba4-85f2-943e89c1e108 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:18.495519773 +0000 UTC m=+38.213417838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert") pod "ingress-canary-hs2sn" (UID: "9b62338f-c99c-4ba4-85f2-943e89c1e108") : secret "canary-serving-cert" not found Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.495490 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4f77bc5-s6k6q: secret "image-registry-tls" not found Jun 03 17:48:16.495743 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:16.495578 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls podName:37831fa4-a454-49e3-8011-f527ff168e84 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:18.495567651 +0000 UTC m=+38.213465711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls") pod "image-registry-b4f77bc5-s6k6q" (UID: "37831fa4-a454-49e3-8011-f527ff168e84") : secret "image-registry-tls" not found Jun 03 17:48:16.680251 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.680067 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz"] Jun 03 17:48:16.682600 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.682548 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2"] Jun 03 17:48:16.683656 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:16.683628 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8398a03_f682_4db0_8c48_63eabcf67597.slice/crio-34f0b432376ab24b5b51e5da35c8f0755076cdd44ac17e41ace2d0f718c198c2 WatchSource:0}: Error finding container 34f0b432376ab24b5b51e5da35c8f0755076cdd44ac17e41ace2d0f718c198c2: Status 404 returned error can't find the container with id 34f0b432376ab24b5b51e5da35c8f0755076cdd44ac17e41ace2d0f718c198c2 Jun 03 17:48:16.687836 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:16.687812 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5964a09e_9c25_4188_9ec7_e3693cbec143.slice/crio-e0055daa48d704034ca793d491aeda4425eef2337448eec1294e85c1088c5f87 WatchSource:0}: Error finding container e0055daa48d704034ca793d491aeda4425eef2337448eec1294e85c1088c5f87: Status 404 returned error can't find the container with id e0055daa48d704034ca793d491aeda4425eef2337448eec1294e85c1088c5f87 Jun 03 17:48:16.925381 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.925352 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" event={"ID":"c8398a03-f682-4db0-8c48-63eabcf67597","Type":"ContainerStarted","Data":"34f0b432376ab24b5b51e5da35c8f0755076cdd44ac17e41ace2d0f718c198c2"} Jun 03 17:48:16.926351 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:16.926327 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" event={"ID":"5964a09e-9c25-4188-9ec7-e3693cbec143","Type":"ContainerStarted","Data":"e0055daa48d704034ca793d491aeda4425eef2337448eec1294e85c1088c5f87"} Jun 03 17:48:17.930246 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:17.930014 2570 generic.go:358] "Generic (PLEG): container finished" podID="355a496a-311c-48ac-b015-53aa82b57375" containerID="daebd03faace2a950360e4087d9f48a96f085a7ccfc5052917076dd41b842beb" exitCode=0 Jun 03 17:48:17.930719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:17.930090 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerDied","Data":"daebd03faace2a950360e4087d9f48a96f085a7ccfc5052917076dd41b842beb"} Jun 03 17:48:18.412991 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.412960 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:18.413162 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.412999 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:18.413162 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.413034 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:18.413162 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.413108 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 17:48:18.413262 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.413165 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:22.413151534 +0000 UTC m=+42.131049597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : secret "router-metrics-certs-default" not found Jun 03 17:48:18.413262 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.413166 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 17:48:18.413262 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.413180 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:22.413174452 +0000 UTC m=+42.131072510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : configmap references non-existent config key: service-ca.crt Jun 03 17:48:18.413262 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.413216 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert podName:de9ae2ff-4dc9-41e0-86df-d1316b1f6f74 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:22.413204115 +0000 UTC m=+42.131102175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-kbgxl" (UID: "de9ae2ff-4dc9-41e0-86df-d1316b1f6f74") : secret "networking-console-plugin-cert" not found Jun 03 17:48:18.513843 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.513804 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:18.514014 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.513861 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:18.514014 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.513934 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:18.514014 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.513985 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 17:48:18.514152 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.514030 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 17:48:18.514152 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.514058 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls podName:c0f7495e-7130-47a3-b642-2eaf0e0323ce nodeName:}" failed. No retries permitted until 2026-06-03 17:48:22.514037401 +0000 UTC m=+42.231935465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls") pod "dns-default-fkn9v" (UID: "c0f7495e-7130-47a3-b642-2eaf0e0323ce") : secret "dns-default-metrics-tls" not found Jun 03 17:48:18.514152 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.514090 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert podName:9b62338f-c99c-4ba4-85f2-943e89c1e108 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:22.514072855 +0000 UTC m=+42.231970917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert") pod "ingress-canary-hs2sn" (UID: "9b62338f-c99c-4ba4-85f2-943e89c1e108") : secret "canary-serving-cert" not found Jun 03 17:48:18.514152 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.514092 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 17:48:18.514152 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.514107 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4f77bc5-s6k6q: secret "image-registry-tls" not found Jun 03 17:48:18.514152 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:18.514150 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls podName:37831fa4-a454-49e3-8011-f527ff168e84 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:22.514137316 +0000 UTC m=+42.232035389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls") pod "image-registry-b4f77bc5-s6k6q" (UID: "37831fa4-a454-49e3-8011-f527ff168e84") : secret "image-registry-tls" not found Jun 03 17:48:18.935382 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.935345 2570 generic.go:358] "Generic (PLEG): container finished" podID="355a496a-311c-48ac-b015-53aa82b57375" containerID="9de810c72160facd8cf7060b18709b20bf75f7e4d58f048a2c92a7edd63f2da1" exitCode=0 Jun 03 17:48:18.935797 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:18.935430 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerDied","Data":"9de810c72160facd8cf7060b18709b20bf75f7e4d58f048a2c92a7edd63f2da1"} Jun 03 17:48:19.941468 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:19.941430 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" event={"ID":"355a496a-311c-48ac-b015-53aa82b57375","Type":"ContainerStarted","Data":"d48b2ba37febae9fd66c08067c7514fffe4b21392c09ba569efc9030f34833ec"} Jun 03 17:48:19.972879 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:19.972818 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pj5bw" podStartSLOduration=5.708883007 podStartE2EDuration="38.972801808s" podCreationTimestamp="2026-06-03 17:47:41 +0000 UTC" firstStartedPulling="2026-06-03 17:47:43.595303057 +0000 UTC m=+3.313201122" lastFinishedPulling="2026-06-03 17:48:16.85922185 +0000 UTC m=+36.577119923" observedRunningTime="2026-06-03 17:48:19.970939694 +0000 UTC m=+39.688837774" watchObservedRunningTime="2026-06-03 17:48:19.972801808 +0000 UTC m=+39.690699891" Jun 03 17:48:21.946882 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:21.946845 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" event={"ID":"c8398a03-f682-4db0-8c48-63eabcf67597","Type":"ContainerStarted","Data":"b186efa9b439968caf28da0b2148e12f94a0428dc10ebc52fc91e35dfb2b9b1b"} Jun 03 17:48:21.948064 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:21.948040 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" event={"ID":"5964a09e-9c25-4188-9ec7-e3693cbec143","Type":"ContainerStarted","Data":"0d4ee0aa72e3e0ec5f0d82e14b2074e9dcfc9673a22e734a009dd305b8a0c096"} Jun 03 17:48:21.962160 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:21.961978 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56d84b9f44-xwprz" podStartSLOduration=35.702770652 podStartE2EDuration="39.961960438s" podCreationTimestamp="2026-06-03 17:47:42 +0000 UTC" firstStartedPulling="2026-06-03 17:48:16.686015766 +0000 UTC m=+36.403913842" lastFinishedPulling="2026-06-03 17:48:20.945205568 +0000 UTC m=+40.663103628" observedRunningTime="2026-06-03 17:48:21.961726494 +0000 UTC m=+41.679624574" watchObservedRunningTime="2026-06-03 17:48:21.961960438 +0000 UTC m=+41.679858520" Jun 03 17:48:21.976338 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:21.976296 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" podStartSLOduration=35.729241023 podStartE2EDuration="39.976285355s" podCreationTimestamp="2026-06-03 17:47:42 +0000 UTC" firstStartedPulling="2026-06-03 17:48:16.689716441 +0000 UTC m=+36.407614503" lastFinishedPulling="2026-06-03 17:48:20.936760777 +0000 UTC m=+40.654658835" observedRunningTime="2026-06-03 17:48:21.975714046 +0000 UTC m=+41.693612128" watchObservedRunningTime="2026-06-03 17:48:21.976285355 +0000 UTC m=+41.694183466" Jun 03 17:48:22.450285 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:22.450232 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:22.450285 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:22.450288 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:22.450544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:22.450321 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:22.450544 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.450411 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 17:48:22.450544 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.450475 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:30.450460106 +0000 UTC m=+50.168358164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : secret "router-metrics-certs-default" not found Jun 03 17:48:22.450544 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.450492 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 17:48:22.450544 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.450509 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:30.450494272 +0000 UTC m=+50.168392346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : configmap references non-existent config key: service-ca.crt Jun 03 17:48:22.450544 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.450548 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert podName:de9ae2ff-4dc9-41e0-86df-d1316b1f6f74 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:30.450538787 +0000 UTC m=+50.168436853 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-kbgxl" (UID: "de9ae2ff-4dc9-41e0-86df-d1316b1f6f74") : secret "networking-console-plugin-cert" not found Jun 03 17:48:22.551347 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:22.551249 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:22.551347 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:22.551295 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:22.551347 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:22.551335 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:22.551686 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.551442 2570 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 17:48:22.551686 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.551442 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 17:48:22.551686 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.551459 2570 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 17:48:22.551686 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.551454 2570 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b4f77bc5-s6k6q: secret "image-registry-tls" not found Jun 03 17:48:22.551686 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.551521 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls podName:c0f7495e-7130-47a3-b642-2eaf0e0323ce nodeName:}" failed. No retries permitted until 2026-06-03 17:48:30.551499232 +0000 UTC m=+50.269397291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls") pod "dns-default-fkn9v" (UID: "c0f7495e-7130-47a3-b642-2eaf0e0323ce") : secret "dns-default-metrics-tls" not found Jun 03 17:48:22.551686 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.551539 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert podName:9b62338f-c99c-4ba4-85f2-943e89c1e108 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:30.551530265 +0000 UTC m=+50.269428331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert") pod "ingress-canary-hs2sn" (UID: "9b62338f-c99c-4ba4-85f2-943e89c1e108") : secret "canary-serving-cert" not found Jun 03 17:48:22.551686 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:22.551554 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls podName:37831fa4-a454-49e3-8011-f527ff168e84 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:30.551546586 +0000 UTC m=+50.269444648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls") pod "image-registry-b4f77bc5-s6k6q" (UID: "37831fa4-a454-49e3-8011-f527ff168e84") : secret "image-registry-tls" not found Jun 03 17:48:24.320969 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.320936 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-knj8h"] Jun 03 17:48:24.323130 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.323114 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.325752 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.325728 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 17:48:24.325752 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.325730 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 17:48:24.325913 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.325759 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 17:48:24.326564 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.326551 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 17:48:24.326612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.326569 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bhlbf\"" Jun 03 17:48:24.330847 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.330829 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-knj8h"] Jun 03 17:48:24.365127 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.365094 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws2pd\" (UniqueName: \"kubernetes.io/projected/146ba189-83a1-42ca-ada7-defac4a9bf04-kube-api-access-ws2pd\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.365274 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.365153 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/146ba189-83a1-42ca-ada7-defac4a9bf04-signing-cabundle\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.365274 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.365255 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/146ba189-83a1-42ca-ada7-defac4a9bf04-signing-key\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.422572 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.422538 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch"] Jun 03 17:48:24.424311 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.424296 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.426636 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.426613 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 17:48:24.426756 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.426740 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 17:48:24.426901 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.426880 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 17:48:24.426901 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.426892 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vbqlj\"" Jun 03 17:48:24.426988 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.426883 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 17:48:24.429675 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.429656 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r"] Jun 03 17:48:24.431383 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.431364 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h"] Jun 03 17:48:24.431852 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.431589 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.433506 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.433487 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch"] Jun 03 17:48:24.433583 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.433571 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.433877 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.433858 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 17:48:24.435756 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.435740 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 17:48:24.435855 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.435831 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 17:48:24.435927 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.435914 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 17:48:24.435978 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.435928 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 17:48:24.444263 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.444245 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h"] Jun 03 17:48:24.446537 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.446517 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r"] Jun 03 17:48:24.465604 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465577 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.465698 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465606 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqjg5\" (UniqueName: \"kubernetes.io/projected/bd175ccb-9e6c-4163-a31f-5262906b6a5c-kube-api-access-wqjg5\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.465698 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465628 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c71528-6144-4206-8e9e-7bc22781732d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d7c7996f6-7jsch\" (UID: \"d5c71528-6144-4206-8e9e-7bc22781732d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.465698 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465653 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/96903f05-6f24-4637-97bb-a13c4ad5192c-klusterlet-config\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.465919 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465704 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ws2pd\" (UniqueName: \"kubernetes.io/projected/146ba189-83a1-42ca-ada7-defac4a9bf04-kube-api-access-ws2pd\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.465919 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-hub\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.465919 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cdlh\" (UniqueName: \"kubernetes.io/projected/96903f05-6f24-4637-97bb-a13c4ad5192c-kube-api-access-4cdlh\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.465919 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465838 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/146ba189-83a1-42ca-ada7-defac4a9bf04-signing-cabundle\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.465919 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465888 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-ca\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.465919 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465913 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/146ba189-83a1-42ca-ada7-defac4a9bf04-signing-key\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.466211 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465969 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8jrk\" (UniqueName: \"kubernetes.io/projected/d5c71528-6144-4206-8e9e-7bc22781732d-kube-api-access-f8jrk\") pod \"managed-serviceaccount-addon-agent-d7c7996f6-7jsch\" (UID: \"d5c71528-6144-4206-8e9e-7bc22781732d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.466211 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.465989 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/bd175ccb-9e6c-4163-a31f-5262906b6a5c-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.466211 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.466005 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.466211 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.466022 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96903f05-6f24-4637-97bb-a13c4ad5192c-tmp\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.466452 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.466433 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/146ba189-83a1-42ca-ada7-defac4a9bf04-signing-cabundle\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.469366 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.469345 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/146ba189-83a1-42ca-ada7-defac4a9bf04-signing-key\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.473152 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.473131 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws2pd\" (UniqueName: \"kubernetes.io/projected/146ba189-83a1-42ca-ada7-defac4a9bf04-kube-api-access-ws2pd\") pod \"service-ca-685df94d57-knj8h\" (UID: \"146ba189-83a1-42ca-ada7-defac4a9bf04\") " pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.567142 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567108 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-hub\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.567142 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567143 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cdlh\" (UniqueName: \"kubernetes.io/projected/96903f05-6f24-4637-97bb-a13c4ad5192c-kube-api-access-4cdlh\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.567376 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567193 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-ca\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.567376 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567241 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f8jrk\" (UniqueName: \"kubernetes.io/projected/d5c71528-6144-4206-8e9e-7bc22781732d-kube-api-access-f8jrk\") pod \"managed-serviceaccount-addon-agent-d7c7996f6-7jsch\" (UID: \"d5c71528-6144-4206-8e9e-7bc22781732d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.567376 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567274 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/bd175ccb-9e6c-4163-a31f-5262906b6a5c-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.567376 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567300 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.567376 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567323 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96903f05-6f24-4637-97bb-a13c4ad5192c-tmp\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.567376 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567355 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.567709 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567415 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqjg5\" (UniqueName: \"kubernetes.io/projected/bd175ccb-9e6c-4163-a31f-5262906b6a5c-kube-api-access-wqjg5\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.567709 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567463 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c71528-6144-4206-8e9e-7bc22781732d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d7c7996f6-7jsch\" (UID: \"d5c71528-6144-4206-8e9e-7bc22781732d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.567709 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.567494 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/96903f05-6f24-4637-97bb-a13c4ad5192c-klusterlet-config\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.568064 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.568038 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/bd175ccb-9e6c-4163-a31f-5262906b6a5c-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.568187 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.568165 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96903f05-6f24-4637-97bb-a13c4ad5192c-tmp\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.570226 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.570200 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-ca\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.570435 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.570411 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-hub\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.574119 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.570804 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/96903f05-6f24-4637-97bb-a13c4ad5192c-klusterlet-config\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.574119 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.570852 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.574119 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.571165 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/bd175ccb-9e6c-4163-a31f-5262906b6a5c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.574119 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.571695 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d5c71528-6144-4206-8e9e-7bc22781732d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-d7c7996f6-7jsch\" (UID: \"d5c71528-6144-4206-8e9e-7bc22781732d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.576380 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.576357 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8jrk\" (UniqueName: \"kubernetes.io/projected/d5c71528-6144-4206-8e9e-7bc22781732d-kube-api-access-f8jrk\") pod \"managed-serviceaccount-addon-agent-d7c7996f6-7jsch\" (UID: \"d5c71528-6144-4206-8e9e-7bc22781732d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.576506 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.576489 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cdlh\" (UniqueName: \"kubernetes.io/projected/96903f05-6f24-4637-97bb-a13c4ad5192c-kube-api-access-4cdlh\") pod \"klusterlet-addon-workmgr-686776fdb9-dv57r\" (UID: \"96903f05-6f24-4637-97bb-a13c4ad5192c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.576653 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.576633 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqjg5\" (UniqueName: \"kubernetes.io/projected/bd175ccb-9e6c-4163-a31f-5262906b6a5c-kube-api-access-wqjg5\") pod \"cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h\" (UID: \"bd175ccb-9e6c-4163-a31f-5262906b6a5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.632617 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.632577 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-knj8h" Jun 03 17:48:24.744093 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.744058 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" Jun 03 17:48:24.749478 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.749439 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-knj8h"] Jun 03 17:48:24.751792 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:24.751769 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146ba189_83a1_42ca_ada7_defac4a9bf04.slice/crio-f942ec6748f3eb1ea9d3e17704a7dc5f966c7454c7631570b0d0f5c89625dfe4 WatchSource:0}: Error finding container f942ec6748f3eb1ea9d3e17704a7dc5f966c7454c7631570b0d0f5c89625dfe4: Status 404 returned error can't find the container with id f942ec6748f3eb1ea9d3e17704a7dc5f966c7454c7631570b0d0f5c89625dfe4 Jun 03 17:48:24.753091 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.753066 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:24.758447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.758424 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:48:24.892930 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.892789 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch"] Jun 03 17:48:24.895328 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:24.895299 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5c71528_6144_4206_8e9e_7bc22781732d.slice/crio-9728a5082c86a3c0f299640640c6452fd19f5f53dc838753ee963a4514056748 WatchSource:0}: Error finding container 9728a5082c86a3c0f299640640c6452fd19f5f53dc838753ee963a4514056748: Status 404 returned error can't find the container with id 9728a5082c86a3c0f299640640c6452fd19f5f53dc838753ee963a4514056748 Jun 03 17:48:24.914746 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.914724 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r"] Jun 03 17:48:24.917507 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:24.917481 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96903f05_6f24_4637_97bb_a13c4ad5192c.slice/crio-298a875ba3de4a3d843474f8a5d54a8113d7ecda3d4d4ef5c5db8937e4f114c8 WatchSource:0}: Error finding container 298a875ba3de4a3d843474f8a5d54a8113d7ecda3d4d4ef5c5db8937e4f114c8: Status 404 returned error can't find the container with id 298a875ba3de4a3d843474f8a5d54a8113d7ecda3d4d4ef5c5db8937e4f114c8 Jun 03 17:48:24.954819 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.954791 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" event={"ID":"96903f05-6f24-4637-97bb-a13c4ad5192c","Type":"ContainerStarted","Data":"298a875ba3de4a3d843474f8a5d54a8113d7ecda3d4d4ef5c5db8937e4f114c8"} Jun 03 17:48:24.955750 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.955731 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" event={"ID":"d5c71528-6144-4206-8e9e-7bc22781732d","Type":"ContainerStarted","Data":"9728a5082c86a3c0f299640640c6452fd19f5f53dc838753ee963a4514056748"} Jun 03 17:48:24.957022 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.956996 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-knj8h" event={"ID":"146ba189-83a1-42ca-ada7-defac4a9bf04","Type":"ContainerStarted","Data":"fe99514fd4e5e55ac9b83eb078163e066815c18b2c4475750427652ed2e51123"} Jun 03 17:48:24.957108 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.957023 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-knj8h" event={"ID":"146ba189-83a1-42ca-ada7-defac4a9bf04","Type":"ContainerStarted","Data":"f942ec6748f3eb1ea9d3e17704a7dc5f966c7454c7631570b0d0f5c89625dfe4"} Jun 03 17:48:24.975498 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:24.975462 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-knj8h" podStartSLOduration=0.975450571 podStartE2EDuration="975.450571ms" podCreationTimestamp="2026-06-03 17:48:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:48:24.974448117 +0000 UTC m=+44.692346198" watchObservedRunningTime="2026-06-03 17:48:24.975450571 +0000 UTC m=+44.693348652" Jun 03 17:48:25.114486 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:25.114405 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h"] Jun 03 17:48:25.117193 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:25.117164 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd175ccb_9e6c_4163_a31f_5262906b6a5c.slice/crio-d81c57cb077c7f9c1cacb60f508d08aed8b608a2e1447af464dd7c2507315b94 WatchSource:0}: Error finding container d81c57cb077c7f9c1cacb60f508d08aed8b608a2e1447af464dd7c2507315b94: Status 404 returned error can't find the container with id d81c57cb077c7f9c1cacb60f508d08aed8b608a2e1447af464dd7c2507315b94 Jun 03 17:48:25.961954 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:25.961860 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" event={"ID":"bd175ccb-9e6c-4163-a31f-5262906b6a5c","Type":"ContainerStarted","Data":"d81c57cb077c7f9c1cacb60f508d08aed8b608a2e1447af464dd7c2507315b94"} Jun 03 17:48:27.817963 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:27.817919 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:27.826081 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:27.826028 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/70cb0120-e80c-4202-bd77-2f23e425711a-original-pull-secret\") pod \"global-pull-secret-syncer-2slbp\" (UID: \"70cb0120-e80c-4202-bd77-2f23e425711a\") " pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:28.016159 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:28.016116 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2slbp" Jun 03 17:48:30.548545 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.548481 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:30.548545 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.548535 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:30.549129 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.548608 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:30.549129 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:30.548656 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 17:48:30.549129 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:30.548736 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 03 17:48:30.549129 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:30.548743 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:46.548717211 +0000 UTC m=+66.266615275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : configmap references non-existent config key: service-ca.crt Jun 03 17:48:30.549129 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:30.548773 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert podName:de9ae2ff-4dc9-41e0-86df-d1316b1f6f74 nodeName:}" failed. No retries permitted until 2026-06-03 17:48:46.548762572 +0000 UTC m=+66.266660632 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert") pod "networking-console-plugin-76c9bb5fdf-kbgxl" (UID: "de9ae2ff-4dc9-41e0-86df-d1316b1f6f74") : secret "networking-console-plugin-cert" not found Jun 03 17:48:30.549129 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:48:30.548794 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs podName:c7ce78f4-1229-4f88-a5c1-d5893b88355b nodeName:}" failed. No retries permitted until 2026-06-03 17:48:46.548781361 +0000 UTC m=+66.266679419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs") pod "router-default-96f4f4fdc-mg5vn" (UID: "c7ce78f4-1229-4f88-a5c1-d5893b88355b") : secret "router-metrics-certs-default" not found Jun 03 17:48:30.649289 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.649253 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:30.649489 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.649313 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:30.649489 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.649373 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:30.651625 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.651598 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0f7495e-7130-47a3-b642-2eaf0e0323ce-metrics-tls\") pod \"dns-default-fkn9v\" (UID: \"c0f7495e-7130-47a3-b642-2eaf0e0323ce\") " pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:30.651888 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.651859 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b62338f-c99c-4ba4-85f2-943e89c1e108-cert\") pod \"ingress-canary-hs2sn\" (UID: \"9b62338f-c99c-4ba4-85f2-943e89c1e108\") " pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:30.651932 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.651859 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"image-registry-b4f77bc5-s6k6q\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:30.660709 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.660674 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:30.675485 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.675467 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:30.701810 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:30.701787 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hs2sn" Jun 03 17:48:33.406091 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.406023 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2slbp"] Jun 03 17:48:33.503378 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.503278 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hs2sn"] Jun 03 17:48:33.506208 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:33.506150 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b62338f_c99c_4ba4_85f2_943e89c1e108.slice/crio-3492e7327621d39599dac9c7136532109c3c16d2b4447e5d2a77c83e95ab566d WatchSource:0}: Error finding container 3492e7327621d39599dac9c7136532109c3c16d2b4447e5d2a77c83e95ab566d: Status 404 returned error can't find the container with id 3492e7327621d39599dac9c7136532109c3c16d2b4447e5d2a77c83e95ab566d Jun 03 17:48:33.723218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.723188 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fkn9v"] Jun 03 17:48:33.726102 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:33.726068 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f7495e_7130_47a3_b642_2eaf0e0323ce.slice/crio-8cac08e552fea21de6c19183ae548aa506e9aedeec0221b20075982bc5a7a360 WatchSource:0}: Error finding container 8cac08e552fea21de6c19183ae548aa506e9aedeec0221b20075982bc5a7a360: Status 404 returned error can't find the container with id 8cac08e552fea21de6c19183ae548aa506e9aedeec0221b20075982bc5a7a360 Jun 03 17:48:33.726493 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.726472 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4f77bc5-s6k6q"] Jun 03 17:48:33.729298 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:33.729276 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37831fa4_a454_49e3_8011_f527ff168e84.slice/crio-a1bf6b936cc7bebb1c30b2f882af82964517290e6e95548ea8f8fc7b27f0531e WatchSource:0}: Error finding container a1bf6b936cc7bebb1c30b2f882af82964517290e6e95548ea8f8fc7b27f0531e: Status 404 returned error can't find the container with id a1bf6b936cc7bebb1c30b2f882af82964517290e6e95548ea8f8fc7b27f0531e Jun 03 17:48:33.994481 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.994366 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" event={"ID":"bd175ccb-9e6c-4163-a31f-5262906b6a5c","Type":"ContainerStarted","Data":"5792caff726b96d00e43b9081953a3f48505afe706145837d2910d48aab959dc"} Jun 03 17:48:33.995542 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.995514 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2slbp" event={"ID":"70cb0120-e80c-4202-bd77-2f23e425711a","Type":"ContainerStarted","Data":"007e5cba3610d02ec5d41c6b85fbcec6bebcb78ec081a415432db17e664e0995"} Jun 03 17:48:33.997292 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.997253 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" event={"ID":"96903f05-6f24-4637-97bb-a13c4ad5192c","Type":"ContainerStarted","Data":"14ce3f1b5747d72830aedf06edfa4f366d388710e8e1747b728ebcc87e2ae813"} Jun 03 17:48:33.997652 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.997621 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:33.999199 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.999171 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" event={"ID":"37831fa4-a454-49e3-8011-f527ff168e84","Type":"ContainerStarted","Data":"0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7"} Jun 03 17:48:33.999322 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.999202 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" event={"ID":"37831fa4-a454-49e3-8011-f527ff168e84","Type":"ContainerStarted","Data":"a1bf6b936cc7bebb1c30b2f882af82964517290e6e95548ea8f8fc7b27f0531e"} Jun 03 17:48:33.999322 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.999279 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:33.999930 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:33.999911 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" Jun 03 17:48:34.001360 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:34.001319 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" event={"ID":"d5c71528-6144-4206-8e9e-7bc22781732d","Type":"ContainerStarted","Data":"5d1a0126c9fdf7a3faa587b5a1a5cbfed5a087b06b9ee55e00fd3e9d482d3bed"} Jun 03 17:48:34.002636 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:34.002602 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fkn9v" event={"ID":"c0f7495e-7130-47a3-b642-2eaf0e0323ce","Type":"ContainerStarted","Data":"8cac08e552fea21de6c19183ae548aa506e9aedeec0221b20075982bc5a7a360"} Jun 03 17:48:34.003929 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:34.003907 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hs2sn" event={"ID":"9b62338f-c99c-4ba4-85f2-943e89c1e108","Type":"ContainerStarted","Data":"3492e7327621d39599dac9c7136532109c3c16d2b4447e5d2a77c83e95ab566d"} Jun 03 17:48:34.015092 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:34.015044 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-686776fdb9-dv57r" podStartSLOduration=1.599199713 podStartE2EDuration="10.015028015s" podCreationTimestamp="2026-06-03 17:48:24 +0000 UTC" firstStartedPulling="2026-06-03 17:48:24.919049849 +0000 UTC m=+44.636947911" lastFinishedPulling="2026-06-03 17:48:33.33487814 +0000 UTC m=+53.052776213" observedRunningTime="2026-06-03 17:48:34.014826873 +0000 UTC m=+53.732724955" watchObservedRunningTime="2026-06-03 17:48:34.015028015 +0000 UTC m=+53.732926097" Jun 03 17:48:34.031301 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:34.031251 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-d7c7996f6-7jsch" podStartSLOduration=1.583597606 podStartE2EDuration="10.031236428s" podCreationTimestamp="2026-06-03 17:48:24 +0000 UTC" firstStartedPulling="2026-06-03 17:48:24.897319715 +0000 UTC m=+44.615217774" lastFinishedPulling="2026-06-03 17:48:33.344958532 +0000 UTC m=+53.062856596" observedRunningTime="2026-06-03 17:48:34.030742807 +0000 UTC m=+53.748640888" watchObservedRunningTime="2026-06-03 17:48:34.031236428 +0000 UTC m=+53.749134508" Jun 03 17:48:34.052935 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:34.052874 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" podStartSLOduration=53.052854223 podStartE2EDuration="53.052854223s" podCreationTimestamp="2026-06-03 17:47:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:48:34.052281314 +0000 UTC m=+53.770179395" watchObservedRunningTime="2026-06-03 17:48:34.052854223 +0000 UTC m=+53.770752305" Jun 03 17:48:39.924655 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:39.924620 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbbpw" Jun 03 17:48:40.026558 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.026514 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" event={"ID":"bd175ccb-9e6c-4163-a31f-5262906b6a5c","Type":"ContainerStarted","Data":"4081a9ec734af7f951cd4c3abb26eef0df5132490880171ff558d80cda354a9c"} Jun 03 17:48:40.026558 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.026563 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" event={"ID":"bd175ccb-9e6c-4163-a31f-5262906b6a5c","Type":"ContainerStarted","Data":"e5454bf7da7c9b5530f83cce7c11b4454989793ba9e3405744e911a75376004a"} Jun 03 17:48:40.027876 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.027852 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2slbp" event={"ID":"70cb0120-e80c-4202-bd77-2f23e425711a","Type":"ContainerStarted","Data":"7b316be25238053a5f2451a56a73378529e372e2f216be9b8d50a95bcb5fa3c5"} Jun 03 17:48:40.029306 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.029279 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fkn9v" event={"ID":"c0f7495e-7130-47a3-b642-2eaf0e0323ce","Type":"ContainerStarted","Data":"b4166708a36507f935a037771f8e038b7ebd29cd2bc1cc0f540bfb2ee729bb2a"} Jun 03 17:48:40.029424 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.029312 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fkn9v" event={"ID":"c0f7495e-7130-47a3-b642-2eaf0e0323ce","Type":"ContainerStarted","Data":"0d310bc6976f5e3fed45ebf357e12fe62104ae84895a7c69a8a45afb7abea2a6"} Jun 03 17:48:40.029487 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.029440 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:40.030598 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.030572 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hs2sn" event={"ID":"9b62338f-c99c-4ba4-85f2-943e89c1e108","Type":"ContainerStarted","Data":"cb4ad9ca92d6a938ef18c8af15e3193d1962ebd5afa6094b366ad405d6a4904f"} Jun 03 17:48:40.047112 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.047065 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" podStartSLOduration=2.074615965 podStartE2EDuration="16.047052308s" podCreationTimestamp="2026-06-03 17:48:24 +0000 UTC" firstStartedPulling="2026-06-03 17:48:25.118941541 +0000 UTC m=+44.836839603" lastFinishedPulling="2026-06-03 17:48:39.091377873 +0000 UTC m=+58.809275946" observedRunningTime="2026-06-03 17:48:40.046780988 +0000 UTC m=+59.764679066" watchObservedRunningTime="2026-06-03 17:48:40.047052308 +0000 UTC m=+59.764950389" Jun 03 17:48:40.062462 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.062415 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2slbp" podStartSLOduration=39.064192576 podStartE2EDuration="45.06240176s" podCreationTimestamp="2026-06-03 17:47:55 +0000 UTC" firstStartedPulling="2026-06-03 17:48:33.434088377 +0000 UTC m=+53.151986441" lastFinishedPulling="2026-06-03 17:48:39.432297549 +0000 UTC m=+59.150195625" observedRunningTime="2026-06-03 17:48:40.061539267 +0000 UTC m=+59.779437348" watchObservedRunningTime="2026-06-03 17:48:40.06240176 +0000 UTC m=+59.780299833" Jun 03 17:48:40.078677 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.078633 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fkn9v" podStartSLOduration=20.720507339 podStartE2EDuration="26.078621178s" podCreationTimestamp="2026-06-03 17:48:14 +0000 UTC" firstStartedPulling="2026-06-03 17:48:33.727932046 +0000 UTC m=+53.445830105" lastFinishedPulling="2026-06-03 17:48:39.08604587 +0000 UTC m=+58.803943944" observedRunningTime="2026-06-03 17:48:40.077316663 +0000 UTC m=+59.795214743" watchObservedRunningTime="2026-06-03 17:48:40.078621178 +0000 UTC m=+59.796519258" Jun 03 17:48:40.093085 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:40.093037 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hs2sn" podStartSLOduration=20.516699492 podStartE2EDuration="26.09302356s" podCreationTimestamp="2026-06-03 17:48:14 +0000 UTC" firstStartedPulling="2026-06-03 17:48:33.50837153 +0000 UTC m=+53.226269588" lastFinishedPulling="2026-06-03 17:48:39.08469558 +0000 UTC m=+58.802593656" observedRunningTime="2026-06-03 17:48:40.09214439 +0000 UTC m=+59.810042471" watchObservedRunningTime="2026-06-03 17:48:40.09302356 +0000 UTC m=+59.810921669" Jun 03 17:48:44.537831 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.537785 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq"] Jun 03 17:48:44.559904 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.559866 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt"] Jun 03 17:48:44.560052 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.560018 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.562645 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.562620 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2jlwb\"" Jun 03 17:48:44.563588 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.563554 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 17:48:44.563706 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.563597 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 17:48:44.563706 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.563654 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:48:44.573777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.573757 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt"] Jun 03 17:48:44.573870 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.573782 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq"] Jun 03 17:48:44.573870 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.573862 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" Jun 03 17:48:44.576289 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.576271 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:48:44.576289 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.576283 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 03 17:48:44.576464 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.576407 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-q8h9h\"" Jun 03 17:48:44.639517 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.639482 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-t75km"] Jun 03 17:48:44.641782 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.641738 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t"] Jun 03 17:48:44.641922 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.641859 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.643619 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.643598 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g"] Jun 03 17:48:44.643779 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.643745 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.644772 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.644754 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 03 17:48:44.645157 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.645137 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 17:48:44.645338 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.645320 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 03 17:48:44.645416 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.645360 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 17:48:44.645527 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.645507 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-m2tkc"] Jun 03 17:48:44.645675 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.645655 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5z8lf\"" Jun 03 17:48:44.645770 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.645681 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.647618 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.647602 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.650708 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.650689 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:48:44.650947 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.650929 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 03 17:48:44.651059 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.651016 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 03 17:48:44.651338 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.651314 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-f6z8k\"" Jun 03 17:48:44.651523 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.651502 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 03 17:48:44.652174 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.652150 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 17:48:44.652260 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.652159 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 03 17:48:44.653707 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.653687 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 17:48:44.653986 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.653969 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 17:48:44.654356 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.654336 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 17:48:44.654888 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.654852 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 17:48:44.655195 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.655174 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cpmb5\"" Jun 03 17:48:44.655530 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.655501 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hv4rm\"" Jun 03 17:48:44.655809 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.655791 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 17:48:44.655901 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.655801 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 17:48:44.656207 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.656186 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 17:48:44.661929 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.661906 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t"] Jun 03 17:48:44.662254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.662236 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 17:48:44.662981 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.662964 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-t75km"] Jun 03 17:48:44.663938 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.663918 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g"] Jun 03 17:48:44.673697 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.673672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cd36fa0-e1e9-4cd2-8586-4c86af79f33e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fcdwq\" (UID: \"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.673839 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.673719 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qmbs\" (UniqueName: \"kubernetes.io/projected/9cd36fa0-e1e9-4cd2-8586-4c86af79f33e-kube-api-access-9qmbs\") pod \"cluster-samples-operator-755bbf9bfb-fcdwq\" (UID: \"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.673839 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.673750 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncg6j\" (UniqueName: \"kubernetes.io/projected/8c3629d2-357d-4dbc-9c10-1ef19c1d18b7-kube-api-access-ncg6j\") pod \"volume-data-source-validator-7598fd5bd-t5fdt\" (UID: \"8c3629d2-357d-4dbc-9c10-1ef19c1d18b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" Jun 03 17:48:44.681813 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.681793 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-m2tkc"] Jun 03 17:48:44.761167 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.761112 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" podUID="bd175ccb-9e6c-4163-a31f-5262906b6a5c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 17:48:44.774483 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bknd4\" (UniqueName: \"kubernetes.io/projected/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-kube-api-access-bknd4\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.774635 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774493 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e52b19e-4980-4291-a671-3036fcd75ce9-config\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.774635 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774519 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f40eb91-2641-4602-8322-cb0b7b89947c-tmp\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.774635 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774546 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/607adca6-6c2b-457e-b325-c05ec6df1ea4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.774635 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774595 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cd36fa0-e1e9-4cd2-8586-4c86af79f33e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fcdwq\" (UID: \"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.774827 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twnj8\" (UniqueName: \"kubernetes.io/projected/6e52b19e-4980-4291-a671-3036fcd75ce9-kube-api-access-twnj8\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.774827 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774797 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f40eb91-2641-4602-8322-cb0b7b89947c-snapshots\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.774914 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.774914 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774897 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9qmbs\" (UniqueName: \"kubernetes.io/projected/9cd36fa0-e1e9-4cd2-8586-4c86af79f33e-kube-api-access-9qmbs\") pod \"cluster-samples-operator-755bbf9bfb-fcdwq\" (UID: \"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.775000 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774946 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ncg6j\" (UniqueName: \"kubernetes.io/projected/8c3629d2-357d-4dbc-9c10-1ef19c1d18b7-kube-api-access-ncg6j\") pod \"volume-data-source-validator-7598fd5bd-t5fdt\" (UID: \"8c3629d2-357d-4dbc-9c10-1ef19c1d18b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" Jun 03 17:48:44.775000 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.774981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e52b19e-4980-4291-a671-3036fcd75ce9-serving-cert\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.775101 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f40eb91-2641-4602-8322-cb0b7b89947c-service-ca-bundle\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.775155 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkxl5\" (UniqueName: \"kubernetes.io/projected/607adca6-6c2b-457e-b325-c05ec6df1ea4-kube-api-access-jkxl5\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.775261 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775242 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e52b19e-4980-4291-a671-3036fcd75ce9-trusted-ca\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.775347 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775305 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f40eb91-2641-4602-8322-cb0b7b89947c-serving-cert\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.775347 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775334 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.775480 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775418 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4kjc\" (UniqueName: \"kubernetes.io/projected/7f40eb91-2641-4602-8322-cb0b7b89947c-kube-api-access-n4kjc\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.775480 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775443 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f40eb91-2641-4602-8322-cb0b7b89947c-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.775590 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.775479 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/607adca6-6c2b-457e-b325-c05ec6df1ea4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.777478 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.777458 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cd36fa0-e1e9-4cd2-8586-4c86af79f33e-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-fcdwq\" (UID: \"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.788598 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.788545 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncg6j\" (UniqueName: \"kubernetes.io/projected/8c3629d2-357d-4dbc-9c10-1ef19c1d18b7-kube-api-access-ncg6j\") pod \"volume-data-source-validator-7598fd5bd-t5fdt\" (UID: \"8c3629d2-357d-4dbc-9c10-1ef19c1d18b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" Jun 03 17:48:44.788598 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.788547 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qmbs\" (UniqueName: \"kubernetes.io/projected/9cd36fa0-e1e9-4cd2-8586-4c86af79f33e-kube-api-access-9qmbs\") pod \"cluster-samples-operator-755bbf9bfb-fcdwq\" (UID: \"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.869660 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.869631 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" Jun 03 17:48:44.876565 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876533 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f40eb91-2641-4602-8322-cb0b7b89947c-service-ca-bundle\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.876695 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876589 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jkxl5\" (UniqueName: \"kubernetes.io/projected/607adca6-6c2b-457e-b325-c05ec6df1ea4-kube-api-access-jkxl5\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.876695 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876640 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e52b19e-4980-4291-a671-3036fcd75ce9-trusted-ca\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.876695 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876687 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f40eb91-2641-4602-8322-cb0b7b89947c-serving-cert\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.876862 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876717 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.876862 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876769 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n4kjc\" (UniqueName: \"kubernetes.io/projected/7f40eb91-2641-4602-8322-cb0b7b89947c-kube-api-access-n4kjc\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.876862 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876802 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f40eb91-2641-4602-8322-cb0b7b89947c-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.876862 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876830 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/607adca6-6c2b-457e-b325-c05ec6df1ea4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.877058 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876896 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bknd4\" (UniqueName: \"kubernetes.io/projected/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-kube-api-access-bknd4\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.877058 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876925 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e52b19e-4980-4291-a671-3036fcd75ce9-config\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.877058 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876952 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f40eb91-2641-4602-8322-cb0b7b89947c-tmp\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.877058 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.876996 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/607adca6-6c2b-457e-b325-c05ec6df1ea4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.877058 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.877028 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twnj8\" (UniqueName: \"kubernetes.io/projected/6e52b19e-4980-4291-a671-3036fcd75ce9-kube-api-access-twnj8\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.877342 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.877066 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f40eb91-2641-4602-8322-cb0b7b89947c-snapshots\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.877342 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.877096 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.877342 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.877145 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e52b19e-4980-4291-a671-3036fcd75ce9-serving-cert\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.877342 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.877309 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f40eb91-2641-4602-8322-cb0b7b89947c-service-ca-bundle\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.877826 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.877804 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f40eb91-2641-4602-8322-cb0b7b89947c-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.878511 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.878325 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f40eb91-2641-4602-8322-cb0b7b89947c-snapshots\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.878575 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.878553 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e52b19e-4980-4291-a671-3036fcd75ce9-trusted-ca\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.878644 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.878622 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.878702 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.878652 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/607adca6-6c2b-457e-b325-c05ec6df1ea4-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.879028 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.878982 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e52b19e-4980-4291-a671-3036fcd75ce9-config\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.879028 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.879000 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f40eb91-2641-4602-8322-cb0b7b89947c-tmp\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.879983 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.879950 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f40eb91-2641-4602-8322-cb0b7b89947c-serving-cert\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.880168 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.880150 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/607adca6-6c2b-457e-b325-c05ec6df1ea4-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.880777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.880756 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e52b19e-4980-4291-a671-3036fcd75ce9-serving-cert\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.881191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.881167 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.882912 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.882884 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" Jun 03 17:48:44.885511 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.885488 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkxl5\" (UniqueName: \"kubernetes.io/projected/607adca6-6c2b-457e-b325-c05ec6df1ea4-kube-api-access-jkxl5\") pod \"kube-storage-version-migrator-operator-96ddc787c-z8v2t\" (UID: \"607adca6-6c2b-457e-b325-c05ec6df1ea4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.885933 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.885913 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4kjc\" (UniqueName: \"kubernetes.io/projected/7f40eb91-2641-4602-8322-cb0b7b89947c-kube-api-access-n4kjc\") pod \"insights-operator-788bf58df5-t75km\" (UID: \"7f40eb91-2641-4602-8322-cb0b7b89947c\") " pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.886193 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.886167 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bknd4\" (UniqueName: \"kubernetes.io/projected/4f4df5bb-10aa-4ec0-8c34-4f332e88b48d-kube-api-access-bknd4\") pod \"cluster-monitoring-operator-69b6cbdb88-vzx5g\" (UID: \"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.886476 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.886460 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twnj8\" (UniqueName: \"kubernetes.io/projected/6e52b19e-4980-4291-a671-3036fcd75ce9-kube-api-access-twnj8\") pod \"console-operator-86d7c6cc77-m2tkc\" (UID: \"6e52b19e-4980-4291-a671-3036fcd75ce9\") " pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:44.961937 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.961494 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-t75km" Jun 03 17:48:44.962825 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.962253 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" Jun 03 17:48:44.972083 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.972038 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" Jun 03 17:48:44.976350 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:44.976326 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:45.067604 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:45.067532 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq"] Jun 03 17:48:45.090744 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:45.090714 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt"] Jun 03 17:48:45.146677 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:45.146649 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-t75km"] Jun 03 17:48:45.149681 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:45.149649 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f40eb91_2641_4602_8322_cb0b7b89947c.slice/crio-2ee3101842d5543e08315318ed245ebcfe63cad08479e139209f32881aacb211 WatchSource:0}: Error finding container 2ee3101842d5543e08315318ed245ebcfe63cad08479e139209f32881aacb211: Status 404 returned error can't find the container with id 2ee3101842d5543e08315318ed245ebcfe63cad08479e139209f32881aacb211 Jun 03 17:48:45.166924 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:45.166894 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t"] Jun 03 17:48:45.169359 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:45.169335 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607adca6_6c2b_457e_b325_c05ec6df1ea4.slice/crio-a5c8f9661418a320354334409804ad67b257aab1cd1c5cacae4dbb57c5cf339f WatchSource:0}: Error finding container a5c8f9661418a320354334409804ad67b257aab1cd1c5cacae4dbb57c5cf339f: Status 404 returned error can't find the container with id a5c8f9661418a320354334409804ad67b257aab1cd1c5cacae4dbb57c5cf339f Jun 03 17:48:45.183209 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:45.183185 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g"] Jun 03 17:48:45.186697 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:45.186671 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4df5bb_10aa_4ec0_8c34_4f332e88b48d.slice/crio-94f669e03d70a0327d3c55dc3a3a49858b6b3277aa40fdf7db634c339fb52c03 WatchSource:0}: Error finding container 94f669e03d70a0327d3c55dc3a3a49858b6b3277aa40fdf7db634c339fb52c03: Status 404 returned error can't find the container with id 94f669e03d70a0327d3c55dc3a3a49858b6b3277aa40fdf7db634c339fb52c03 Jun 03 17:48:45.203912 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:45.203878 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-m2tkc"] Jun 03 17:48:45.206699 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:45.206674 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e52b19e_4980_4291_a671_3036fcd75ce9.slice/crio-63295ed7c806e8ec8affca116c53ef39eba052d8f79a0246d8add1818bfff726 WatchSource:0}: Error finding container 63295ed7c806e8ec8affca116c53ef39eba052d8f79a0246d8add1818bfff726: Status 404 returned error can't find the container with id 63295ed7c806e8ec8affca116c53ef39eba052d8f79a0246d8add1818bfff726 Jun 03 17:48:46.055523 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.055442 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-t75km" event={"ID":"7f40eb91-2641-4602-8322-cb0b7b89947c","Type":"ContainerStarted","Data":"2ee3101842d5543e08315318ed245ebcfe63cad08479e139209f32881aacb211"} Jun 03 17:48:46.059060 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.058998 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" event={"ID":"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e","Type":"ContainerStarted","Data":"6c6173977c6789b89a3ed919e67f652249c357cf97c400b883eeff3f85ecc3ca"} Jun 03 17:48:46.061497 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.061437 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" event={"ID":"607adca6-6c2b-457e-b325-c05ec6df1ea4","Type":"ContainerStarted","Data":"a5c8f9661418a320354334409804ad67b257aab1cd1c5cacae4dbb57c5cf339f"} Jun 03 17:48:46.067719 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.067549 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" event={"ID":"6e52b19e-4980-4291-a671-3036fcd75ce9","Type":"ContainerStarted","Data":"63295ed7c806e8ec8affca116c53ef39eba052d8f79a0246d8add1818bfff726"} Jun 03 17:48:46.070699 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.070609 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" event={"ID":"8c3629d2-357d-4dbc-9c10-1ef19c1d18b7","Type":"ContainerStarted","Data":"97a185f3042f512403a01cfc5dd63aa5355df92bd1c630bd4681ce0261eeb131"} Jun 03 17:48:46.078376 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.078334 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" event={"ID":"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d","Type":"ContainerStarted","Data":"94f669e03d70a0327d3c55dc3a3a49858b6b3277aa40fdf7db634c339fb52c03"} Jun 03 17:48:46.503434 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.501225 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:46.503434 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.501300 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:46.505865 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.504151 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 17:48:46.505865 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.505193 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vpps\" (UniqueName: \"kubernetes.io/projected/27eeb238-3d08-4a69-93ed-647589658ac7-kube-api-access-6vpps\") pod \"network-check-target-sjdwg\" (UID: \"27eeb238-3d08-4a69-93ed-647589658ac7\") " pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:46.518836 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.518778 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b2fbf7b7-252b-4db4-958a-b9c2883808b9-metrics-certs\") pod \"network-metrics-daemon-8qwfz\" (UID: \"b2fbf7b7-252b-4db4-958a-b9c2883808b9\") " pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:46.603413 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.602721 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:46.603413 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.602880 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:46.603413 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.602923 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:46.604082 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.604034 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7ce78f4-1229-4f88-a5c1-d5893b88355b-service-ca-bundle\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:46.609680 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.609280 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/de9ae2ff-4dc9-41e0-86df-d1316b1f6f74-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-kbgxl\" (UID: \"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:46.610726 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.610701 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7ce78f4-1229-4f88-a5c1-d5893b88355b-metrics-certs\") pod \"router-default-96f4f4fdc-mg5vn\" (UID: \"c7ce78f4-1229-4f88-a5c1-d5893b88355b\") " pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:46.612035 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.611797 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xgvk6\"" Jun 03 17:48:46.620550 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.620108 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:46.625691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.625458 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p4bvb\"" Jun 03 17:48:46.634141 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.633748 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8qwfz" Jun 03 17:48:46.780523 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.780253 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x28px\"" Jun 03 17:48:46.788446 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.788423 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:46.813911 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.813884 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c24zv\"" Jun 03 17:48:46.822002 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:46.821975 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" Jun 03 17:48:49.618082 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:49.617886 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-96f4f4fdc-mg5vn"] Jun 03 17:48:49.640088 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:49.640037 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sjdwg"] Jun 03 17:48:49.650366 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:49.650337 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27eeb238_3d08_4a69_93ed_647589658ac7.slice/crio-7c2551f49a5950e7e16ecea97f8549615e3db84c618c979cfc25d5fff6e4f75e WatchSource:0}: Error finding container 7c2551f49a5950e7e16ecea97f8549615e3db84c618c979cfc25d5fff6e4f75e: Status 404 returned error can't find the container with id 7c2551f49a5950e7e16ecea97f8549615e3db84c618c979cfc25d5fff6e4f75e Jun 03 17:48:49.664028 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:49.662704 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8qwfz"] Jun 03 17:48:49.674262 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:49.674191 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl"] Jun 03 17:48:50.036753 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.036718 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fkn9v" Jun 03 17:48:50.092851 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.092812 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-t75km" event={"ID":"7f40eb91-2641-4602-8322-cb0b7b89947c","Type":"ContainerStarted","Data":"e13b47807861b0acec55310dfd7cd60bf1091da6ccf29a0e02ddfbb34ee7fecb"} Jun 03 17:48:50.094945 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.094913 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" event={"ID":"8c3629d2-357d-4dbc-9c10-1ef19c1d18b7","Type":"ContainerStarted","Data":"efedfcdbf6f0efc0b5bfbb5fb90ce47282836d59f289abb34031ba7832e2d444"} Jun 03 17:48:50.099144 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.099114 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" event={"ID":"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e","Type":"ContainerStarted","Data":"fddafa994fe6eac9f9efaaada76e36d3e4b7634d97e8107c953de9c563b87d9d"} Jun 03 17:48:50.099284 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.099151 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" event={"ID":"9cd36fa0-e1e9-4cd2-8586-4c86af79f33e","Type":"ContainerStarted","Data":"d40fc32f353a9a7d071c9944879c5e2ebb2181b31cfb58f22ea51ea18fd8646f"} Jun 03 17:48:50.101267 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.101234 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" event={"ID":"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74","Type":"ContainerStarted","Data":"71f36636e39bb24b04b2514940ee10bf2026e02d71b05c63f3225677ca507582"} Jun 03 17:48:50.102944 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.102921 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qwfz" event={"ID":"b2fbf7b7-252b-4db4-958a-b9c2883808b9","Type":"ContainerStarted","Data":"d04eaa4199fc2531ace6a0dcdc6dccb30424d1adb9def8cfbe0a881e7444b863"} Jun 03 17:48:50.104905 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.104872 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" event={"ID":"607adca6-6c2b-457e-b325-c05ec6df1ea4","Type":"ContainerStarted","Data":"1ce4eee141b2fe2363e27ae2f7f4de2a19f63043f7d15628f81e95f9f7673a82"} Jun 03 17:48:50.107269 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.107246 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sjdwg" event={"ID":"27eeb238-3d08-4a69-93ed-647589658ac7","Type":"ContainerStarted","Data":"e52760fa53fa888b85c82947b432fcaaa7a219d5d80e210acfab7706eb30503c"} Jun 03 17:48:50.107424 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.107383 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sjdwg" event={"ID":"27eeb238-3d08-4a69-93ed-647589658ac7","Type":"ContainerStarted","Data":"7c2551f49a5950e7e16ecea97f8549615e3db84c618c979cfc25d5fff6e4f75e"} Jun 03 17:48:50.108127 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.108110 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:48:50.109486 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.109468 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" event={"ID":"6e52b19e-4980-4291-a671-3036fcd75ce9","Type":"ContainerStarted","Data":"cddc2e57b1d14731ca4d281be9a7dea617f98cd4c53aca6a0d6302f3f5f902a9"} Jun 03 17:48:50.111252 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.111235 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:50.111930 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.111886 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" event={"ID":"c7ce78f4-1229-4f88-a5c1-d5893b88355b","Type":"ContainerStarted","Data":"08e84af85040da2be65dc510ef433d87942f56d8c89a1fbecd6ac3e2b2b779a9"} Jun 03 17:48:50.112023 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.111938 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" event={"ID":"c7ce78f4-1229-4f88-a5c1-d5893b88355b","Type":"ContainerStarted","Data":"ca3436eb790dc841c5529718c8f4a4a9dd1db6a5acb3d88ae2125beec76ea55d"} Jun 03 17:48:50.114042 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.114025 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" event={"ID":"4f4df5bb-10aa-4ec0-8c34-4f332e88b48d","Type":"ContainerStarted","Data":"be4f123a5e5d3afc8f5d49087ef425697533dcb206a20fc665bf896a5917c8e6"} Jun 03 17:48:50.115872 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.115834 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-t75km" podStartSLOduration=1.894130125 podStartE2EDuration="6.115807773s" podCreationTimestamp="2026-06-03 17:48:44 +0000 UTC" firstStartedPulling="2026-06-03 17:48:45.151446002 +0000 UTC m=+64.869344061" lastFinishedPulling="2026-06-03 17:48:49.373123635 +0000 UTC m=+69.091021709" observedRunningTime="2026-06-03 17:48:50.114749421 +0000 UTC m=+69.832647504" watchObservedRunningTime="2026-06-03 17:48:50.115807773 +0000 UTC m=+69.833705855" Jun 03 17:48:50.143165 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.143102 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-t5fdt" podStartSLOduration=1.880276491 podStartE2EDuration="6.143082256s" podCreationTimestamp="2026-06-03 17:48:44 +0000 UTC" firstStartedPulling="2026-06-03 17:48:45.105500589 +0000 UTC m=+64.823398656" lastFinishedPulling="2026-06-03 17:48:49.368306347 +0000 UTC m=+69.086204421" observedRunningTime="2026-06-03 17:48:50.13680053 +0000 UTC m=+69.854698610" watchObservedRunningTime="2026-06-03 17:48:50.143082256 +0000 UTC m=+69.860980338" Jun 03 17:48:50.179422 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.178325 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sjdwg" podStartSLOduration=69.178305605 podStartE2EDuration="1m9.178305605s" podCreationTimestamp="2026-06-03 17:47:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:48:50.156713928 +0000 UTC m=+69.874612010" watchObservedRunningTime="2026-06-03 17:48:50.178305605 +0000 UTC m=+69.896203688" Jun 03 17:48:50.179422 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.178918 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" podStartSLOduration=2.008310319 podStartE2EDuration="6.178911007s" podCreationTimestamp="2026-06-03 17:48:44 +0000 UTC" firstStartedPulling="2026-06-03 17:48:45.208418882 +0000 UTC m=+64.926316961" lastFinishedPulling="2026-06-03 17:48:49.379019577 +0000 UTC m=+69.096917649" observedRunningTime="2026-06-03 17:48:50.177349648 +0000 UTC m=+69.895247730" watchObservedRunningTime="2026-06-03 17:48:50.178911007 +0000 UTC m=+69.896809092" Jun 03 17:48:50.199187 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.199134 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-z8v2t" podStartSLOduration=1.9929044280000001 podStartE2EDuration="6.199118618s" podCreationTimestamp="2026-06-03 17:48:44 +0000 UTC" firstStartedPulling="2026-06-03 17:48:45.171821051 +0000 UTC m=+64.889719113" lastFinishedPulling="2026-06-03 17:48:49.37803523 +0000 UTC m=+69.095933303" observedRunningTime="2026-06-03 17:48:50.198518393 +0000 UTC m=+69.916416479" watchObservedRunningTime="2026-06-03 17:48:50.199118618 +0000 UTC m=+69.917016699" Jun 03 17:48:50.218859 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.217577 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-fcdwq" podStartSLOduration=1.996811649 podStartE2EDuration="6.217559431s" podCreationTimestamp="2026-06-03 17:48:44 +0000 UTC" firstStartedPulling="2026-06-03 17:48:45.148903444 +0000 UTC m=+64.866801503" lastFinishedPulling="2026-06-03 17:48:49.369651225 +0000 UTC m=+69.087549285" observedRunningTime="2026-06-03 17:48:50.216653776 +0000 UTC m=+69.934551858" watchObservedRunningTime="2026-06-03 17:48:50.217559431 +0000 UTC m=+69.935457514" Jun 03 17:48:50.263473 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.261978 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" podStartSLOduration=70.261958953 podStartE2EDuration="1m10.261958953s" podCreationTimestamp="2026-06-03 17:47:40 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:48:50.261233462 +0000 UTC m=+69.979131547" watchObservedRunningTime="2026-06-03 17:48:50.261958953 +0000 UTC m=+69.979857035" Jun 03 17:48:50.263473 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.262117 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-vzx5g" podStartSLOduration=2.075216153 podStartE2EDuration="6.262107973s" podCreationTimestamp="2026-06-03 17:48:44 +0000 UTC" firstStartedPulling="2026-06-03 17:48:45.188492595 +0000 UTC m=+64.906390654" lastFinishedPulling="2026-06-03 17:48:49.375384411 +0000 UTC m=+69.093282474" observedRunningTime="2026-06-03 17:48:50.238693609 +0000 UTC m=+69.956591692" watchObservedRunningTime="2026-06-03 17:48:50.262107973 +0000 UTC m=+69.980006096" Jun 03 17:48:50.666799 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.666761 2570 patch_prober.go:28] interesting pod/image-registry-b4f77bc5-s6k6q container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 03 17:48:50.667247 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.666822 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" podUID="37831fa4-a454-49e3-8011-f527ff168e84" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 17:48:50.789149 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.789121 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:50.794952 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:50.794928 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:51.111152 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.111107 2570 patch_prober.go:28] interesting pod/console-operator-86d7c6cc77-m2tkc container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.22:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 03 17:48:51.111433 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.111181 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" podUID="6e52b19e-4980-4291-a671-3036fcd75ce9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.22:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Jun 03 17:48:51.118147 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.118096 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:51.118829 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.118806 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-96f4f4fdc-mg5vn" Jun 03 17:48:51.144504 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.144373 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-m2tkc" Jun 03 17:48:51.340904 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.340877 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fkn9v_c0f7495e-7130-47a3-b642-2eaf0e0323ce/dns/0.log" Jun 03 17:48:51.516112 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.516085 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fkn9v_c0f7495e-7130-47a3-b642-2eaf0e0323ce/kube-rbac-proxy/0.log" Jun 03 17:48:51.715885 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:51.715813 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5h67z_b30786e0-7861-4e43-a57e-2c9d4000c330/dns-node-resolver/0.log" Jun 03 17:48:52.121169 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:52.121130 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" event={"ID":"de9ae2ff-4dc9-41e0-86df-d1316b1f6f74","Type":"ContainerStarted","Data":"cff16646a609b6bd85132b4042b11cd788b3c3d2bd6294c159c7479ab6e71b75"} Jun 03 17:48:52.122756 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:52.122729 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qwfz" event={"ID":"b2fbf7b7-252b-4db4-958a-b9c2883808b9","Type":"ContainerStarted","Data":"a7d60eccbb4f38edcd1a393e773d865ae6118facabdd4e27491a0fcf6c6b6c11"} Jun 03 17:48:52.122756 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:52.122758 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8qwfz" event={"ID":"b2fbf7b7-252b-4db4-958a-b9c2883808b9","Type":"ContainerStarted","Data":"f331b796f4adf9e08e41bdebcbe7d1d76fb72a018e1e82457ee02f8e09295aeb"} Jun 03 17:48:52.139378 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:52.139334 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-kbgxl" podStartSLOduration=41.466093601 podStartE2EDuration="43.139320419s" podCreationTimestamp="2026-06-03 17:48:09 +0000 UTC" firstStartedPulling="2026-06-03 17:48:49.688332642 +0000 UTC m=+69.406230710" lastFinishedPulling="2026-06-03 17:48:51.361559458 +0000 UTC m=+71.079457528" observedRunningTime="2026-06-03 17:48:52.137470728 +0000 UTC m=+71.855368806" watchObservedRunningTime="2026-06-03 17:48:52.139320419 +0000 UTC m=+71.857218499" Jun 03 17:48:52.153674 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:52.153621 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8qwfz" podStartSLOduration=69.466262364 podStartE2EDuration="1m11.15360355s" podCreationTimestamp="2026-06-03 17:47:41 +0000 UTC" firstStartedPulling="2026-06-03 17:48:49.676494758 +0000 UTC m=+69.394392822" lastFinishedPulling="2026-06-03 17:48:51.363835946 +0000 UTC m=+71.081734008" observedRunningTime="2026-06-03 17:48:52.152678725 +0000 UTC m=+71.870576807" watchObservedRunningTime="2026-06-03 17:48:52.15360355 +0000 UTC m=+71.871501633" Jun 03 17:48:52.517065 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:52.517037 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b4f77bc5-s6k6q_37831fa4-a454-49e3-8011-f527ff168e84/registry/0.log" Jun 03 17:48:52.716527 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:52.716502 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6r2b2_b1e8bbba-7978-4536-8e7b-42b4764c0105/node-ca/0.log" Jun 03 17:48:53.316299 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:53.316258 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-96f4f4fdc-mg5vn_c7ce78f4-1229-4f88-a5c1-d5893b88355b/router/0.log" Jun 03 17:48:53.716294 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:53.716208 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hs2sn_9b62338f-c99c-4ba4-85f2-943e89c1e108/serve-healthcheck-canary/0.log" Jun 03 17:48:54.759607 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:54.759572 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" podUID="bd175ccb-9e6c-4163-a31f-5262906b6a5c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 17:48:55.014826 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:55.014733 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:48:57.530035 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.529996 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r5nv9"] Jun 03 17:48:57.533485 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.533460 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.536089 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.536066 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b8k7p\"" Jun 03 17:48:57.536289 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.536269 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 17:48:57.536437 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.536066 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 17:48:57.536720 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.536702 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 17:48:57.537499 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.537480 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 17:48:57.611023 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.610990 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611046 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-tls\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611071 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a31e096e-2890-4695-a3bd-12e85c685790-metrics-client-ca\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611094 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-sys\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611108 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-root\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611172 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611374 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611192 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-wtmp\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611374 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-textfile\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.611374 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.611258 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwl44\" (UniqueName: \"kubernetes.io/projected/a31e096e-2890-4695-a3bd-12e85c685790-kube-api-access-zwl44\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712542 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712505 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-wtmp\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712728 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712567 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-textfile\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712728 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712602 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwl44\" (UniqueName: \"kubernetes.io/projected/a31e096e-2890-4695-a3bd-12e85c685790-kube-api-access-zwl44\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712728 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712648 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712728 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712699 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-wtmp\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712939 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712706 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-tls\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712939 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712766 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a31e096e-2890-4695-a3bd-12e85c685790-metrics-client-ca\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712939 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712807 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-sys\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712939 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712837 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-root\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.712939 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712888 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.713175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712956 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-textfile\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.713175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.712989 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-sys\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.713175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.713054 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a31e096e-2890-4695-a3bd-12e85c685790-root\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.713691 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.713668 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a31e096e-2890-4695-a3bd-12e85c685790-metrics-client-ca\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.713826 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.713738 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-accelerators-collector-config\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.715517 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.715493 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-tls\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.715821 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.715801 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a31e096e-2890-4695-a3bd-12e85c685790-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.723947 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.723925 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwl44\" (UniqueName: \"kubernetes.io/projected/a31e096e-2890-4695-a3bd-12e85c685790-kube-api-access-zwl44\") pod \"node-exporter-r5nv9\" (UID: \"a31e096e-2890-4695-a3bd-12e85c685790\") " pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.845013 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:57.844923 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r5nv9" Jun 03 17:48:57.860011 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:48:57.859976 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31e096e_2890_4695_a3bd_12e85c685790.slice/crio-0f1404c8cb3a41c491ea5d5412b617f2a8d29a7c714036e44dabeb572cabaae9 WatchSource:0}: Error finding container 0f1404c8cb3a41c491ea5d5412b617f2a8d29a7c714036e44dabeb572cabaae9: Status 404 returned error can't find the container with id 0f1404c8cb3a41c491ea5d5412b617f2a8d29a7c714036e44dabeb572cabaae9 Jun 03 17:48:58.142252 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:48:58.142156 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5nv9" event={"ID":"a31e096e-2890-4695-a3bd-12e85c685790","Type":"ContainerStarted","Data":"0f1404c8cb3a41c491ea5d5412b617f2a8d29a7c714036e44dabeb572cabaae9"} Jun 03 17:49:00.151379 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:00.151345 2570 generic.go:358] "Generic (PLEG): container finished" podID="a31e096e-2890-4695-a3bd-12e85c685790" containerID="2f4b34546fa84af35119828c30ea855c53a1c7721ef22f09de7f76c9a274b702" exitCode=0 Jun 03 17:49:00.151798 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:00.151427 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5nv9" event={"ID":"a31e096e-2890-4695-a3bd-12e85c685790","Type":"ContainerDied","Data":"2f4b34546fa84af35119828c30ea855c53a1c7721ef22f09de7f76c9a274b702"} Jun 03 17:49:01.156111 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.156076 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5nv9" event={"ID":"a31e096e-2890-4695-a3bd-12e85c685790","Type":"ContainerStarted","Data":"869a17c2037d427c185787a1d8529f728920391303fe3ffd0cafdb3cfa1ef9a8"} Jun 03 17:49:01.156111 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.156115 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r5nv9" event={"ID":"a31e096e-2890-4695-a3bd-12e85c685790","Type":"ContainerStarted","Data":"43d68edecb472ef603419656a9e812c552d15105eabff2688cadb77542f27226"} Jun 03 17:49:01.178814 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.178761 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r5nv9" podStartSLOduration=2.915230691 podStartE2EDuration="4.178746228s" podCreationTimestamp="2026-06-03 17:48:57 +0000 UTC" firstStartedPulling="2026-06-03 17:48:57.863116657 +0000 UTC m=+77.581014717" lastFinishedPulling="2026-06-03 17:48:59.126632195 +0000 UTC m=+78.844530254" observedRunningTime="2026-06-03 17:49:01.176690109 +0000 UTC m=+80.894588190" watchObservedRunningTime="2026-06-03 17:49:01.178746228 +0000 UTC m=+80.896644305" Jun 03 17:49:01.826964 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.826932 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9ncl9"] Jun 03 17:49:01.868740 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.868710 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ncl9"] Jun 03 17:49:01.868876 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.868849 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:01.871106 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.871073 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 17:49:01.871245 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.871074 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 17:49:01.871245 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:01.871126 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x8frl\"" Jun 03 17:49:02.051276 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.051237 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfd45fc6-d56e-490e-a731-7f1dbd299af9-data-volume\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.051276 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.051276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfd45fc6-d56e-490e-a731-7f1dbd299af9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.051509 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.051351 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpxck\" (UniqueName: \"kubernetes.io/projected/bfd45fc6-d56e-490e-a731-7f1dbd299af9-kube-api-access-vpxck\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.051509 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.051409 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bfd45fc6-d56e-490e-a731-7f1dbd299af9-crio-socket\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.051509 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.051430 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfd45fc6-d56e-490e-a731-7f1dbd299af9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.152650 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.152549 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfd45fc6-d56e-490e-a731-7f1dbd299af9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.152650 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.152609 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfd45fc6-d56e-490e-a731-7f1dbd299af9-data-volume\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.152829 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.152717 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfd45fc6-d56e-490e-a731-7f1dbd299af9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.152829 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.152786 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpxck\" (UniqueName: \"kubernetes.io/projected/bfd45fc6-d56e-490e-a731-7f1dbd299af9-kube-api-access-vpxck\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.152896 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.152828 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bfd45fc6-d56e-490e-a731-7f1dbd299af9-crio-socket\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.152930 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.152912 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bfd45fc6-d56e-490e-a731-7f1dbd299af9-crio-socket\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.152961 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.152937 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfd45fc6-d56e-490e-a731-7f1dbd299af9-data-volume\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.153225 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.153208 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bfd45fc6-d56e-490e-a731-7f1dbd299af9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.155024 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.155006 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bfd45fc6-d56e-490e-a731-7f1dbd299af9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.161239 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.161209 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpxck\" (UniqueName: \"kubernetes.io/projected/bfd45fc6-d56e-490e-a731-7f1dbd299af9-kube-api-access-vpxck\") pod \"insights-runtime-extractor-9ncl9\" (UID: \"bfd45fc6-d56e-490e-a731-7f1dbd299af9\") " pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.177705 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.177682 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9ncl9" Jun 03 17:49:02.337294 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:02.337256 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9ncl9"] Jun 03 17:49:02.341496 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:49:02.341465 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfd45fc6_d56e_490e_a731_7f1dbd299af9.slice/crio-73f9d88b8e422ac4bdecfe3b22f5e8def82cf24f1997cde850a53135eae1d8c8 WatchSource:0}: Error finding container 73f9d88b8e422ac4bdecfe3b22f5e8def82cf24f1997cde850a53135eae1d8c8: Status 404 returned error can't find the container with id 73f9d88b8e422ac4bdecfe3b22f5e8def82cf24f1997cde850a53135eae1d8c8 Jun 03 17:49:03.168068 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:03.168035 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ncl9" event={"ID":"bfd45fc6-d56e-490e-a731-7f1dbd299af9","Type":"ContainerStarted","Data":"1acb55c2a2fba30ee9845c7f56e7f41c3ceb49f5f1543f716821489e004bea6c"} Jun 03 17:49:03.168068 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:03.168071 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ncl9" event={"ID":"bfd45fc6-d56e-490e-a731-7f1dbd299af9","Type":"ContainerStarted","Data":"73f9d88b8e422ac4bdecfe3b22f5e8def82cf24f1997cde850a53135eae1d8c8"} Jun 03 17:49:04.172806 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:04.172725 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ncl9" event={"ID":"bfd45fc6-d56e-490e-a731-7f1dbd299af9","Type":"ContainerStarted","Data":"7dd779a294b17061d824032a4220b448bb009194450ef1f5dc5b8cc922272139"} Jun 03 17:49:04.759786 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:04.759745 2570 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" podUID="bd175ccb-9e6c-4163-a31f-5262906b6a5c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 17:49:04.759986 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:04.759823 2570 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" Jun 03 17:49:04.760519 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:04.760467 2570 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4081a9ec734af7f951cd4c3abb26eef0df5132490880171ff558d80cda354a9c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 17:49:04.760632 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:04.760561 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" podUID="bd175ccb-9e6c-4163-a31f-5262906b6a5c" containerName="service-proxy" containerID="cri-o://4081a9ec734af7f951cd4c3abb26eef0df5132490880171ff558d80cda354a9c" gracePeriod=30 Jun 03 17:49:05.178071 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:05.177978 2570 generic.go:358] "Generic (PLEG): container finished" podID="bd175ccb-9e6c-4163-a31f-5262906b6a5c" containerID="4081a9ec734af7f951cd4c3abb26eef0df5132490880171ff558d80cda354a9c" exitCode=2 Jun 03 17:49:05.178071 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:05.178049 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" event={"ID":"bd175ccb-9e6c-4163-a31f-5262906b6a5c","Type":"ContainerDied","Data":"4081a9ec734af7f951cd4c3abb26eef0df5132490880171ff558d80cda354a9c"} Jun 03 17:49:05.178572 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:05.178086 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-85d9cbf9c7-7mv5h" event={"ID":"bd175ccb-9e6c-4163-a31f-5262906b6a5c","Type":"ContainerStarted","Data":"3774bd78ce5846e18725eae03c7aa1cf0466f63dc16bf076b21122e00c13d890"} Jun 03 17:49:06.984410 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:06.984356 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4f77bc5-s6k6q"] Jun 03 17:49:07.187359 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:07.187319 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9ncl9" event={"ID":"bfd45fc6-d56e-490e-a731-7f1dbd299af9","Type":"ContainerStarted","Data":"ed1df3a5eebc0dea15a010cae65a56bd285cf14c8f7167473f46702f09d67a71"} Jun 03 17:49:07.205353 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:07.205268 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9ncl9" podStartSLOduration=2.473066579 podStartE2EDuration="6.205251175s" podCreationTimestamp="2026-06-03 17:49:01 +0000 UTC" firstStartedPulling="2026-06-03 17:49:02.480380176 +0000 UTC m=+82.198278238" lastFinishedPulling="2026-06-03 17:49:06.212564775 +0000 UTC m=+85.930462834" observedRunningTime="2026-06-03 17:49:07.205011138 +0000 UTC m=+86.922909213" watchObservedRunningTime="2026-06-03 17:49:07.205251175 +0000 UTC m=+86.923149259" Jun 03 17:49:22.125611 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:22.125578 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sjdwg" Jun 03 17:49:32.010712 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.010645 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" podUID="37831fa4-a454-49e3-8011-f527ff168e84" containerName="registry" containerID="cri-o://0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7" gracePeriod=30 Jun 03 17:49:32.257682 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.257656 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:49:32.260462 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.260434 2570 generic.go:358] "Generic (PLEG): container finished" podID="37831fa4-a454-49e3-8011-f527ff168e84" containerID="0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7" exitCode=0 Jun 03 17:49:32.260585 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.260483 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" event={"ID":"37831fa4-a454-49e3-8011-f527ff168e84","Type":"ContainerDied","Data":"0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7"} Jun 03 17:49:32.260585 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.260496 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" Jun 03 17:49:32.260585 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.260519 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4f77bc5-s6k6q" event={"ID":"37831fa4-a454-49e3-8011-f527ff168e84","Type":"ContainerDied","Data":"a1bf6b936cc7bebb1c30b2f882af82964517290e6e95548ea8f8fc7b27f0531e"} Jun 03 17:49:32.260585 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.260552 2570 scope.go:117] "RemoveContainer" containerID="0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7" Jun 03 17:49:32.268212 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.268194 2570 scope.go:117] "RemoveContainer" containerID="0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7" Jun 03 17:49:32.268479 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:49:32.268458 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7\": container with ID starting with 0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7 not found: ID does not exist" containerID="0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7" Jun 03 17:49:32.268554 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.268491 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7"} err="failed to get container status \"0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7\": rpc error: code = NotFound desc = could not find container \"0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7\": container with ID starting with 0dca7c08b03aae83e028f83ad2f17214ae2c55b074bde8b688b0e0e60b5ffdd7 not found: ID does not exist" Jun 03 17:49:32.323730 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323704 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q69kw\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-kube-api-access-q69kw\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.323908 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323741 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-trusted-ca\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.323908 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323767 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-registry-certificates\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.323908 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323835 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-bound-sa-token\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.323908 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323873 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.323908 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323906 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37831fa4-a454-49e3-8011-f527ff168e84-ca-trust-extracted\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.324183 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323942 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-image-registry-private-configuration\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.324183 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.323984 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-installation-pull-secrets\") pod \"37831fa4-a454-49e3-8011-f527ff168e84\" (UID: \"37831fa4-a454-49e3-8011-f527ff168e84\") " Jun 03 17:49:32.324290 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.324256 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 17:49:32.324343 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.324278 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 17:49:32.326370 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.326342 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-kube-api-access-q69kw" (OuterVolumeSpecName: "kube-api-access-q69kw") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "kube-api-access-q69kw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:49:32.326775 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.326748 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:49:32.326883 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.326750 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 17:49:32.326883 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.326813 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:49:32.326883 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.326831 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 17:49:32.334101 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.334076 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37831fa4-a454-49e3-8011-f527ff168e84-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "37831fa4-a454-49e3-8011-f527ff168e84" (UID: "37831fa4-a454-49e3-8011-f527ff168e84"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:49:32.425269 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425237 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q69kw\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-kube-api-access-q69kw\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.425269 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425266 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-trusted-ca\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.425269 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425276 2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/37831fa4-a454-49e3-8011-f527ff168e84-registry-certificates\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.425526 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425285 2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-bound-sa-token\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.425526 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425295 2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/37831fa4-a454-49e3-8011-f527ff168e84-registry-tls\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.425526 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425303 2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/37831fa4-a454-49e3-8011-f527ff168e84-ca-trust-extracted\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.425526 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425313 2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-image-registry-private-configuration\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.425526 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.425322 2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/37831fa4-a454-49e3-8011-f527ff168e84-installation-pull-secrets\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:49:32.585992 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.585963 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b4f77bc5-s6k6q"] Jun 03 17:49:32.589602 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.589578 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b4f77bc5-s6k6q"] Jun 03 17:49:32.781835 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:32.781795 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37831fa4-a454-49e3-8011-f527ff168e84" path="/var/lib/kubelet/pods/37831fa4-a454-49e3-8011-f527ff168e84/volumes" Jun 03 17:49:52.315228 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:52.315188 2570 generic.go:358] "Generic (PLEG): container finished" podID="5964a09e-9c25-4188-9ec7-e3693cbec143" containerID="0d4ee0aa72e3e0ec5f0d82e14b2074e9dcfc9673a22e734a009dd305b8a0c096" exitCode=0 Jun 03 17:49:52.315711 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:52.315263 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" event={"ID":"5964a09e-9c25-4188-9ec7-e3693cbec143","Type":"ContainerDied","Data":"0d4ee0aa72e3e0ec5f0d82e14b2074e9dcfc9673a22e734a009dd305b8a0c096"} Jun 03 17:49:52.315711 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:52.315591 2570 scope.go:117] "RemoveContainer" containerID="0d4ee0aa72e3e0ec5f0d82e14b2074e9dcfc9673a22e734a009dd305b8a0c096" Jun 03 17:49:53.322270 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:49:53.322237 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-9zgj2" event={"ID":"5964a09e-9c25-4188-9ec7-e3693cbec143","Type":"ContainerStarted","Data":"4f19e994283364485f2a0863a7a679f3b1032d625916d2507b1a6a0c820c382d"} Jun 03 17:52:40.734565 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:52:40.734535 2570 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 17:53:17.678483 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.678452 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5"] Jun 03 17:53:17.680734 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.678753 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37831fa4-a454-49e3-8011-f527ff168e84" containerName="registry" Jun 03 17:53:17.680734 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.678764 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="37831fa4-a454-49e3-8011-f527ff168e84" containerName="registry" Jun 03 17:53:17.680734 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.678824 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="37831fa4-a454-49e3-8011-f527ff168e84" containerName="registry" Jun 03 17:53:17.681655 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.681640 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.684923 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.684894 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 17:53:17.685091 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.684900 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 17:53:17.685506 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.685486 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 17:53:17.685618 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.685530 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ncxhs\"" Jun 03 17:53:17.686188 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.686173 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 17:53:17.703507 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.703477 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5"] Jun 03 17:53:17.740146 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.740110 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11ffd21e-4db0-4627-b712-6b0d681871d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.740357 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.740160 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ffd21e-4db0-4627-b712-6b0d681871d1-tmp\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.740357 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.740185 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11ffd21e-4db0-4627-b712-6b0d681871d1-manifests\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.740357 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.740263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdqkg\" (UniqueName: \"kubernetes.io/projected/11ffd21e-4db0-4627-b712-6b0d681871d1-kube-api-access-kdqkg\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.740357 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.740329 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11ffd21e-4db0-4627-b712-6b0d681871d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.841694 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.841654 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11ffd21e-4db0-4627-b712-6b0d681871d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.841918 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.841722 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11ffd21e-4db0-4627-b712-6b0d681871d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.841918 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.841772 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ffd21e-4db0-4627-b712-6b0d681871d1-tmp\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.841918 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.841810 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11ffd21e-4db0-4627-b712-6b0d681871d1-manifests\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.841918 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.841853 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdqkg\" (UniqueName: \"kubernetes.io/projected/11ffd21e-4db0-4627-b712-6b0d681871d1-kube-api-access-kdqkg\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.842357 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.842331 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/11ffd21e-4db0-4627-b712-6b0d681871d1-manifests\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.844204 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.844172 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11ffd21e-4db0-4627-b712-6b0d681871d1-tmp\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.844302 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.844237 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11ffd21e-4db0-4627-b712-6b0d681871d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.844302 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.844277 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/11ffd21e-4db0-4627-b712-6b0d681871d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.849872 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.849854 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdqkg\" (UniqueName: \"kubernetes.io/projected/11ffd21e-4db0-4627-b712-6b0d681871d1-kube-api-access-kdqkg\") pod \"opendatahub-operator-controller-manager-99c86d98-cggj5\" (UID: \"11ffd21e-4db0-4627-b712-6b0d681871d1\") " pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:17.992591 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:17.992545 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:18.128996 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:18.128958 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5"] Jun 03 17:53:18.132457 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:53:18.132419 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11ffd21e_4db0_4627_b712_6b0d681871d1.slice/crio-10d2bbdc7beab9f3f3dd3e2bbe32363c0124f4d789d92460605a1a2149a3738a WatchSource:0}: Error finding container 10d2bbdc7beab9f3f3dd3e2bbe32363c0124f4d789d92460605a1a2149a3738a: Status 404 returned error can't find the container with id 10d2bbdc7beab9f3f3dd3e2bbe32363c0124f4d789d92460605a1a2149a3738a Jun 03 17:53:18.134714 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:18.134695 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 17:53:18.887422 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:18.887366 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" event={"ID":"11ffd21e-4db0-4627-b712-6b0d681871d1","Type":"ContainerStarted","Data":"10d2bbdc7beab9f3f3dd3e2bbe32363c0124f4d789d92460605a1a2149a3738a"} Jun 03 17:53:21.899241 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:21.899203 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" event={"ID":"11ffd21e-4db0-4627-b712-6b0d681871d1","Type":"ContainerStarted","Data":"17e6283cd5fe061e18d3f787c07827578ad0ca8b7265019a368af3eb49d20b7e"} Jun 03 17:53:22.904435 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:22.904379 2570 generic.go:358] "Generic (PLEG): container finished" podID="11ffd21e-4db0-4627-b712-6b0d681871d1" containerID="17e6283cd5fe061e18d3f787c07827578ad0ca8b7265019a368af3eb49d20b7e" exitCode=0 Jun 03 17:53:22.904435 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:22.904423 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" event={"ID":"11ffd21e-4db0-4627-b712-6b0d681871d1","Type":"ContainerDied","Data":"17e6283cd5fe061e18d3f787c07827578ad0ca8b7265019a368af3eb49d20b7e"} Jun 03 17:53:23.910154 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:23.910123 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" event={"ID":"11ffd21e-4db0-4627-b712-6b0d681871d1","Type":"ContainerStarted","Data":"8ea9f9b8de300a2826bb2e2db7a334703858dcfb412561af8ac53d4637c1698d"} Jun 03 17:53:23.910564 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:23.910218 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:23.930151 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:23.930066 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" podStartSLOduration=1.754509528 podStartE2EDuration="6.930053676s" podCreationTimestamp="2026-06-03 17:53:17 +0000 UTC" firstStartedPulling="2026-06-03 17:53:18.134815027 +0000 UTC m=+337.852713086" lastFinishedPulling="2026-06-03 17:53:23.310359174 +0000 UTC m=+343.028257234" observedRunningTime="2026-06-03 17:53:23.928767479 +0000 UTC m=+343.646665560" watchObservedRunningTime="2026-06-03 17:53:23.930053676 +0000 UTC m=+343.647951757" Jun 03 17:53:34.916630 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:34.916601 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-99c86d98-cggj5" Jun 03 17:53:37.301037 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.301002 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c"] Jun 03 17:53:37.309773 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.309749 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.312189 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.312166 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 17:53:37.312331 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.312204 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xnht9\"" Jun 03 17:53:37.312331 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.312169 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 17:53:37.315572 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.315541 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c"] Jun 03 17:53:37.406943 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.406906 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-fbv6c"] Jun 03 17:53:37.408714 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.408691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dda319b6-702b-45d8-895b-8aaa70f99ba0-tmp\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.408821 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.408763 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda319b6-702b-45d8-895b-8aaa70f99ba0-tls-certs\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.408821 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.408794 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h77ct\" (UniqueName: \"kubernetes.io/projected/dda319b6-702b-45d8-895b-8aaa70f99ba0-kube-api-access-h77ct\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.409307 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.409292 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:37.411643 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.411619 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 03 17:53:37.411786 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.411763 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qtl7x\"" Jun 03 17:53:37.420522 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.420499 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-fbv6c"] Jun 03 17:53:37.509957 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.509923 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h77ct\" (UniqueName: \"kubernetes.io/projected/dda319b6-702b-45d8-895b-8aaa70f99ba0-kube-api-access-h77ct\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.510130 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.509971 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxzk9\" (UniqueName: \"kubernetes.io/projected/9d327321-86a1-424a-abc1-b44c88397179-kube-api-access-bxzk9\") pod \"odh-model-controller-76588b95-fbv6c\" (UID: \"9d327321-86a1-424a-abc1-b44c88397179\") " pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:37.510130 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.510003 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dda319b6-702b-45d8-895b-8aaa70f99ba0-tmp\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.510130 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.510056 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d327321-86a1-424a-abc1-b44c88397179-cert\") pod \"odh-model-controller-76588b95-fbv6c\" (UID: \"9d327321-86a1-424a-abc1-b44c88397179\") " pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:37.510257 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.510138 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda319b6-702b-45d8-895b-8aaa70f99ba0-tls-certs\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.512290 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.512255 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dda319b6-702b-45d8-895b-8aaa70f99ba0-tmp\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.512458 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.512440 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dda319b6-702b-45d8-895b-8aaa70f99ba0-tls-certs\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.519732 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.519708 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h77ct\" (UniqueName: \"kubernetes.io/projected/dda319b6-702b-45d8-895b-8aaa70f99ba0-kube-api-access-h77ct\") pod \"kube-auth-proxy-58fd596d6f-lgl6c\" (UID: \"dda319b6-702b-45d8-895b-8aaa70f99ba0\") " pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.611174 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.611077 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bxzk9\" (UniqueName: \"kubernetes.io/projected/9d327321-86a1-424a-abc1-b44c88397179-kube-api-access-bxzk9\") pod \"odh-model-controller-76588b95-fbv6c\" (UID: \"9d327321-86a1-424a-abc1-b44c88397179\") " pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:37.611174 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.611139 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d327321-86a1-424a-abc1-b44c88397179-cert\") pod \"odh-model-controller-76588b95-fbv6c\" (UID: \"9d327321-86a1-424a-abc1-b44c88397179\") " pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:37.611358 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:53:37.611246 2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 03 17:53:37.611358 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:53:37.611312 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d327321-86a1-424a-abc1-b44c88397179-cert podName:9d327321-86a1-424a-abc1-b44c88397179 nodeName:}" failed. No retries permitted until 2026-06-03 17:53:38.111289112 +0000 UTC m=+357.829187175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9d327321-86a1-424a-abc1-b44c88397179-cert") pod "odh-model-controller-76588b95-fbv6c" (UID: "9d327321-86a1-424a-abc1-b44c88397179") : secret "odh-model-controller-webhook-cert" not found Jun 03 17:53:37.620425 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.620398 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" Jun 03 17:53:37.620774 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.620756 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxzk9\" (UniqueName: \"kubernetes.io/projected/9d327321-86a1-424a-abc1-b44c88397179-kube-api-access-bxzk9\") pod \"odh-model-controller-76588b95-fbv6c\" (UID: \"9d327321-86a1-424a-abc1-b44c88397179\") " pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:37.756487 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.756452 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c"] Jun 03 17:53:37.759592 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:53:37.759563 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddda319b6_702b_45d8_895b_8aaa70f99ba0.slice/crio-e19268d0786d0fcae86600af6080064c999884068b5d3de1b3da287ab2dacafa WatchSource:0}: Error finding container e19268d0786d0fcae86600af6080064c999884068b5d3de1b3da287ab2dacafa: Status 404 returned error can't find the container with id e19268d0786d0fcae86600af6080064c999884068b5d3de1b3da287ab2dacafa Jun 03 17:53:37.852175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.852137 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-gkvgb"] Jun 03 17:53:37.854975 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.854959 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:37.857255 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.857229 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 03 17:53:37.872197 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.872164 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-gkvgb"] Jun 03 17:53:37.913833 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.913804 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-tls-certs\") pod \"model-serving-api-6577596cd5-gkvgb\" (UID: \"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb\") " pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:37.914008 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.913863 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrb2\" (UniqueName: \"kubernetes.io/projected/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-kube-api-access-zqrb2\") pod \"model-serving-api-6577596cd5-gkvgb\" (UID: \"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb\") " pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:37.957218 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:37.957183 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" event={"ID":"dda319b6-702b-45d8-895b-8aaa70f99ba0","Type":"ContainerStarted","Data":"e19268d0786d0fcae86600af6080064c999884068b5d3de1b3da287ab2dacafa"} Jun 03 17:53:38.014862 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.014828 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrb2\" (UniqueName: \"kubernetes.io/projected/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-kube-api-access-zqrb2\") pod \"model-serving-api-6577596cd5-gkvgb\" (UID: \"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb\") " pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:38.015053 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.014911 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-tls-certs\") pod \"model-serving-api-6577596cd5-gkvgb\" (UID: \"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb\") " pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:38.015053 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:53:38.015032 2570 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 03 17:53:38.015142 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:53:38.015083 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-tls-certs podName:0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb nodeName:}" failed. No retries permitted until 2026-06-03 17:53:38.515067775 +0000 UTC m=+358.232965835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-tls-certs") pod "model-serving-api-6577596cd5-gkvgb" (UID: "0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb") : secret "model-serving-api-tls" not found Jun 03 17:53:38.024106 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.024077 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrb2\" (UniqueName: \"kubernetes.io/projected/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-kube-api-access-zqrb2\") pod \"model-serving-api-6577596cd5-gkvgb\" (UID: \"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb\") " pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:38.115710 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.115614 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d327321-86a1-424a-abc1-b44c88397179-cert\") pod \"odh-model-controller-76588b95-fbv6c\" (UID: \"9d327321-86a1-424a-abc1-b44c88397179\") " pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:38.118015 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.117984 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9d327321-86a1-424a-abc1-b44c88397179-cert\") pod \"odh-model-controller-76588b95-fbv6c\" (UID: \"9d327321-86a1-424a-abc1-b44c88397179\") " pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:38.319298 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.319264 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:38.485153 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.485123 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-fbv6c"] Jun 03 17:53:38.487440 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:53:38.487412 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d327321_86a1_424a_abc1_b44c88397179.slice/crio-ce60967d9cf22df92c91da6063f1f0fca15b7a4bb3f4766f6f564080718fb53f WatchSource:0}: Error finding container ce60967d9cf22df92c91da6063f1f0fca15b7a4bb3f4766f6f564080718fb53f: Status 404 returned error can't find the container with id ce60967d9cf22df92c91da6063f1f0fca15b7a4bb3f4766f6f564080718fb53f Jun 03 17:53:38.519351 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.519298 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-tls-certs\") pod \"model-serving-api-6577596cd5-gkvgb\" (UID: \"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb\") " pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:38.522289 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.522263 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb-tls-certs\") pod \"model-serving-api-6577596cd5-gkvgb\" (UID: \"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb\") " pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:38.765994 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.765958 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:38.918808 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.918771 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-gkvgb"] Jun 03 17:53:38.922330 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:53:38.922296 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf7b384_eb3c_4080_ba77_5ab9eee9dbcb.slice/crio-6ca9d2a4858b9cdf2cc0ee076396e2390cd9eaa65e221e06cbe0402d6dd2ea47 WatchSource:0}: Error finding container 6ca9d2a4858b9cdf2cc0ee076396e2390cd9eaa65e221e06cbe0402d6dd2ea47: Status 404 returned error can't find the container with id 6ca9d2a4858b9cdf2cc0ee076396e2390cd9eaa65e221e06cbe0402d6dd2ea47 Jun 03 17:53:38.963286 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.963241 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-fbv6c" event={"ID":"9d327321-86a1-424a-abc1-b44c88397179","Type":"ContainerStarted","Data":"ce60967d9cf22df92c91da6063f1f0fca15b7a4bb3f4766f6f564080718fb53f"} Jun 03 17:53:38.964669 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:38.964638 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-gkvgb" event={"ID":"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb","Type":"ContainerStarted","Data":"6ca9d2a4858b9cdf2cc0ee076396e2390cd9eaa65e221e06cbe0402d6dd2ea47"} Jun 03 17:53:42.395352 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:42.395332 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 17:53:42.980768 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:42.980732 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-fbv6c" event={"ID":"9d327321-86a1-424a-abc1-b44c88397179","Type":"ContainerStarted","Data":"e16a94781da3e8d73eb6391de597390c71c1c542f04d9320b4b7994e1c7ea8bf"} Jun 03 17:53:42.980947 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:42.980816 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:42.982079 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:42.982055 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-gkvgb" event={"ID":"0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb","Type":"ContainerStarted","Data":"a4df408e6c0af17424e6d8c1f11fc2bc673efb2af1aaf3bb37739bad5b5d839b"} Jun 03 17:53:42.982185 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:42.982114 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:42.983289 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:42.983269 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" event={"ID":"dda319b6-702b-45d8-895b-8aaa70f99ba0","Type":"ContainerStarted","Data":"1461f3e6aaa861301fb5eba96c89d49381d44f051c0d320c9fbfac1f5b2ce5cb"} Jun 03 17:53:42.998524 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:42.998475 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-fbv6c" podStartSLOduration=2.094308929 podStartE2EDuration="5.998459211s" podCreationTimestamp="2026-06-03 17:53:37 +0000 UTC" firstStartedPulling="2026-06-03 17:53:38.488866772 +0000 UTC m=+358.206764844" lastFinishedPulling="2026-06-03 17:53:42.393017067 +0000 UTC m=+362.110915126" observedRunningTime="2026-06-03 17:53:42.996298685 +0000 UTC m=+362.714196765" watchObservedRunningTime="2026-06-03 17:53:42.998459211 +0000 UTC m=+362.716357292" Jun 03 17:53:43.013621 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:43.013567 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-gkvgb" podStartSLOduration=2.541695308 podStartE2EDuration="6.013549203s" podCreationTimestamp="2026-06-03 17:53:37 +0000 UTC" firstStartedPulling="2026-06-03 17:53:38.924107229 +0000 UTC m=+358.642005301" lastFinishedPulling="2026-06-03 17:53:42.395961137 +0000 UTC m=+362.113859196" observedRunningTime="2026-06-03 17:53:43.01226498 +0000 UTC m=+362.730163063" watchObservedRunningTime="2026-06-03 17:53:43.013549203 +0000 UTC m=+362.731447284" Jun 03 17:53:43.028029 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:43.027961 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58fd596d6f-lgl6c" podStartSLOduration=1.396817808 podStartE2EDuration="6.027940438s" podCreationTimestamp="2026-06-03 17:53:37 +0000 UTC" firstStartedPulling="2026-06-03 17:53:37.761502628 +0000 UTC m=+357.479400694" lastFinishedPulling="2026-06-03 17:53:42.392625265 +0000 UTC m=+362.110523324" observedRunningTime="2026-06-03 17:53:43.027412062 +0000 UTC m=+362.745310136" watchObservedRunningTime="2026-06-03 17:53:43.027940438 +0000 UTC m=+362.745838520" Jun 03 17:53:47.485077 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.485042 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-4795b"] Jun 03 17:53:47.487730 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.487712 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:47.490146 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.490130 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 17:53:47.490695 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.490679 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-msxcp\"" Jun 03 17:53:47.498936 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.498904 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-4795b"] Jun 03 17:53:47.598261 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.598223 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4795b\" (UID: \"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:47.598454 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.598286 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjqmj\" (UniqueName: \"kubernetes.io/projected/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-kube-api-access-wjqmj\") pod \"kserve-controller-manager-7c99ffcdcd-4795b\" (UID: \"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:47.698972 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.698928 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4795b\" (UID: \"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:47.699207 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.699004 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wjqmj\" (UniqueName: \"kubernetes.io/projected/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-kube-api-access-wjqmj\") pod \"kserve-controller-manager-7c99ffcdcd-4795b\" (UID: \"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:47.699207 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:53:47.699090 2570 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 17:53:47.699207 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:53:47.699169 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-cert podName:2ab03d6a-7e81-4d36-82b3-395ae5fd38ab nodeName:}" failed. No retries permitted until 2026-06-03 17:53:48.1991477 +0000 UTC m=+367.917045765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-cert") pod "kserve-controller-manager-7c99ffcdcd-4795b" (UID: "2ab03d6a-7e81-4d36-82b3-395ae5fd38ab") : secret "kserve-webhook-server-cert" not found Jun 03 17:53:47.715134 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:47.715104 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjqmj\" (UniqueName: \"kubernetes.io/projected/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-kube-api-access-wjqmj\") pod \"kserve-controller-manager-7c99ffcdcd-4795b\" (UID: \"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:48.203067 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:48.203026 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4795b\" (UID: \"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:48.205472 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:48.205442 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ab03d6a-7e81-4d36-82b3-395ae5fd38ab-cert\") pod \"kserve-controller-manager-7c99ffcdcd-4795b\" (UID: \"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:48.400693 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:48.400650 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:48.543677 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:48.543643 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-4795b"] Jun 03 17:53:48.545146 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:53:48.545122 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab03d6a_7e81_4d36_82b3_395ae5fd38ab.slice/crio-e300f8de9f1859e2c840eea2a50f1b9e0b9b1d4d7fb19f6bc29d0648abf10f1f WatchSource:0}: Error finding container e300f8de9f1859e2c840eea2a50f1b9e0b9b1d4d7fb19f6bc29d0648abf10f1f: Status 404 returned error can't find the container with id e300f8de9f1859e2c840eea2a50f1b9e0b9b1d4d7fb19f6bc29d0648abf10f1f Jun 03 17:53:49.001879 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:49.001850 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" event={"ID":"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab","Type":"ContainerStarted","Data":"e300f8de9f1859e2c840eea2a50f1b9e0b9b1d4d7fb19f6bc29d0648abf10f1f"} Jun 03 17:53:52.015029 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:52.014993 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" event={"ID":"2ab03d6a-7e81-4d36-82b3-395ae5fd38ab","Type":"ContainerStarted","Data":"b7e03c91637d3d7c078f0f62c535eea54f5138af50bcaf0c55bc7b031dd1e0b4"} Jun 03 17:53:52.015495 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:52.015115 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:53:52.040507 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:52.040452 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" podStartSLOduration=1.7868716770000002 podStartE2EDuration="5.040437041s" podCreationTimestamp="2026-06-03 17:53:47 +0000 UTC" firstStartedPulling="2026-06-03 17:53:48.546375082 +0000 UTC m=+368.264273141" lastFinishedPulling="2026-06-03 17:53:51.799940446 +0000 UTC m=+371.517838505" observedRunningTime="2026-06-03 17:53:52.038753708 +0000 UTC m=+371.756651790" watchObservedRunningTime="2026-06-03 17:53:52.040437041 +0000 UTC m=+371.758335122" Jun 03 17:53:53.989453 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:53.989422 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-fbv6c" Jun 03 17:53:53.991455 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:53.991434 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-gkvgb" Jun 03 17:53:56.131547 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.131511 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qds4z"] Jun 03 17:53:56.133761 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.133746 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.136354 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.136331 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 17:53:56.136354 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.136352 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-sb8ft\"" Jun 03 17:53:56.136545 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.136359 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 17:53:56.149544 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.149514 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qds4z"] Jun 03 17:53:56.277810 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.277773 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpgr7\" (UniqueName: \"kubernetes.io/projected/75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5-kube-api-access-tpgr7\") pod \"servicemesh-operator3-55f49c5f94-qds4z\" (UID: \"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.277991 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.277892 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qds4z\" (UID: \"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.378766 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.378722 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tpgr7\" (UniqueName: \"kubernetes.io/projected/75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5-kube-api-access-tpgr7\") pod \"servicemesh-operator3-55f49c5f94-qds4z\" (UID: \"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.378963 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.378790 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qds4z\" (UID: \"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.381597 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.381527 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5-operator-config\") pod \"servicemesh-operator3-55f49c5f94-qds4z\" (UID: \"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.387640 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.387611 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpgr7\" (UniqueName: \"kubernetes.io/projected/75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5-kube-api-access-tpgr7\") pod \"servicemesh-operator3-55f49c5f94-qds4z\" (UID: \"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.442583 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.442551 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:53:56.572864 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:56.572837 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-qds4z"] Jun 03 17:53:56.575651 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:53:56.575618 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f82ccc_a4f7_4ec1_ae8c_4e6cd54ad3d5.slice/crio-ba02e8b9dd5f0b7c34331b5c27fbcd0bd9398782fc4c8f713e276906b68d2f16 WatchSource:0}: Error finding container ba02e8b9dd5f0b7c34331b5c27fbcd0bd9398782fc4c8f713e276906b68d2f16: Status 404 returned error can't find the container with id ba02e8b9dd5f0b7c34331b5c27fbcd0bd9398782fc4c8f713e276906b68d2f16 Jun 03 17:53:57.032308 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:53:57.032273 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" event={"ID":"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5","Type":"ContainerStarted","Data":"ba02e8b9dd5f0b7c34331b5c27fbcd0bd9398782fc4c8f713e276906b68d2f16"} Jun 03 17:54:00.046643 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:00.046549 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" event={"ID":"75f82ccc-a4f7-4ec1-ae8c-4e6cd54ad3d5","Type":"ContainerStarted","Data":"b6048b4945280dd6005ad63b089a21c176d28ace0674159c678f9d9245099782"} Jun 03 17:54:00.047090 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:00.046666 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:54:00.068828 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:00.068770 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" podStartSLOduration=0.900932681 podStartE2EDuration="4.068749383s" podCreationTimestamp="2026-06-03 17:53:56 +0000 UTC" firstStartedPulling="2026-06-03 17:53:56.578291865 +0000 UTC m=+376.296189924" lastFinishedPulling="2026-06-03 17:53:59.746108554 +0000 UTC m=+379.464006626" observedRunningTime="2026-06-03 17:54:00.065350333 +0000 UTC m=+379.783248415" watchObservedRunningTime="2026-06-03 17:54:00.068749383 +0000 UTC m=+379.786647466" Jun 03 17:54:07.674036 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.673995 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-74c696fb4c-mkhkd"] Jun 03 17:54:07.677020 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.676997 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:07.679958 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.679933 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jqhph\"" Jun 03 17:54:07.680086 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.679933 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 17:54:07.688462 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.688438 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c696fb4c-mkhkd"] Jun 03 17:54:07.773347 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.773318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sqqf\" (UniqueName: \"kubernetes.io/projected/48edec0b-eee6-46bf-b676-c50e4f4c7437-kube-api-access-7sqqf\") pod \"dashboard-redirect-74c696fb4c-mkhkd\" (UID: \"48edec0b-eee6-46bf-b676-c50e4f4c7437\") " pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:07.773548 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.773378 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48edec0b-eee6-46bf-b676-c50e4f4c7437-redirect-config\") pod \"dashboard-redirect-74c696fb4c-mkhkd\" (UID: \"48edec0b-eee6-46bf-b676-c50e4f4c7437\") " pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:07.874073 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.874037 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7sqqf\" (UniqueName: \"kubernetes.io/projected/48edec0b-eee6-46bf-b676-c50e4f4c7437-kube-api-access-7sqqf\") pod \"dashboard-redirect-74c696fb4c-mkhkd\" (UID: \"48edec0b-eee6-46bf-b676-c50e4f4c7437\") " pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:07.874249 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.874125 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48edec0b-eee6-46bf-b676-c50e4f4c7437-redirect-config\") pod \"dashboard-redirect-74c696fb4c-mkhkd\" (UID: \"48edec0b-eee6-46bf-b676-c50e4f4c7437\") " pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:07.874923 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.874902 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/48edec0b-eee6-46bf-b676-c50e4f4c7437-redirect-config\") pod \"dashboard-redirect-74c696fb4c-mkhkd\" (UID: \"48edec0b-eee6-46bf-b676-c50e4f4c7437\") " pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:07.882288 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.882264 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sqqf\" (UniqueName: \"kubernetes.io/projected/48edec0b-eee6-46bf-b676-c50e4f4c7437-kube-api-access-7sqqf\") pod \"dashboard-redirect-74c696fb4c-mkhkd\" (UID: \"48edec0b-eee6-46bf-b676-c50e4f4c7437\") " pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:07.987920 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:07.987885 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" Jun 03 17:54:08.144579 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:08.144554 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-74c696fb4c-mkhkd"] Jun 03 17:54:08.147068 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:54:08.147038 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48edec0b_eee6_46bf_b676_c50e4f4c7437.slice/crio-3cffe711e6249b5b04410489ea54c44a7d8ab4e63da31cbabfa04151a3b85942 WatchSource:0}: Error finding container 3cffe711e6249b5b04410489ea54c44a7d8ab4e63da31cbabfa04151a3b85942: Status 404 returned error can't find the container with id 3cffe711e6249b5b04410489ea54c44a7d8ab4e63da31cbabfa04151a3b85942 Jun 03 17:54:09.077237 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:09.077201 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" event={"ID":"48edec0b-eee6-46bf-b676-c50e4f4c7437","Type":"ContainerStarted","Data":"3cffe711e6249b5b04410489ea54c44a7d8ab4e63da31cbabfa04151a3b85942"} Jun 03 17:54:11.052524 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:11.052490 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-qds4z" Jun 03 17:54:14.104670 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:14.104628 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" event={"ID":"48edec0b-eee6-46bf-b676-c50e4f4c7437","Type":"ContainerStarted","Data":"1d568097e783cf4037c945390db77705e32588593486edbceb92e26e4c26686f"} Jun 03 17:54:14.121346 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:14.121297 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-74c696fb4c-mkhkd" podStartSLOduration=1.953694552 podStartE2EDuration="7.121282825s" podCreationTimestamp="2026-06-03 17:54:07 +0000 UTC" firstStartedPulling="2026-06-03 17:54:08.148486386 +0000 UTC m=+387.866384444" lastFinishedPulling="2026-06-03 17:54:13.316074654 +0000 UTC m=+393.033972717" observedRunningTime="2026-06-03 17:54:14.119797084 +0000 UTC m=+393.837695157" watchObservedRunningTime="2026-06-03 17:54:14.121282825 +0000 UTC m=+393.839180906" Jun 03 17:54:23.024162 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:23.024127 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-4795b" Jun 03 17:54:25.452850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.452806 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk"] Jun 03 17:54:25.456590 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.456566 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.459473 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.459435 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 17:54:25.459473 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.459471 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 17:54:25.459653 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.459478 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 17:54:25.459653 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.459590 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mdnpn\"" Jun 03 17:54:25.459828 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.459812 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 17:54:25.466194 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.466168 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk"] Jun 03 17:54:25.534191 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.534157 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.534426 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.534199 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-kube-api-access-vvwbp\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.534426 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.534233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.534426 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.534337 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.534426 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.534372 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.534623 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.534450 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.534623 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.534521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.635631 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.635597 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.635794 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.635640 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.635794 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.635687 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.635885 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.635859 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-kube-api-access-vvwbp\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.635953 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.635926 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.636013 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.635990 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.636065 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.636018 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.636569 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.636542 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.638312 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.638283 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.638488 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.638462 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-local-certs\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.638593 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.638581 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-cacerts\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.638720 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.638703 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.643763 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.643735 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-istio-token\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.643889 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.643835 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvwbp\" (UniqueName: \"kubernetes.io/projected/254ddc0e-41d1-4ddf-89ee-d44c942a5b1a-kube-api-access-vvwbp\") pod \"istiod-openshift-gateway-798958bb55-2h8hk\" (UID: \"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.767594 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.767556 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:25.907224 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:25.907196 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk"] Jun 03 17:54:25.908960 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:54:25.908935 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254ddc0e_41d1_4ddf_89ee_d44c942a5b1a.slice/crio-f85a8e5027b7f165e9fb157af4e2629df03f6275a613feb0d7872bab6fffc90a WatchSource:0}: Error finding container f85a8e5027b7f165e9fb157af4e2629df03f6275a613feb0d7872bab6fffc90a: Status 404 returned error can't find the container with id f85a8e5027b7f165e9fb157af4e2629df03f6275a613feb0d7872bab6fffc90a Jun 03 17:54:26.150757 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:26.150671 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" event={"ID":"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a","Type":"ContainerStarted","Data":"f85a8e5027b7f165e9fb157af4e2629df03f6275a613feb0d7872bab6fffc90a"} Jun 03 17:54:28.186182 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:28.186142 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 17:54:28.186489 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:28.186209 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 17:54:29.165185 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:29.165141 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" event={"ID":"254ddc0e-41d1-4ddf-89ee-d44c942a5b1a","Type":"ContainerStarted","Data":"35d59fc02d35dc653c4ea6ee7f280e59c4ad887f61c251583d1ae95342a1bbe3"} Jun 03 17:54:29.165522 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:29.165500 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:54:29.166906 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:29.166866 2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-2h8hk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 17:54:29.167041 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:29.166934 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" podUID="254ddc0e-41d1-4ddf-89ee-d44c942a5b1a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 17:54:29.191455 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:29.191375 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" podStartSLOduration=1.916448817 podStartE2EDuration="4.191360606s" podCreationTimestamp="2026-06-03 17:54:25 +0000 UTC" firstStartedPulling="2026-06-03 17:54:25.910961419 +0000 UTC m=+405.628859478" lastFinishedPulling="2026-06-03 17:54:28.185873205 +0000 UTC m=+407.903771267" observedRunningTime="2026-06-03 17:54:29.189521485 +0000 UTC m=+408.907419577" watchObservedRunningTime="2026-06-03 17:54:29.191360606 +0000 UTC m=+408.909258688" Jun 03 17:54:30.169819 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:54:30.169790 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-2h8hk" Jun 03 17:55:21.471324 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.471281 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl"] Jun 03 17:55:21.474526 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.474507 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" Jun 03 17:55:21.477087 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.477065 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 17:55:21.477835 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.477817 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 17:55:21.477916 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.477817 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-7jlp4\"" Jun 03 17:55:21.477916 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.477858 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 17:55:21.483627 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.483609 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl"] Jun 03 17:55:21.628714 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.628672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h79g7\" (UniqueName: \"kubernetes.io/projected/c0b25a7f-3a28-4760-a9d2-26e06265650f-kube-api-access-h79g7\") pod \"dns-operator-controller-manager-648d5c98bc-kckbl\" (UID: \"c0b25a7f-3a28-4760-a9d2-26e06265650f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" Jun 03 17:55:21.729910 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.729819 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h79g7\" (UniqueName: \"kubernetes.io/projected/c0b25a7f-3a28-4760-a9d2-26e06265650f-kube-api-access-h79g7\") pod \"dns-operator-controller-manager-648d5c98bc-kckbl\" (UID: \"c0b25a7f-3a28-4760-a9d2-26e06265650f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" Jun 03 17:55:21.739278 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.739239 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h79g7\" (UniqueName: \"kubernetes.io/projected/c0b25a7f-3a28-4760-a9d2-26e06265650f-kube-api-access-h79g7\") pod \"dns-operator-controller-manager-648d5c98bc-kckbl\" (UID: \"c0b25a7f-3a28-4760-a9d2-26e06265650f\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" Jun 03 17:55:21.785066 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.785028 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" Jun 03 17:55:21.918440 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:21.918415 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl"] Jun 03 17:55:21.920246 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:55:21.920209 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b25a7f_3a28_4760_a9d2_26e06265650f.slice/crio-42e1257b02651bfb0c8c2259ecff1eaf4ab43475cac07a733a3e6f7f43628c86 WatchSource:0}: Error finding container 42e1257b02651bfb0c8c2259ecff1eaf4ab43475cac07a733a3e6f7f43628c86: Status 404 returned error can't find the container with id 42e1257b02651bfb0c8c2259ecff1eaf4ab43475cac07a733a3e6f7f43628c86 Jun 03 17:55:22.353253 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:22.353215 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" event={"ID":"c0b25a7f-3a28-4760-a9d2-26e06265650f","Type":"ContainerStarted","Data":"42e1257b02651bfb0c8c2259ecff1eaf4ab43475cac07a733a3e6f7f43628c86"} Jun 03 17:55:25.364007 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:25.363971 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" event={"ID":"c0b25a7f-3a28-4760-a9d2-26e06265650f","Type":"ContainerStarted","Data":"17de09863bb59993663947cc7fc5c3f78e5a18003ab0a93b078b85771acb4f86"} Jun 03 17:55:25.364427 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:25.364074 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" Jun 03 17:55:25.393464 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:25.393413 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" podStartSLOduration=1.94420136 podStartE2EDuration="4.393371414s" podCreationTimestamp="2026-06-03 17:55:21 +0000 UTC" firstStartedPulling="2026-06-03 17:55:21.92224161 +0000 UTC m=+461.640139670" lastFinishedPulling="2026-06-03 17:55:24.371411648 +0000 UTC m=+464.089309724" observedRunningTime="2026-06-03 17:55:25.390296907 +0000 UTC m=+465.108194988" watchObservedRunningTime="2026-06-03 17:55:25.393371414 +0000 UTC m=+465.111269495" Jun 03 17:55:34.505087 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.505046 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj"] Jun 03 17:55:34.508578 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.508552 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:34.511232 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.511211 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qr6mc\"" Jun 03 17:55:34.525966 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.525943 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj"] Jun 03 17:55:34.549736 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.549696 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d850eb3-4e92-46c9-8157-5d11ad667e0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:34.549856 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.549758 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h85lt\" (UniqueName: \"kubernetes.io/projected/8d850eb3-4e92-46c9-8157-5d11ad667e0c-kube-api-access-h85lt\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:34.618092 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.618059 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj"] Jun 03 17:55:34.618321 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:55:34.618302 2570 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-h85lt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" podUID="8d850eb3-4e92-46c9-8157-5d11ad667e0c" Jun 03 17:55:34.650766 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.650724 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h85lt\" (UniqueName: \"kubernetes.io/projected/8d850eb3-4e92-46c9-8157-5d11ad667e0c-kube-api-access-h85lt\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:34.650933 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.650904 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d850eb3-4e92-46c9-8157-5d11ad667e0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:34.651342 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.651325 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d850eb3-4e92-46c9-8157-5d11ad667e0c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:34.665855 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:34.665825 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h85lt\" (UniqueName: \"kubernetes.io/projected/8d850eb3-4e92-46c9-8157-5d11ad667e0c-kube-api-access-h85lt\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:35.093964 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.093924 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj"] Jun 03 17:55:35.105140 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.105103 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj"] Jun 03 17:55:35.396777 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.396692 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:35.399799 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.399765 2570 status_manager.go:895] "Failed to get status for pod" podUID="8d850eb3-4e92-46c9-8157-5d11ad667e0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" is forbidden: User \"system:node:ip-10-0-128-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-111.ec2.internal' and this object" Jun 03 17:55:35.401724 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.401704 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:35.404013 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.403989 2570 status_manager.go:895] "Failed to get status for pod" podUID="8d850eb3-4e92-46c9-8157-5d11ad667e0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" is forbidden: User \"system:node:ip-10-0-128-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-111.ec2.internal' and this object" Jun 03 17:55:35.458574 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.458543 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d850eb3-4e92-46c9-8157-5d11ad667e0c-extensions-socket-volume\") pod \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " Jun 03 17:55:35.458728 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.458580 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h85lt\" (UniqueName: \"kubernetes.io/projected/8d850eb3-4e92-46c9-8157-5d11ad667e0c-kube-api-access-h85lt\") pod \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\" (UID: \"8d850eb3-4e92-46c9-8157-5d11ad667e0c\") " Jun 03 17:55:35.458772 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.458741 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d850eb3-4e92-46c9-8157-5d11ad667e0c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8d850eb3-4e92-46c9-8157-5d11ad667e0c" (UID: "8d850eb3-4e92-46c9-8157-5d11ad667e0c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 17:55:35.460674 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.460643 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d850eb3-4e92-46c9-8157-5d11ad667e0c-kube-api-access-h85lt" (OuterVolumeSpecName: "kube-api-access-h85lt") pod "8d850eb3-4e92-46c9-8157-5d11ad667e0c" (UID: "8d850eb3-4e92-46c9-8157-5d11ad667e0c"). InnerVolumeSpecName "kube-api-access-h85lt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:55:35.559579 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.559540 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8d850eb3-4e92-46c9-8157-5d11ad667e0c-extensions-socket-volume\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:55:35.559579 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:35.559571 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h85lt\" (UniqueName: \"kubernetes.io/projected/8d850eb3-4e92-46c9-8157-5d11ad667e0c-kube-api-access-h85lt\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:55:36.369936 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:36.369905 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-kckbl" Jun 03 17:55:36.372367 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:36.372333 2570 status_manager.go:895] "Failed to get status for pod" podUID="8d850eb3-4e92-46c9-8157-5d11ad667e0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" is forbidden: User \"system:node:ip-10-0-128-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-111.ec2.internal' and this object" Jun 03 17:55:36.400359 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:36.400331 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" Jun 03 17:55:36.402869 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:36.402833 2570 status_manager.go:895] "Failed to get status for pod" podUID="8d850eb3-4e92-46c9-8157-5d11ad667e0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" is forbidden: User \"system:node:ip-10-0-128-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-111.ec2.internal' and this object" Jun 03 17:55:36.408858 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:36.408831 2570 status_manager.go:895] "Failed to get status for pod" podUID="8d850eb3-4e92-46c9-8157-5d11ad667e0c" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-2lgbj\" is forbidden: User \"system:node:ip-10-0-128-111.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-111.ec2.internal' and this object" Jun 03 17:55:36.777684 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:55:36.777652 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d850eb3-4e92-46c9-8157-5d11ad667e0c" path="/var/lib/kubelet/pods/8d850eb3-4e92-46c9-8157-5d11ad667e0c/volumes" Jun 03 17:56:03.779187 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.779147 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m"] Jun 03 17:56:03.782640 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.782613 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.786852 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.786804 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-pchrq\"" Jun 03 17:56:03.798356 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.798318 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m"] Jun 03 17:56:03.907917 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.907877 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74ab5b32-534e-4904-93e1-0f103553adfb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.907917 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.907916 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74ab5b32-534e-4904-93e1-0f103553adfb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.908138 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.907941 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.908138 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.908019 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clfpb\" (UniqueName: \"kubernetes.io/projected/74ab5b32-534e-4904-93e1-0f103553adfb-kube-api-access-clfpb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.908138 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.908066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74ab5b32-534e-4904-93e1-0f103553adfb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.908138 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.908115 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.908285 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.908138 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.908285 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.908160 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:03.908285 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:03.908243 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.009674 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009627 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.009850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009707 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74ab5b32-534e-4904-93e1-0f103553adfb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.009850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009737 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74ab5b32-534e-4904-93e1-0f103553adfb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.009850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009777 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.009850 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009811 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clfpb\" (UniqueName: \"kubernetes.io/projected/74ab5b32-534e-4904-93e1-0f103553adfb-kube-api-access-clfpb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010118 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009858 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74ab5b32-534e-4904-93e1-0f103553adfb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010118 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009895 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010118 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009930 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010118 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.009968 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010345 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.010304 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010345 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.010333 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010463 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.010436 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010615 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.010588 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74ab5b32-534e-4904-93e1-0f103553adfb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.010856 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.010831 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.012477 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.012454 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74ab5b32-534e-4904-93e1-0f103553adfb-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.013167 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.013148 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74ab5b32-534e-4904-93e1-0f103553adfb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.017710 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.017686 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74ab5b32-534e-4904-93e1-0f103553adfb-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.017995 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.017977 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clfpb\" (UniqueName: \"kubernetes.io/projected/74ab5b32-534e-4904-93e1-0f103553adfb-kube-api-access-clfpb\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-ldc5m\" (UID: \"74ab5b32-534e-4904-93e1-0f103553adfb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.095447 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.095326 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:04.239075 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.238942 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m"] Jun 03 17:56:04.241971 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:56:04.241940 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74ab5b32_534e_4904_93e1_0f103553adfb.slice/crio-bbe4c81f635f42dadba498f919cd52fd9e8645266a0258983cf7c746de457190 WatchSource:0}: Error finding container bbe4c81f635f42dadba498f919cd52fd9e8645266a0258983cf7c746de457190: Status 404 returned error can't find the container with id bbe4c81f635f42dadba498f919cd52fd9e8645266a0258983cf7c746de457190 Jun 03 17:56:04.499148 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:04.499113 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" event={"ID":"74ab5b32-534e-4904-93e1-0f103553adfb","Type":"ContainerStarted","Data":"bbe4c81f635f42dadba498f919cd52fd9e8645266a0258983cf7c746de457190"} Jun 03 17:56:07.192288 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:07.192251 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 17:56:07.192608 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:07.192324 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 17:56:07.192608 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:07.192360 2570 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 03 17:56:07.511791 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:07.511746 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" event={"ID":"74ab5b32-534e-4904-93e1-0f103553adfb","Type":"ContainerStarted","Data":"c1c90e8d0379fe26260b67106ea1d2f28459feeedf428d8a1562cc6cf861e217"} Jun 03 17:56:07.529620 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:07.529563 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" podStartSLOduration=1.58179113 podStartE2EDuration="4.529545658s" podCreationTimestamp="2026-06-03 17:56:03 +0000 UTC" firstStartedPulling="2026-06-03 17:56:04.244238838 +0000 UTC m=+503.962136910" lastFinishedPulling="2026-06-03 17:56:07.191993376 +0000 UTC m=+506.909891438" observedRunningTime="2026-06-03 17:56:07.528947996 +0000 UTC m=+507.246846090" watchObservedRunningTime="2026-06-03 17:56:07.529545658 +0000 UTC m=+507.247443743" Jun 03 17:56:08.096340 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:08.096303 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:08.101322 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:08.101292 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:08.515435 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:08.515384 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:08.516511 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:08.516491 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-ldc5m" Jun 03 17:56:20.359590 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.359512 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:56:20.362320 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.362300 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.364832 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.364808 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 17:56:20.364932 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.364833 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tn7sd\"" Jun 03 17:56:20.370698 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.370677 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:56:20.396192 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.396162 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:56:20.455068 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.455041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff0784b-8231-4949-bf1c-76e355b352b5-config-file\") pod \"limitador-limitador-78c99df468-j5snp\" (UID: \"9ff0784b-8231-4949-bf1c-76e355b352b5\") " pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.455186 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.455089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k27mj\" (UniqueName: \"kubernetes.io/projected/9ff0784b-8231-4949-bf1c-76e355b352b5-kube-api-access-k27mj\") pod \"limitador-limitador-78c99df468-j5snp\" (UID: \"9ff0784b-8231-4949-bf1c-76e355b352b5\") " pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.555785 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.555756 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k27mj\" (UniqueName: \"kubernetes.io/projected/9ff0784b-8231-4949-bf1c-76e355b352b5-kube-api-access-k27mj\") pod \"limitador-limitador-78c99df468-j5snp\" (UID: \"9ff0784b-8231-4949-bf1c-76e355b352b5\") " pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.555928 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.555844 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff0784b-8231-4949-bf1c-76e355b352b5-config-file\") pod \"limitador-limitador-78c99df468-j5snp\" (UID: \"9ff0784b-8231-4949-bf1c-76e355b352b5\") " pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.556380 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.556362 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9ff0784b-8231-4949-bf1c-76e355b352b5-config-file\") pod \"limitador-limitador-78c99df468-j5snp\" (UID: \"9ff0784b-8231-4949-bf1c-76e355b352b5\") " pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.564120 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.564098 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k27mj\" (UniqueName: \"kubernetes.io/projected/9ff0784b-8231-4949-bf1c-76e355b352b5-kube-api-access-k27mj\") pod \"limitador-limitador-78c99df468-j5snp\" (UID: \"9ff0784b-8231-4949-bf1c-76e355b352b5\") " pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.673248 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.673150 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:20.806150 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:20.806124 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:56:20.808665 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:56:20.808638 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff0784b_8231_4949_bf1c_76e355b352b5.slice/crio-b82f74ed6c971544752b932327cbdc4806b67a8f5f437793100ef868321aaeb4 WatchSource:0}: Error finding container b82f74ed6c971544752b932327cbdc4806b67a8f5f437793100ef868321aaeb4: Status 404 returned error can't find the container with id b82f74ed6c971544752b932327cbdc4806b67a8f5f437793100ef868321aaeb4 Jun 03 17:56:21.565765 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:21.565719 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" event={"ID":"9ff0784b-8231-4949-bf1c-76e355b352b5","Type":"ContainerStarted","Data":"b82f74ed6c971544752b932327cbdc4806b67a8f5f437793100ef868321aaeb4"} Jun 03 17:56:23.573607 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:23.573569 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" event={"ID":"9ff0784b-8231-4949-bf1c-76e355b352b5","Type":"ContainerStarted","Data":"18d052730d5cf21adc282e6f6aa0213e3a623b58016f08a7852fc7feb1e321db"} Jun 03 17:56:23.573993 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:23.573668 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:56:23.590627 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:23.590540 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" podStartSLOduration=1.189574334 podStartE2EDuration="3.590524409s" podCreationTimestamp="2026-06-03 17:56:20 +0000 UTC" firstStartedPulling="2026-06-03 17:56:20.810876581 +0000 UTC m=+520.528774640" lastFinishedPulling="2026-06-03 17:56:23.211826651 +0000 UTC m=+522.929724715" observedRunningTime="2026-06-03 17:56:23.589614034 +0000 UTC m=+523.307512116" watchObservedRunningTime="2026-06-03 17:56:23.590524409 +0000 UTC m=+523.308422530" Jun 03 17:56:34.578989 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:56:34.578957 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-j5snp" Jun 03 17:57:59.420836 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.420746 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64c95b8547-jbq6b"] Jun 03 17:57:59.423069 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.423053 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:57:59.425640 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.425619 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gd7q2\"" Jun 03 17:57:59.425905 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.425890 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 17:57:59.442321 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.442294 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64c95b8547-jbq6b"] Jun 03 17:57:59.552782 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.552742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdf9l\" (UniqueName: \"kubernetes.io/projected/9626a21f-c8c5-431e-b6a4-9f09e6b7780a-kube-api-access-xdf9l\") pod \"maas-controller-64c95b8547-jbq6b\" (UID: \"9626a21f-c8c5-431e-b6a4-9f09e6b7780a\") " pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:57:59.653587 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.653552 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xdf9l\" (UniqueName: \"kubernetes.io/projected/9626a21f-c8c5-431e-b6a4-9f09e6b7780a-kube-api-access-xdf9l\") pod \"maas-controller-64c95b8547-jbq6b\" (UID: \"9626a21f-c8c5-431e-b6a4-9f09e6b7780a\") " pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:57:59.662011 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.661982 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdf9l\" (UniqueName: \"kubernetes.io/projected/9626a21f-c8c5-431e-b6a4-9f09e6b7780a-kube-api-access-xdf9l\") pod \"maas-controller-64c95b8547-jbq6b\" (UID: \"9626a21f-c8c5-431e-b6a4-9f09e6b7780a\") " pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:57:59.733630 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.733589 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:57:59.867259 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.867231 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64c95b8547-jbq6b"] Jun 03 17:57:59.869097 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:57:59.869071 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9626a21f_c8c5_431e_b6a4_9f09e6b7780a.slice/crio-db2f8ddb2e316c8a3afd78a9228401877f731fc55eb0c3f0159b11fe94780da5 WatchSource:0}: Error finding container db2f8ddb2e316c8a3afd78a9228401877f731fc55eb0c3f0159b11fe94780da5: Status 404 returned error can't find the container with id db2f8ddb2e316c8a3afd78a9228401877f731fc55eb0c3f0159b11fe94780da5 Jun 03 17:57:59.913177 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:57:59.913141 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64c95b8547-jbq6b" event={"ID":"9626a21f-c8c5-431e-b6a4-9f09e6b7780a","Type":"ContainerStarted","Data":"db2f8ddb2e316c8a3afd78a9228401877f731fc55eb0c3f0159b11fe94780da5"} Jun 03 17:58:02.925586 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:02.925547 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64c95b8547-jbq6b" event={"ID":"9626a21f-c8c5-431e-b6a4-9f09e6b7780a","Type":"ContainerStarted","Data":"230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9"} Jun 03 17:58:02.926032 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:02.925713 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:58:02.943718 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:02.943662 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-64c95b8547-jbq6b" podStartSLOduration=1.569558443 podStartE2EDuration="3.943648074s" podCreationTimestamp="2026-06-03 17:57:59 +0000 UTC" firstStartedPulling="2026-06-03 17:57:59.870368663 +0000 UTC m=+619.588266725" lastFinishedPulling="2026-06-03 17:58:02.244458296 +0000 UTC m=+621.962356356" observedRunningTime="2026-06-03 17:58:02.941668178 +0000 UTC m=+622.659566263" watchObservedRunningTime="2026-06-03 17:58:02.943648074 +0000 UTC m=+622.661546155" Jun 03 17:58:13.884352 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:13.884314 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64c95b8547-jbq6b"] Jun 03 17:58:13.884812 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:13.884590 2570 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-64c95b8547-jbq6b" podUID="9626a21f-c8c5-431e-b6a4-9f09e6b7780a" containerName="manager" containerID="cri-o://230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9" gracePeriod=30 Jun 03 17:58:13.891576 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:13.891552 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:58:14.130889 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.130866 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:58:14.288144 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.288110 2570 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdf9l\" (UniqueName: \"kubernetes.io/projected/9626a21f-c8c5-431e-b6a4-9f09e6b7780a-kube-api-access-xdf9l\") pod \"9626a21f-c8c5-431e-b6a4-9f09e6b7780a\" (UID: \"9626a21f-c8c5-431e-b6a4-9f09e6b7780a\") " Jun 03 17:58:14.290287 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.290255 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9626a21f-c8c5-431e-b6a4-9f09e6b7780a-kube-api-access-xdf9l" (OuterVolumeSpecName: "kube-api-access-xdf9l") pod "9626a21f-c8c5-431e-b6a4-9f09e6b7780a" (UID: "9626a21f-c8c5-431e-b6a4-9f09e6b7780a"). InnerVolumeSpecName "kube-api-access-xdf9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:58:14.388756 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.388719 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdf9l\" (UniqueName: \"kubernetes.io/projected/9626a21f-c8c5-431e-b6a4-9f09e6b7780a-kube-api-access-xdf9l\") on node \"ip-10-0-128-111.ec2.internal\" DevicePath \"\"" Jun 03 17:58:14.966539 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.966507 2570 generic.go:358] "Generic (PLEG): container finished" podID="9626a21f-c8c5-431e-b6a4-9f09e6b7780a" containerID="230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9" exitCode=0 Jun 03 17:58:14.966953 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.966591 2570 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64c95b8547-jbq6b" Jun 03 17:58:14.966953 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.966605 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64c95b8547-jbq6b" event={"ID":"9626a21f-c8c5-431e-b6a4-9f09e6b7780a","Type":"ContainerDied","Data":"230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9"} Jun 03 17:58:14.966953 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.966645 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64c95b8547-jbq6b" event={"ID":"9626a21f-c8c5-431e-b6a4-9f09e6b7780a","Type":"ContainerDied","Data":"db2f8ddb2e316c8a3afd78a9228401877f731fc55eb0c3f0159b11fe94780da5"} Jun 03 17:58:14.966953 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.966661 2570 scope.go:117] "RemoveContainer" containerID="230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9" Jun 03 17:58:14.974869 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.974852 2570 scope.go:117] "RemoveContainer" containerID="230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9" Jun 03 17:58:14.975113 ip-10-0-128-111 kubenswrapper[2570]: E0603 17:58:14.975096 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9\": container with ID starting with 230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9 not found: ID does not exist" containerID="230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9" Jun 03 17:58:14.975156 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.975120 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9"} err="failed to get container status \"230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9\": rpc error: code = NotFound desc = could not find container \"230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9\": container with ID starting with 230b943d89e984852e7bf13d3c6a3c4583ee93e291486a0ec1556b5e0e6095b9 not found: ID does not exist" Jun 03 17:58:14.982064 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.982041 2570 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64c95b8547-jbq6b"] Jun 03 17:58:14.986814 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:14.986795 2570 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64c95b8547-jbq6b"] Jun 03 17:58:16.777932 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:16.777897 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9626a21f-c8c5-431e-b6a4-9f09e6b7780a" path="/var/lib/kubelet/pods/9626a21f-c8c5-431e-b6a4-9f09e6b7780a/volumes" Jun 03 17:58:33.268261 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.268218 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6b8b778955-k4fk6"] Jun 03 17:58:33.268837 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.268744 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9626a21f-c8c5-431e-b6a4-9f09e6b7780a" containerName="manager" Jun 03 17:58:33.268837 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.268760 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9626a21f-c8c5-431e-b6a4-9f09e6b7780a" containerName="manager" Jun 03 17:58:33.268919 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.268842 2570 memory_manager.go:356] "RemoveStaleState removing state" podUID="9626a21f-c8c5-431e-b6a4-9f09e6b7780a" containerName="manager" Jun 03 17:58:33.271208 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.271191 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.273570 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.273552 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 17:58:33.273665 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.273620 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hqb84\"" Jun 03 17:58:33.280036 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.280007 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b8b778955-k4fk6"] Jun 03 17:58:33.350612 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.350578 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a0f835c-9d82-4519-96ae-ac789ccc4f85-maas-api-tls\") pod \"maas-api-6b8b778955-k4fk6\" (UID: \"6a0f835c-9d82-4519-96ae-ac789ccc4f85\") " pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.350775 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.350642 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdcdq\" (UniqueName: \"kubernetes.io/projected/6a0f835c-9d82-4519-96ae-ac789ccc4f85-kube-api-access-pdcdq\") pod \"maas-api-6b8b778955-k4fk6\" (UID: \"6a0f835c-9d82-4519-96ae-ac789ccc4f85\") " pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.451360 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.451330 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a0f835c-9d82-4519-96ae-ac789ccc4f85-maas-api-tls\") pod \"maas-api-6b8b778955-k4fk6\" (UID: \"6a0f835c-9d82-4519-96ae-ac789ccc4f85\") " pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.451540 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.451383 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdcdq\" (UniqueName: \"kubernetes.io/projected/6a0f835c-9d82-4519-96ae-ac789ccc4f85-kube-api-access-pdcdq\") pod \"maas-api-6b8b778955-k4fk6\" (UID: \"6a0f835c-9d82-4519-96ae-ac789ccc4f85\") " pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.453813 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.453786 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a0f835c-9d82-4519-96ae-ac789ccc4f85-maas-api-tls\") pod \"maas-api-6b8b778955-k4fk6\" (UID: \"6a0f835c-9d82-4519-96ae-ac789ccc4f85\") " pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.460518 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.460489 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdcdq\" (UniqueName: \"kubernetes.io/projected/6a0f835c-9d82-4519-96ae-ac789ccc4f85-kube-api-access-pdcdq\") pod \"maas-api-6b8b778955-k4fk6\" (UID: \"6a0f835c-9d82-4519-96ae-ac789ccc4f85\") " pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.582984 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.582901 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:33.681686 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.681651 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-q9mwb"] Jun 03 17:58:33.684831 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.684804 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" Jun 03 17:58:33.687348 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.687322 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 17:58:33.687508 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.687324 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-v5w9b\"" Jun 03 17:58:33.693321 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.693291 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-q9mwb"] Jun 03 17:58:33.729179 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.729152 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6b8b778955-k4fk6"] Jun 03 17:58:33.731107 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:58:33.731085 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0f835c_9d82_4519_96ae_ac789ccc4f85.slice/crio-8231f0b01f8d857488b9d54f71212aded23a51943f74e05e12a626972b97e2b8 WatchSource:0}: Error finding container 8231f0b01f8d857488b9d54f71212aded23a51943f74e05e12a626972b97e2b8: Status 404 returned error can't find the container with id 8231f0b01f8d857488b9d54f71212aded23a51943f74e05e12a626972b97e2b8 Jun 03 17:58:33.732296 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.732281 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 17:58:33.754404 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.754364 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzmhf\" (UniqueName: \"kubernetes.io/projected/bfadefbe-01ba-494e-af93-dcec510bf4e1-kube-api-access-lzmhf\") pod \"payload-processing-58b6c8fdc7-q9mwb\" (UID: \"bfadefbe-01ba-494e-af93-dcec510bf4e1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" Jun 03 17:58:33.841551 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.841464 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:58:33.855293 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.855266 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lzmhf\" (UniqueName: \"kubernetes.io/projected/bfadefbe-01ba-494e-af93-dcec510bf4e1-kube-api-access-lzmhf\") pod \"payload-processing-58b6c8fdc7-q9mwb\" (UID: \"bfadefbe-01ba-494e-af93-dcec510bf4e1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" Jun 03 17:58:33.863480 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.863455 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzmhf\" (UniqueName: \"kubernetes.io/projected/bfadefbe-01ba-494e-af93-dcec510bf4e1-kube-api-access-lzmhf\") pod \"payload-processing-58b6c8fdc7-q9mwb\" (UID: \"bfadefbe-01ba-494e-af93-dcec510bf4e1\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" Jun 03 17:58:33.998539 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:33.998504 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" Jun 03 17:58:34.038789 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:34.038753 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b8b778955-k4fk6" event={"ID":"6a0f835c-9d82-4519-96ae-ac789ccc4f85","Type":"ContainerStarted","Data":"8231f0b01f8d857488b9d54f71212aded23a51943f74e05e12a626972b97e2b8"} Jun 03 17:58:34.137905 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:34.137809 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-q9mwb"] Jun 03 17:58:34.141311 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:58:34.141283 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfadefbe_01ba_494e_af93_dcec510bf4e1.slice/crio-035b158e65a93dc007abd92528fb9eb64f25f08acd45d2364811bb3cb48c63c2 WatchSource:0}: Error finding container 035b158e65a93dc007abd92528fb9eb64f25f08acd45d2364811bb3cb48c63c2: Status 404 returned error can't find the container with id 035b158e65a93dc007abd92528fb9eb64f25f08acd45d2364811bb3cb48c63c2 Jun 03 17:58:35.066185 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:35.066149 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" event={"ID":"bfadefbe-01ba-494e-af93-dcec510bf4e1","Type":"ContainerStarted","Data":"035b158e65a93dc007abd92528fb9eb64f25f08acd45d2364811bb3cb48c63c2"} Jun 03 17:58:36.071233 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:36.071198 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6b8b778955-k4fk6" event={"ID":"6a0f835c-9d82-4519-96ae-ac789ccc4f85","Type":"ContainerStarted","Data":"effff0b8c482f6f0f6713a2a8bcbd397b1db9962e0fa5bf0071ac36409e7a6b5"} Jun 03 17:58:36.071732 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:36.071328 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:36.088986 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:36.088926 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6b8b778955-k4fk6" podStartSLOduration=1.7252039190000001 podStartE2EDuration="3.088910032s" podCreationTimestamp="2026-06-03 17:58:33 +0000 UTC" firstStartedPulling="2026-06-03 17:58:33.732427033 +0000 UTC m=+653.450325093" lastFinishedPulling="2026-06-03 17:58:35.096133143 +0000 UTC m=+654.814031206" observedRunningTime="2026-06-03 17:58:36.087640548 +0000 UTC m=+655.805538629" watchObservedRunningTime="2026-06-03 17:58:36.088910032 +0000 UTC m=+655.806808113" Jun 03 17:58:38.080739 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:38.080696 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" event={"ID":"bfadefbe-01ba-494e-af93-dcec510bf4e1","Type":"ContainerStarted","Data":"0cc68e6b7b094d34bb8ac4dd1764ad2cceca133c8f77bb88bd33a08b04f28e85"} Jun 03 17:58:38.081119 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:38.080770 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" Jun 03 17:58:38.097543 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:38.097491 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" podStartSLOduration=1.964972553 podStartE2EDuration="5.097474621s" podCreationTimestamp="2026-06-03 17:58:33 +0000 UTC" firstStartedPulling="2026-06-03 17:58:34.143151152 +0000 UTC m=+653.861049211" lastFinishedPulling="2026-06-03 17:58:37.275653202 +0000 UTC m=+656.993551279" observedRunningTime="2026-06-03 17:58:38.09555554 +0000 UTC m=+657.813453621" watchObservedRunningTime="2026-06-03 17:58:38.097474621 +0000 UTC m=+657.815372701" Jun 03 17:58:42.081043 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:42.081013 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6b8b778955-k4fk6" Jun 03 17:58:49.087043 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:58:49.087011 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-q9mwb" Jun 03 17:59:39.453155 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.453067 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp"] Jun 03 17:59:39.457548 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.457527 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.460134 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.460113 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 17:59:39.460254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.460153 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 17:59:39.460254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.460184 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dqzzh\"" Jun 03 17:59:39.460254 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.460194 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 17:59:39.465445 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.465423 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp"] Jun 03 17:59:39.541559 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.541521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlq2w\" (UniqueName: \"kubernetes.io/projected/aeaf0394-de1a-4797-a5c9-aa970b16648f-kube-api-access-nlq2w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.541745 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.541575 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.541745 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.541661 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.541745 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.541692 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.541875 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.541786 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.541875 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.541833 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaf0394-de1a-4797-a5c9-aa970b16648f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.642347 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642306 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.642550 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642364 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaf0394-de1a-4797-a5c9-aa970b16648f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.642550 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642444 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlq2w\" (UniqueName: \"kubernetes.io/projected/aeaf0394-de1a-4797-a5c9-aa970b16648f-kube-api-access-nlq2w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.642550 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642472 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.642550 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642498 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.642550 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642513 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.642892 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642861 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.643016 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642872 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.643016 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.642954 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.644690 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.644667 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aeaf0394-de1a-4797-a5c9-aa970b16648f-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.645050 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.645030 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aeaf0394-de1a-4797-a5c9-aa970b16648f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.650463 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.650442 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlq2w\" (UniqueName: \"kubernetes.io/projected/aeaf0394-de1a-4797-a5c9-aa970b16648f-kube-api-access-nlq2w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp\" (UID: \"aeaf0394-de1a-4797-a5c9-aa970b16648f\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.768643 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.768607 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:39.902937 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.902911 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp"] Jun 03 17:59:39.904893 ip-10-0-128-111 kubenswrapper[2570]: W0603 17:59:39.904860 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeaf0394_de1a_4797_a5c9_aa970b16648f.slice/crio-974765f8c077b5e17c660062e2dddad547a2daba914127f41aafb98e8d9381ec WatchSource:0}: Error finding container 974765f8c077b5e17c660062e2dddad547a2daba914127f41aafb98e8d9381ec: Status 404 returned error can't find the container with id 974765f8c077b5e17c660062e2dddad547a2daba914127f41aafb98e8d9381ec Jun 03 17:59:39.951820 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:39.951786 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:59:40.299957 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:40.299919 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" event={"ID":"aeaf0394-de1a-4797-a5c9-aa970b16648f","Type":"ContainerStarted","Data":"974765f8c077b5e17c660062e2dddad547a2daba914127f41aafb98e8d9381ec"} Jun 03 17:59:45.318860 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:45.318816 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" event={"ID":"aeaf0394-de1a-4797-a5c9-aa970b16648f","Type":"ContainerStarted","Data":"faef4d0c4717c3dda5701e6656350419b9f4bbc8197289047700ede41ae9fbfb"} Jun 03 17:59:45.545305 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:45.545267 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:59:50.339881 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:50.339786 2570 generic.go:358] "Generic (PLEG): container finished" podID="aeaf0394-de1a-4797-a5c9-aa970b16648f" containerID="faef4d0c4717c3dda5701e6656350419b9f4bbc8197289047700ede41ae9fbfb" exitCode=0 Jun 03 17:59:50.339881 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:50.339857 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" event={"ID":"aeaf0394-de1a-4797-a5c9-aa970b16648f","Type":"ContainerDied","Data":"faef4d0c4717c3dda5701e6656350419b9f4bbc8197289047700ede41ae9fbfb"} Jun 03 17:59:50.572106 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:50.572070 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 17:59:52.348563 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:52.348526 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" event={"ID":"aeaf0394-de1a-4797-a5c9-aa970b16648f","Type":"ContainerStarted","Data":"e3db13af6409c705493ca5fc910888ba5f0d7abad2ec114fac51933a46eda41d"} Jun 03 17:59:52.369042 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:52.368993 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" podStartSLOduration=1.813917308 podStartE2EDuration="13.368978347s" podCreationTimestamp="2026-06-03 17:59:39 +0000 UTC" firstStartedPulling="2026-06-03 17:59:39.906667402 +0000 UTC m=+719.624565464" lastFinishedPulling="2026-06-03 17:59:51.461728444 +0000 UTC m=+731.179626503" observedRunningTime="2026-06-03 17:59:52.36588523 +0000 UTC m=+732.083783311" watchObservedRunningTime="2026-06-03 17:59:52.368978347 +0000 UTC m=+732.086876427" Jun 03 17:59:59.769175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:59.769129 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:59.769175 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:59.769178 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 17:59:59.781876 ip-10-0-128-111 kubenswrapper[2570]: I0603 17:59:59.781854 2570 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 18:00:00.386658 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:00.386630 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp" Jun 03 18:00:05.344214 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:05.344173 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 18:00:09.956441 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:09.956381 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 18:00:41.943980 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:41.943942 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr"] Jun 03 18:00:41.953730 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:41.953697 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:41.956083 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:41.956055 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 18:00:41.956083 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:41.956066 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr"] Jun 03 18:00:42.011789 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.011754 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v728\" (UniqueName: \"kubernetes.io/projected/574e8599-39bb-46f1-9581-0db40803515f-kube-api-access-7v728\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.011789 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.011802 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/574e8599-39bb-46f1-9581-0db40803515f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.012083 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.011909 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.012083 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.011961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.012083 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.011981 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.012083 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.012017 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113383 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113331 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113598 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113426 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113598 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113473 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113598 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113504 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7v728\" (UniqueName: \"kubernetes.io/projected/574e8599-39bb-46f1-9581-0db40803515f-kube-api-access-7v728\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113598 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113536 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/574e8599-39bb-46f1-9581-0db40803515f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113802 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113619 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113857 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113810 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113914 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113846 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.113914 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.113874 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.116055 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.116029 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/574e8599-39bb-46f1-9581-0db40803515f-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.116356 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.116335 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/574e8599-39bb-46f1-9581-0db40803515f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.122210 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.122175 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v728\" (UniqueName: \"kubernetes.io/projected/574e8599-39bb-46f1-9581-0db40803515f-kube-api-access-7v728\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr\" (UID: \"574e8599-39bb-46f1-9581-0db40803515f\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.265796 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.265757 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" Jun 03 18:00:42.398633 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.398604 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr"] Jun 03 18:00:42.400472 ip-10-0-128-111 kubenswrapper[2570]: W0603 18:00:42.400443 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574e8599_39bb_46f1_9581_0db40803515f.slice/crio-5fa924caa950e51cfd94e5ac074545932b3c294cf5d489084e4d6cb460696d57 WatchSource:0}: Error finding container 5fa924caa950e51cfd94e5ac074545932b3c294cf5d489084e4d6cb460696d57: Status 404 returned error can't find the container with id 5fa924caa950e51cfd94e5ac074545932b3c294cf5d489084e4d6cb460696d57 Jun 03 18:00:42.550616 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.550536 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" event={"ID":"574e8599-39bb-46f1-9581-0db40803515f","Type":"ContainerStarted","Data":"14b8a907bb0611193b49507abc82ef8fb99e8354c0e0f5728d34b4b95c5f3997"} Jun 03 18:00:42.550616 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:42.550572 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr" event={"ID":"574e8599-39bb-46f1-9581-0db40803515f","Type":"ContainerStarted","Data":"5fa924caa950e51cfd94e5ac074545932b3c294cf5d489084e4d6cb460696d57"} Jun 03 18:00:43.558847 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:00:43.558803 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-j5snp"] Jun 03 18:06:22.816693 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:22.816665 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr_574e8599-39bb-46f1-9581-0db40803515f/storage-initializer/0.log" Jun 03 18:06:29.196126 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:29.196093 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c696fb4c-mkhkd_48edec0b-eee6-46bf-b676-c50e4f4c7437/nginx/0.log" Jun 03 18:06:29.348685 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:29.348652 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-4795b_2ab03d6a-7e81-4d36-82b3-395ae5fd38ab/manager/0.log" Jun 03 18:06:29.595753 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:29.595723 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b8b778955-k4fk6_6a0f835c-9d82-4519-96ae-ac789ccc4f85/maas-api/0.log" Jun 03 18:06:29.931805 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:29.931728 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-gkvgb_0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb/server/0.log" Jun 03 18:06:30.046158 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:30.046127 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-fbv6c_9d327321-86a1-424a-abc1-b44c88397179/manager/0.log" Jun 03 18:06:30.277191 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:30.277159 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cggj5_11ffd21e-4db0-4627-b712-6b0d681871d1/manager/0.log" Jun 03 18:06:30.283473 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:30.283450 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cggj5_11ffd21e-4db0-4627-b712-6b0d681871d1/copy-manifests/0.log" Jun 03 18:06:32.292102 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:32.292070 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-kckbl_c0b25a7f-3a28-4760-a9d2-26e06265650f/manager/0.log" Jun 03 18:06:32.748672 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:32.748644 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-j5snp_9ff0784b-8231-4949-bf1c-76e355b352b5/limitador/0.log" Jun 03 18:06:33.452948 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:33.452922 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-2h8hk_254ddc0e-41d1-4ddf-89ee-d44c942a5b1a/discovery/0.log" Jun 03 18:06:33.565140 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:33.565104 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58fd596d6f-lgl6c_dda319b6-702b-45d8-895b-8aaa70f99ba0/kube-auth-proxy/0.log" Jun 03 18:06:33.793745 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:33.793715 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-ldc5m_74ab5b32-534e-4904-93e1-0f103553adfb/istio-proxy/0.log" Jun 03 18:06:33.902292 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:33.902260 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-q9mwb_bfadefbe-01ba-494e-af93-dcec510bf4e1/payload-processing/0.log" Jun 03 18:06:34.010837 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:34.010808 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-96f4f4fdc-mg5vn_c7ce78f4-1229-4f88-a5c1-d5893b88355b/router/0.log" Jun 03 18:06:34.372297 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:34.372266 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp_aeaf0394-de1a-4797-a5c9-aa970b16648f/storage-initializer/0.log" Jun 03 18:06:34.380090 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:34.380067 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-btxnp_aeaf0394-de1a-4797-a5c9-aa970b16648f/main/0.log" Jun 03 18:06:35.064516 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:35.064488 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-vqzdr_574e8599-39bb-46f1-9581-0db40803515f/storage-initializer/0.log" Jun 03 18:06:42.377191 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:42.377160 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2slbp_70cb0120-e80c-4202-bd77-2f23e425711a/global-pull-secret-syncer/0.log" Jun 03 18:06:42.554923 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:42.554892 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dphts_ad544606-0cbc-4202-8d14-39fa80b7eea6/konnectivity-agent/0.log" Jun 03 18:06:42.690361 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:42.690285 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-111.ec2.internal_e4df10d4b37f7728e83844c976cd0de4/haproxy/0.log" Jun 03 18:06:46.502891 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:46.502858 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-kckbl_c0b25a7f-3a28-4760-a9d2-26e06265650f/manager/0.log" Jun 03 18:06:46.641745 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:46.641713 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-j5snp_9ff0784b-8231-4949-bf1c-76e355b352b5/limitador/0.log" Jun 03 18:06:48.276248 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:48.276220 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-vzx5g_4f4df5bb-10aa-4ec0-8c34-4f332e88b48d/cluster-monitoring-operator/0.log" Jun 03 18:06:48.676000 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:48.675904 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5nv9_a31e096e-2890-4695-a3bd-12e85c685790/node-exporter/0.log" Jun 03 18:06:48.708670 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:48.708642 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5nv9_a31e096e-2890-4695-a3bd-12e85c685790/kube-rbac-proxy/0.log" Jun 03 18:06:48.735976 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:48.735947 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r5nv9_a31e096e-2890-4695-a3bd-12e85c685790/init-textfile/0.log" Jun 03 18:06:50.848347 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:50.848275 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-kbgxl_de9ae2ff-4dc9-41e0-86df-d1316b1f6f74/networking-console-plugin/0.log" Jun 03 18:06:51.406893 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:51.406864 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-m2tkc_6e52b19e-4980-4291-a671-3036fcd75ce9/console-operator/0.log" Jun 03 18:06:52.444155 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.444123 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-t5fdt_8c3629d2-357d-4dbc-9c10-1ef19c1d18b7/volume-data-source-validator/0.log" Jun 03 18:06:52.519121 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.519081 2570 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk"] Jun 03 18:06:52.522300 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.522278 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.524788 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.524765 2570 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zjbgd\"/\"default-dockercfg-wrl8k\"" Jun 03 18:06:52.524911 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.524779 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjbgd\"/\"openshift-service-ca.crt\"" Jun 03 18:06:52.525705 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.525689 2570 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjbgd\"/\"kube-root-ca.crt\"" Jun 03 18:06:52.533538 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.533518 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk"] Jun 03 18:06:52.638561 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.638527 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-sys\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.638768 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.638593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7xh\" (UniqueName: \"kubernetes.io/projected/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-kube-api-access-mk7xh\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.638768 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.638665 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-lib-modules\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.638768 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.638702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-podres\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.638768 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.638738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-proc\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739362 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739325 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-lib-modules\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739362 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739365 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-podres\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739630 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739407 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-proc\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739630 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739462 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-sys\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739630 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739513 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-podres\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739630 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739523 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-lib-modules\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739630 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739540 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-proc\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739630 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739532 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-sys\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.739630 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.739578 2570 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7xh\" (UniqueName: \"kubernetes.io/projected/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-kube-api-access-mk7xh\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.747353 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.747327 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7xh\" (UniqueName: \"kubernetes.io/projected/9c4e5d1b-35a6-476c-8a00-fb81b7b46d86-kube-api-access-mk7xh\") pod \"perf-node-gather-daemonset-lrsdk\" (UID: \"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86\") " pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.833548 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.833511 2570 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:52.966086 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.966056 2570 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk"] Jun 03 18:06:52.968218 ip-10-0-128-111 kubenswrapper[2570]: W0603 18:06:52.968190 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9c4e5d1b_35a6_476c_8a00_fb81b7b46d86.slice/crio-f362b7b78cd604c351b62fc958db082bc5efee06c7a0ff8af96a15c708f9d5cf WatchSource:0}: Error finding container f362b7b78cd604c351b62fc958db082bc5efee06c7a0ff8af96a15c708f9d5cf: Status 404 returned error can't find the container with id f362b7b78cd604c351b62fc958db082bc5efee06c7a0ff8af96a15c708f9d5cf Jun 03 18:06:52.969928 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:52.969912 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 18:06:53.377184 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.377094 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fkn9v_c0f7495e-7130-47a3-b642-2eaf0e0323ce/dns/0.log" Jun 03 18:06:53.397029 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.397005 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fkn9v_c0f7495e-7130-47a3-b642-2eaf0e0323ce/kube-rbac-proxy/0.log" Jun 03 18:06:53.457697 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.457672 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5h67z_b30786e0-7861-4e43-a57e-2c9d4000c330/dns-node-resolver/0.log" Jun 03 18:06:53.867082 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.867044 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" event={"ID":"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86","Type":"ContainerStarted","Data":"5ad3486c27302164655e01f631b445fb70058b7fe00135d380f882c1b88974e8"} Jun 03 18:06:53.867082 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.867083 2570 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" event={"ID":"9c4e5d1b-35a6-476c-8a00-fb81b7b46d86","Type":"ContainerStarted","Data":"f362b7b78cd604c351b62fc958db082bc5efee06c7a0ff8af96a15c708f9d5cf"} Jun 03 18:06:53.867378 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.867108 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:06:53.883256 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.883200 2570 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" podStartSLOduration=1.883184311 podStartE2EDuration="1.883184311s" podCreationTimestamp="2026-06-03 18:06:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 18:06:53.881618267 +0000 UTC m=+1153.599516349" watchObservedRunningTime="2026-06-03 18:06:53.883184311 +0000 UTC m=+1153.601082389" Jun 03 18:06:53.989811 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:53.989787 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6r2b2_b1e8bbba-7978-4536-8e7b-42b4764c0105/node-ca/0.log" Jun 03 18:06:54.892328 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:54.892295 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-2h8hk_254ddc0e-41d1-4ddf-89ee-d44c942a5b1a/discovery/0.log" Jun 03 18:06:54.911243 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:54.911209 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58fd596d6f-lgl6c_dda319b6-702b-45d8-895b-8aaa70f99ba0/kube-auth-proxy/0.log" Jun 03 18:06:54.958635 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:54.958604 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-ldc5m_74ab5b32-534e-4904-93e1-0f103553adfb/istio-proxy/0.log" Jun 03 18:06:54.979552 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:54.979528 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-q9mwb_bfadefbe-01ba-494e-af93-dcec510bf4e1/payload-processing/0.log" Jun 03 18:06:55.006635 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:55.006607 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-96f4f4fdc-mg5vn_c7ce78f4-1229-4f88-a5c1-d5893b88355b/router/0.log" Jun 03 18:06:55.566534 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:55.566504 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hs2sn_9b62338f-c99c-4ba4-85f2-943e89c1e108/serve-healthcheck-canary/0.log" Jun 03 18:06:56.015267 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:56.015236 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-t75km_7f40eb91-2641-4602-8322-cb0b7b89947c/insights-operator/0.log" Jun 03 18:06:56.037873 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:56.037848 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ncl9_bfd45fc6-d56e-490e-a731-7f1dbd299af9/kube-rbac-proxy/0.log" Jun 03 18:06:56.058476 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:56.058445 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ncl9_bfd45fc6-d56e-490e-a731-7f1dbd299af9/exporter/0.log" Jun 03 18:06:56.077773 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:56.077729 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9ncl9_bfd45fc6-d56e-490e-a731-7f1dbd299af9/extractor/0.log" Jun 03 18:06:58.185075 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:58.185047 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-74c696fb4c-mkhkd_48edec0b-eee6-46bf-b676-c50e4f4c7437/nginx/0.log" Jun 03 18:06:58.207910 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:58.207880 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-4795b_2ab03d6a-7e81-4d36-82b3-395ae5fd38ab/manager/0.log" Jun 03 18:06:58.265636 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:58.265608 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6b8b778955-k4fk6_6a0f835c-9d82-4519-96ae-ac789ccc4f85/maas-api/0.log" Jun 03 18:06:58.336859 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:58.336829 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-gkvgb_0bf7b384-eb3c-4080-ba77-5ab9eee9dbcb/server/0.log" Jun 03 18:06:58.380781 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:58.380755 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-fbv6c_9d327321-86a1-424a-abc1-b44c88397179/manager/0.log" Jun 03 18:06:58.492911 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:58.492886 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cggj5_11ffd21e-4db0-4627-b712-6b0d681871d1/manager/0.log" Jun 03 18:06:58.511186 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:58.511164 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-99c86d98-cggj5_11ffd21e-4db0-4627-b712-6b0d681871d1/copy-manifests/0.log" Jun 03 18:06:59.881248 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:06:59.881221 2570 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zjbgd/perf-node-gather-daemonset-lrsdk" Jun 03 18:07:05.177686 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:05.177651 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-96ddc787c-z8v2t_607adca6-6c2b-457e-b325-c05ec6df1ea4/kube-storage-version-migrator-operator/0.log" Jun 03 18:07:06.426742 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.426713 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pj5bw_355a496a-311c-48ac-b015-53aa82b57375/kube-multus-additional-cni-plugins/0.log" Jun 03 18:07:06.446742 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.446705 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pj5bw_355a496a-311c-48ac-b015-53aa82b57375/egress-router-binary-copy/0.log" Jun 03 18:07:06.473153 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.473125 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pj5bw_355a496a-311c-48ac-b015-53aa82b57375/cni-plugins/0.log" Jun 03 18:07:06.490611 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.490582 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pj5bw_355a496a-311c-48ac-b015-53aa82b57375/bond-cni-plugin/0.log" Jun 03 18:07:06.510290 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.510260 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pj5bw_355a496a-311c-48ac-b015-53aa82b57375/routeoverride-cni/0.log" Jun 03 18:07:06.528874 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.528852 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pj5bw_355a496a-311c-48ac-b015-53aa82b57375/whereabouts-cni-bincopy/0.log" Jun 03 18:07:06.548772 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.548739 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pj5bw_355a496a-311c-48ac-b015-53aa82b57375/whereabouts-cni/0.log" Jun 03 18:07:06.777979 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.777952 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kzmmh_d4dd0ab8-58ff-4d07-bf52-e68ff9ff6c6d/kube-multus/0.log" Jun 03 18:07:06.797066 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.797039 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8qwfz_b2fbf7b7-252b-4db4-958a-b9c2883808b9/network-metrics-daemon/0.log" Jun 03 18:07:06.817927 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:06.817908 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8qwfz_b2fbf7b7-252b-4db4-958a-b9c2883808b9/kube-rbac-proxy/0.log" Jun 03 18:07:07.978945 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:07.978912 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/ovn-controller/0.log" Jun 03 18:07:08.001975 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:08.001948 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/ovn-acl-logging/0.log" Jun 03 18:07:08.020177 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:08.020146 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/kube-rbac-proxy-node/0.log" Jun 03 18:07:08.040587 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:08.040559 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 18:07:08.060433 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:08.060408 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/northd/0.log" Jun 03 18:07:08.081447 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:08.081420 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/nbdb/0.log" Jun 03 18:07:08.103518 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:08.103494 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/sbdb/0.log" Jun 03 18:07:08.199794 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:08.199770 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbbpw_cae23931-e01c-415e-800d-321d8cc77390/ovnkube-controller/0.log" Jun 03 18:07:09.570078 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:09.570044 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-56d84b9f44-xwprz_c8398a03-f682-4db0-8c48-63eabcf67597/check-endpoints/0.log" Jun 03 18:07:09.641664 ip-10-0-128-111 kubenswrapper[2570]: I0603 18:07:09.641638 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-sjdwg_27eeb238-3d08-4a69-93ed-647589658ac7/network-check-target-container/0.log"