Jun 03 16:41:06.404412 ip-10-0-141-18 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 16:41:06.404425 ip-10-0-141-18 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 16:41:06.404433 ip-10-0-141-18 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 16:41:06.404673 ip-10-0-141-18 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 16:41:16.571819 ip-10-0-141-18 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 16:41:16.571854 ip-10-0-141-18 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6076e9dbc4d840fdb9855763aae48392 -- Jun 03 16:43:46.479073 ip-10-0-141-18 systemd[1]: Starting Kubernetes Kubelet... Jun 03 16:43:46.923764 ip-10-0-141-18 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:43:46.923764 ip-10-0-141-18 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 16:43:46.923764 ip-10-0-141-18 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:43:46.923764 ip-10-0-141-18 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 16:43:46.923764 ip-10-0-141-18 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 16:43:46.925420 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.925335 2577 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 16:43:46.932693 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932676 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:43:46.932693 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932692 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932696 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932699 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932701 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932704 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932707 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932709 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932712 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932714 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932717 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932719 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932726 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932742 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932747 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932750 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932753 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932755 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932758 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932760 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932763 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:43:46.932785 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932765 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932768 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932771 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932773 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932776 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932778 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932781 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932783 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932786 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932789 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932791 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932794 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932797 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932800 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932802 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932805 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932808 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932810 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932813 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932815 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:43:46.933255 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932817 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932820 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932823 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932825 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932828 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932831 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932833 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932835 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932838 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932840 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932843 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932845 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932851 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932855 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932859 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932862 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932864 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932867 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932869 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:43:46.933787 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932873 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932875 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932878 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932881 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932883 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932887 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932890 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932894 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932896 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932899 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932901 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932903 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932906 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932908 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932911 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932913 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932916 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932919 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932922 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:43:46.934253 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932925 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932928 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932931 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932933 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932935 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932938 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.932941 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933936 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933943 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933947 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933949 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933952 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933955 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933958 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933961 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933964 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933967 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933970 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933972 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933975 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:43:46.934703 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933977 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933980 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933983 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933985 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933987 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933990 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933992 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933995 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.933998 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934000 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934003 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934006 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934009 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934011 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934014 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934017 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934019 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934022 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934025 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:43:46.935456 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934028 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934031 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934034 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934036 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934039 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934041 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934044 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934048 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934052 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934056 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934058 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934061 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934063 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934066 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934068 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934071 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934073 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934076 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934078 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934080 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:43:46.936025 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934083 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934086 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934088 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934090 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934093 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934096 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934098 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934101 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934103 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934106 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934108 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934111 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934113 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934116 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934118 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934121 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934124 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934126 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934129 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934132 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:43:46.936547 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934135 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934139 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934142 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934145 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934148 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934150 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934153 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934155 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934158 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934160 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934163 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934165 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934168 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.934170 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934236 2577 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934242 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934248 2577 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934253 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934258 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934262 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 16:43:46.937103 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934266 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934270 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934274 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934277 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934280 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934284 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934287 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934290 2577 flags.go:64] FLAG: --cgroup-root="" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934293 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934296 2577 flags.go:64] FLAG: --client-ca-file="" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934299 2577 flags.go:64] FLAG: --cloud-config="" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934301 2577 flags.go:64] FLAG: --cloud-provider="external" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934304 2577 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934308 2577 flags.go:64] FLAG: --cluster-domain="" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934311 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934314 2577 flags.go:64] FLAG: --config-dir="" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934317 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934321 2577 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934324 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934327 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934331 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934334 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934338 2577 flags.go:64] FLAG: --contention-profiling="false" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934341 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 16:43:46.937593 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934344 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934347 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934350 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934353 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934356 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934362 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934365 2577 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934369 2577 flags.go:64] FLAG: --enable-server="true" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934372 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934376 2577 flags.go:64] FLAG: --event-burst="100" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934380 2577 flags.go:64] FLAG: --event-qps="50" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934382 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934386 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934389 2577 flags.go:64] FLAG: --eviction-hard="" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934393 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934396 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934399 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934402 2577 flags.go:64] FLAG: --eviction-soft="" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934405 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934408 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934411 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934414 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934417 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934419 2577 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934422 2577 flags.go:64] FLAG: --feature-gates="" Jun 03 16:43:46.938177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934426 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934429 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934432 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934435 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934438 2577 flags.go:64] FLAG: --healthz-port="10248" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934441 2577 flags.go:64] FLAG: --help="false" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934444 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-141-18.ec2.internal" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934447 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934450 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934453 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934456 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934459 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934464 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934467 2577 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934469 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934473 2577 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934476 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934479 2577 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934482 2577 flags.go:64] FLAG: --kube-reserved="" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934485 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934488 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934491 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934494 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934496 2577 flags.go:64] FLAG: --lock-file="" Jun 03 16:43:46.938799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934499 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934502 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934505 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934510 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934513 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934516 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934518 2577 flags.go:64] FLAG: --logging-format="text" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934521 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934525 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934528 2577 flags.go:64] FLAG: --manifest-url="" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934530 2577 flags.go:64] FLAG: --manifest-url-header="" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934534 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934537 2577 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934541 2577 flags.go:64] FLAG: --max-pods="110" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934544 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934547 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934550 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934553 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934556 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934559 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934567 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934574 2577 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934578 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934581 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 16:43:46.939367 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934584 2577 flags.go:64] FLAG: --pod-cidr="" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934587 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934672 2577 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934679 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934688 2577 flags.go:64] FLAG: --pods-per-core="0" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934693 2577 flags.go:64] FLAG: --port="10250" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934699 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934704 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab3e93c444d8a164" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934711 2577 flags.go:64] FLAG: --qos-reserved="" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934717 2577 flags.go:64] FLAG: --read-only-port="10255" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.934722 2577 flags.go:64] FLAG: --register-node="true" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936190 2577 flags.go:64] FLAG: --register-schedulable="true" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936337 2577 flags.go:64] FLAG: --register-with-taints="" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936356 2577 flags.go:64] FLAG: --registry-burst="10" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936361 2577 flags.go:64] FLAG: --registry-qps="5" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936366 2577 flags.go:64] FLAG: --reserved-cpus="" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936371 2577 flags.go:64] FLAG: --reserved-memory="" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936377 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936383 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936388 2577 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936393 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936398 2577 flags.go:64] FLAG: --runonce="false" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936409 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936414 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936420 2577 flags.go:64] FLAG: --seccomp-default="false" Jun 03 16:43:46.940069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936425 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936429 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936434 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936440 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936445 2577 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936449 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936454 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936459 2577 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936464 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936468 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936473 2577 flags.go:64] FLAG: --system-cgroups="" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936480 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936493 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936499 2577 flags.go:64] FLAG: --tls-cert-file="" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936503 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936510 2577 flags.go:64] FLAG: --tls-min-version="" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936515 2577 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936519 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936523 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936526 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936529 2577 flags.go:64] FLAG: --v="2" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936534 2577 flags.go:64] FLAG: --version="false" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936538 2577 flags.go:64] FLAG: --vmodule="" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936542 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.936546 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 16:43:46.940693 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936640 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936644 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936647 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936650 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936654 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936657 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936660 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936662 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936665 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936668 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936670 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936673 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936675 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936678 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936681 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936684 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936689 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936693 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936697 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936700 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:43:46.941309 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936703 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936705 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936708 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936711 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936713 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936716 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936718 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936721 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936723 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936726 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936728 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936746 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936749 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936752 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936754 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936757 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936760 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936763 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936766 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936768 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:43:46.941887 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936771 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936774 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936776 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936779 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936781 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936784 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936786 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936789 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936791 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936794 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936796 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936799 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936803 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936807 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936810 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936814 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936818 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936821 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936824 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:43:46.942493 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936827 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936829 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936832 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936835 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936838 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936841 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936844 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936846 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936849 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936852 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936855 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936858 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936861 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936864 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936867 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936870 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936872 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936875 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936878 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936880 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:43:46.943328 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936883 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:43:46.944200 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936886 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:43:46.944200 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936888 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:43:46.944200 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936891 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:43:46.944200 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936893 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:43:46.944200 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936896 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:43:46.944200 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.936899 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:43:46.944200 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.937444 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.944245 2577 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.944268 2577 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944339 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944347 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944352 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944357 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944361 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944366 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944372 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944376 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944380 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944385 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944390 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944394 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944398 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944411 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944416 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944420 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944425 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:43:46.944523 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944429 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944433 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944437 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944441 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944446 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944450 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944454 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944458 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944462 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944467 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944471 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944477 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944483 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944489 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944495 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944500 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944505 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944510 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944515 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:43:46.945490 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944519 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944524 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944528 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944535 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944539 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944544 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944548 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944552 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944556 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944560 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944564 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944569 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944573 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944577 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944581 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944586 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944590 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944594 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944598 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944602 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:43:46.945990 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944606 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944610 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944615 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944619 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944623 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944627 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944631 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944635 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944640 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944645 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944649 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944653 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944657 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944664 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944669 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944672 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944677 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944683 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944687 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944691 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:43:46.946576 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944695 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944700 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944704 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944708 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944712 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944716 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944720 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944724 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944729 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944756 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.944764 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944930 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944938 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944942 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944947 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 16:43:46.947461 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944952 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944956 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944961 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944965 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944970 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944974 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944978 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944983 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944987 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944991 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.944996 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945000 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945005 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945009 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945014 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945018 2577 feature_gate.go:328] unrecognized feature gate: Example Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945023 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945027 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945031 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945036 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 16:43:46.948163 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945040 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945044 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945048 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945052 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945058 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945064 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945069 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945073 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945078 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945083 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945087 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945092 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945097 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945101 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945106 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945110 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945114 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945118 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945122 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 16:43:46.948811 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945127 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945131 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945135 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945139 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945144 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945148 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945152 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945157 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945162 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945166 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945170 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945174 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945179 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945183 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945187 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945191 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945195 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945199 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945203 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945208 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 16:43:46.949284 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945212 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945216 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945220 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945224 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945228 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945233 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945237 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945242 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945246 2577 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945251 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945255 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945260 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945264 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945269 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945273 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945277 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945282 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945286 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945290 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945294 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 16:43:46.949842 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945298 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945303 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:46.945308 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.945315 2577 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.946007 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.948556 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.949644 2577 server.go:1019] "Starting client certificate rotation" Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.949755 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:43:46.950324 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.949787 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 16:43:46.973944 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.973921 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:43:46.975812 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.975793 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 16:43:46.994712 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:46.994689 2577 log.go:25] "Validated CRI v1 runtime API" Jun 03 16:43:47.000636 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.000621 2577 log.go:25] "Validated CRI v1 image API" Jun 03 16:43:47.001749 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.001713 2577 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 16:43:47.009988 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.009963 2577 fs.go:135] Filesystem UUIDs: map[09a5fb07-bb13-4588-859a-6f2a5ca62a6f:/dev/nvme0n1p3 70436d9d-2aef-4222-8cb1-923d58e1d637:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 03 16:43:47.010073 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.009985 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 16:43:47.010186 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.010170 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:43:47.014387 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.014275 2577 manager.go:217] Machine: {Timestamp:2026-06-03 16:43:47.013764693 +0000 UTC m=+0.421247206 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102963 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab785888b801146f8582badfc6523 SystemUUID:ec2ab785-888b-8011-46f8-582badfc6523 BootID:6076e9db-c4d8-40fd-b985-5763aae48392 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:9f:7f:b3:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:9f:7f:b3:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:8c:65:f7:af:a7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 16:43:47.015109 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.015095 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 16:43:47.015222 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.015206 2577 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 16:43:47.016979 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.016954 2577 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 16:43:47.017115 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.016981 2577 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-18.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 16:43:47.017166 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.017125 2577 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 16:43:47.017166 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.017133 2577 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 16:43:47.017166 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.017141 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:43:47.017941 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.017930 2577 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 16:43:47.019229 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.019219 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:43:47.019503 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.019493 2577 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 16:43:47.021714 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.021704 2577 kubelet.go:491] "Attempting to sync node with API server" Jun 03 16:43:47.021769 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.021718 2577 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 16:43:47.021769 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.021743 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 16:43:47.021769 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.021752 2577 kubelet.go:397] "Adding apiserver pod source" Jun 03 16:43:47.021769 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.021761 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 16:43:47.022778 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.022767 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:43:47.022828 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.022785 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 16:43:47.025834 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.025812 2577 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 16:43:47.027783 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.027769 2577 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 16:43:47.030276 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030254 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030285 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030294 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030301 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030310 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030316 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030323 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030329 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030336 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030341 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030349 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 16:43:47.030352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.030356 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 16:43:47.031167 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.031156 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 16:43:47.031206 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.031169 2577 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 16:43:47.034613 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.034598 2577 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 16:43:47.034686 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.034634 2577 server.go:1295] "Started kubelet" Jun 03 16:43:47.034763 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.034704 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 16:43:47.034863 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.034847 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 16:43:47.034979 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.034933 2577 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 16:43:47.035076 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.034988 2577 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 16:43:47.035303 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.035284 2577 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-18.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 16:43:47.035370 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.035340 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 16:43:47.035550 ip-10-0-141-18 systemd[1]: Started Kubernetes Kubelet. Jun 03 16:43:47.036210 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.036143 2577 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 16:43:47.036935 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.036922 2577 server.go:317] "Adding debug handlers to kubelet server" Jun 03 16:43:47.040845 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.040023 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-18.ec2.internal.18b59fe37931fca7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-18.ec2.internal,UID:ip-10-0-141-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-18.ec2.internal,},FirstTimestamp:2026-06-03 16:43:47.034610855 +0000 UTC m=+0.442093368,LastTimestamp:2026-06-03 16:43:47.034610855 +0000 UTC m=+0.442093368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-18.ec2.internal,}" Jun 03 16:43:47.042402 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.042375 2577 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 16:43:47.043209 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.043192 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 16:43:47.044004 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.043992 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 16:43:47.044191 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.044182 2577 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 16:43:47.044251 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.044193 2577 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 16:43:47.044396 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.044358 2577 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 16:43:47.044455 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.044412 2577 reconstruct.go:97] "Volume reconstruction finished" Jun 03 16:43:47.044455 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.044420 2577 reconciler.go:26] "Reconciler: start to sync state" Jun 03 16:43:47.044946 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.044922 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.045090 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.045071 2577 factory.go:55] Registering systemd factory Jun 03 16:43:47.045176 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.045093 2577 factory.go:223] Registration of the systemd container factory successfully Jun 03 16:43:47.046059 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.046043 2577 factory.go:153] Registering CRI-O factory Jun 03 16:43:47.046059 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.046061 2577 factory.go:223] Registration of the crio container factory successfully Jun 03 16:43:47.046184 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.046111 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 16:43:47.046184 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.046131 2577 factory.go:103] Registering Raw factory Jun 03 16:43:47.046184 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.046146 2577 manager.go:1196] Started watching for new ooms in manager Jun 03 16:43:47.046912 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.046890 2577 manager.go:319] Starting recovery of all containers Jun 03 16:43:47.047172 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.047153 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 16:43:47.054521 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.054381 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vztd6" Jun 03 16:43:47.058559 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.058543 2577 manager.go:324] Recovery completed Jun 03 16:43:47.061246 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.061221 2577 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 16:43:47.062676 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.062665 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:43:47.064679 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.064660 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:43:47.064799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.064692 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:43:47.064799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.064703 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:43:47.064799 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.064776 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vztd6" Jun 03 16:43:47.065263 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.065246 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 16:43:47.065263 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.065260 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 16:43:47.065369 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.065278 2577 state_mem.go:36] "Initialized new in-memory state store" Jun 03 16:43:47.068369 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.068355 2577 policy_none.go:49] "None policy: Start" Jun 03 16:43:47.068451 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.068372 2577 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 16:43:47.068451 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.068383 2577 state_mem.go:35] "Initializing new in-memory state store" Jun 03 16:43:47.111268 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.111254 2577 manager.go:341] "Starting Device Plugin manager" Jun 03 16:43:47.111362 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.111300 2577 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 16:43:47.111362 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.111309 2577 server.go:85] "Starting device plugin registration server" Jun 03 16:43:47.111564 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.111549 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 16:43:47.111601 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.111562 2577 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 16:43:47.111669 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.111653 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 16:43:47.111756 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.111728 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 16:43:47.111756 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.111754 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 16:43:47.112333 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.112315 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 16:43:47.112414 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.112357 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.177813 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.177712 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 16:43:47.178940 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.178923 2577 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 16:43:47.179007 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.178951 2577 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 16:43:47.179007 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.178969 2577 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 16:43:47.179007 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.178977 2577 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 16:43:47.179144 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.179011 2577 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 16:43:47.181141 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.181118 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:43:47.211680 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.211638 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:43:47.212882 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.212863 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:43:47.212969 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.212897 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:43:47.212969 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.212912 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:43:47.212969 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.212940 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.225299 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.225279 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.225392 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.225302 2577 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-18.ec2.internal\": node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.280023 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.279990 2577 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal"] Jun 03 16:43:47.280182 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.280069 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:43:47.281436 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.281417 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:43:47.281535 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.281453 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:43:47.281535 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.281467 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:43:47.282639 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.282624 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:43:47.282806 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.282790 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.282860 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.282819 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:43:47.283388 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.283375 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:43:47.283388 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.283381 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:43:47.283468 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.283405 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:43:47.283468 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.283405 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:43:47.283468 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.283416 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:43:47.283468 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.283424 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:43:47.284386 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.284373 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.284443 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.284397 2577 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 16:43:47.285070 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.285057 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientMemory" Jun 03 16:43:47.285153 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.285079 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 16:43:47.285153 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.285089 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeHasSufficientPID" Jun 03 16:43:47.299248 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.299231 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.309391 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.309367 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-18.ec2.internal\" not found" node="ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.313569 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.313552 2577 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-18.ec2.internal\" not found" node="ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.399784 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.399757 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.446883 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.446826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab9922eb271972e23ed9988569fdb3c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal\" (UID: \"ab9922eb271972e23ed9988569fdb3c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.446883 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.446860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9922eb271972e23ed9988569fdb3c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal\" (UID: \"ab9922eb271972e23ed9988569fdb3c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.446883 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.446879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cde4eadd86c11b7e8e2f11f03cb015e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-18.ec2.internal\" (UID: \"7cde4eadd86c11b7e8e2f11f03cb015e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.500029 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.499995 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.547540 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.547512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab9922eb271972e23ed9988569fdb3c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal\" (UID: \"ab9922eb271972e23ed9988569fdb3c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.547589 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.547550 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab9922eb271972e23ed9988569fdb3c3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal\" (UID: \"ab9922eb271972e23ed9988569fdb3c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.547589 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.547586 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9922eb271972e23ed9988569fdb3c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal\" (UID: \"ab9922eb271972e23ed9988569fdb3c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.547647 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.547603 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cde4eadd86c11b7e8e2f11f03cb015e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-18.ec2.internal\" (UID: \"7cde4eadd86c11b7e8e2f11f03cb015e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.547647 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.547629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7cde4eadd86c11b7e8e2f11f03cb015e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-18.ec2.internal\" (UID: \"7cde4eadd86c11b7e8e2f11f03cb015e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.547708 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.547651 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab9922eb271972e23ed9988569fdb3c3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal\" (UID: \"ab9922eb271972e23ed9988569fdb3c3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.600638 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.600601 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.611790 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.611771 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.616363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.616350 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.701826 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.701752 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.802225 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.802186 2577 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-18.ec2.internal\" not found" Jun 03 16:43:47.899810 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.899787 2577 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:43:47.945127 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.945102 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.949778 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.949762 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 16:43:47.949879 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.949865 2577 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 16:43:47.949943 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:47.949922 2577 kubelet.go:3342] "Failed creating a mirror pod" err="Post \"https://a7f6468b2798e469e8787521613d8bf0-2c555d2f161c09ac.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.141.18:47554->34.194.235.185:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.949977 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.949946 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" Jun 03 16:43:47.970824 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:47.969532 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:43:48.022155 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.022127 2577 apiserver.go:52] "Watching apiserver" Jun 03 16:43:48.031379 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.031356 2577 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 16:43:48.033266 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.033241 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-jc56l","openshift-ovn-kubernetes/ovnkube-node-qxv8r","kube-system/konnectivity-agent-wbw48","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch","openshift-dns/node-resolver-tc277","openshift-multus/network-metrics-daemon-dhtsg","openshift-network-diagnostics/network-check-target-6bknm","openshift-network-operator/iptables-alerter-6kxbk","kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tcfw9","openshift-image-registry/node-ca-2x2v9","openshift-multus/multus-additional-cni-plugins-xfgcj"] Jun 03 16:43:48.034565 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.034548 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.036311 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.036289 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.036383 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.036302 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.037178 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.037160 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.037400 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.037381 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 16:43:48.037400 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.037392 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vt5lj\"" Jun 03 16:43:48.037544 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.037380 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 16:43:48.037598 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.037545 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 16:43:48.037690 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.037676 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 16:43:48.038174 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.038160 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.038725 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.038712 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 16:43:48.039174 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.039158 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:48.039257 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.039197 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 16:43:48.039257 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.039211 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:43:48.040108 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040095 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:48.040154 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.040143 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:43:48.040460 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040441 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 16:43:48.040536 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040463 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 16:43:48.040536 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040441 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 16:43:48.040536 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040467 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 16:43:48.040536 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040467 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 16:43:48.040747 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040492 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ktf7c\"" Jun 03 16:43:48.040931 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040918 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 16:43:48.040972 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040934 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 16:43:48.040972 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040936 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ctrdt\"" Jun 03 16:43:48.041030 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.040938 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ssw54\"" Jun 03 16:43:48.041264 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.041252 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.041910 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.041895 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 16:43:48.042011 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.041996 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 16:43:48.042056 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.042045 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 16:43:48.042154 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.042140 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 16:43:48.042216 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.042202 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r2qzg\"" Jun 03 16:43:48.042319 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.042307 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.043271 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.043251 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 16:43:48.043271 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.043268 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.044104 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.044086 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lzxm7\"" Jun 03 16:43:48.044177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.044106 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 16:43:48.044177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.044133 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:43:48.044177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.044152 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 16:43:48.044415 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.044390 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.045521 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.045502 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 16:43:48.046131 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.046109 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:43:48.046389 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.046283 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 16:43:48.046576 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.046559 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wfb7h\"" Jun 03 16:43:48.046657 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.046644 2577 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 16:43:48.046902 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.046885 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 16:43:48.046951 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.046942 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rptgk\"" Jun 03 16:43:48.047327 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.047311 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 16:43:48.047378 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.047365 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 16:43:48.047542 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.047526 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xctd4\"" Jun 03 16:43:48.049270 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.049206 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 16:43:48.049898 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.049871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-cni-multus\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.049898 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.049894 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-conf-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.049912 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-multus-certs\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.049930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-kubelet\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.050055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.049953 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.050055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.049978 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv2ll\" (UniqueName: \"kubernetes.io/projected/0336c145-90b5-41f7-8938-634fafc7bbc1-kube-api-access-dv2ll\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.050055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050000 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjqsd\" (UniqueName: \"kubernetes.io/projected/cc79f89e-5a00-4039-b647-cd0af3690ca7-kube-api-access-vjqsd\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.050055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-cni-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlztz\" (UniqueName: \"kubernetes.io/projected/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-kube-api-access-nlztz\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-etc-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-modprobe-d\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050121 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysctl-conf\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-tuned\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-serviceca\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050234 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050257 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jc46\" (UniqueName: \"kubernetes.io/projected/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-kube-api-access-2jc46\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050302 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-host\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.050363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050334 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4611c661-a784-4315-88a1-38d0f09cc3f3-konnectivity-ca\") pod \"konnectivity-agent-wbw48\" (UID: \"4611c661-a784-4315-88a1-38d0f09cc3f3\") " pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-etc-kubernetes\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0336c145-90b5-41f7-8938-634fafc7bbc1-tmp-dir\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050417 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-systemd\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050441 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-run-ovn-kubernetes\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovn-node-metrics-cert\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050478 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-cni-binary-copy\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050492 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-socket-dir-parent\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jw7j\" (UniqueName: \"kubernetes.io/projected/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-kube-api-access-8jw7j\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050533 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cnibin\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050551 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-netns\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050591 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-kubelet\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050613 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-system-cni-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050628 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-socket-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.050803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-device-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050656 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0336c145-90b5-41f7-8938-634fafc7bbc1-hosts-file\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc79f89e-5a00-4039-b647-cd0af3690ca7-host-slash\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cni-binary-copy\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050700 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050713 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-daemon-config\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-cni-netd\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050787 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-env-overrides\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdns\" (UniqueName: \"kubernetes.io/projected/9c6b6486-df8e-45bb-b8d0-024c5c749d05-kube-api-access-cwdns\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysctl-d\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050874 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-lib-modules\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050902 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmnz7\" (UniqueName: \"kubernetes.io/projected/2ca25510-f078-4fd3-a19d-6f3cca30a18f-kube-api-access-kmnz7\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050948 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-run-netns\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.050988 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-registration-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051016 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-run\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051040 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-var-lib-kubelet\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.051381 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051074 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dp4q\" (UniqueName: \"kubernetes.io/projected/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-kube-api-access-7dp4q\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051118 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4611c661-a784-4315-88a1-38d0f09cc3f3-agent-certs\") pod \"konnectivity-agent-wbw48\" (UID: \"4611c661-a784-4315-88a1-38d0f09cc3f3\") " pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051148 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-cnibin\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-etc-selinux\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysconfig\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051276 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-sys\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-host\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051331 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-system-cni-dir\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051353 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-node-log\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-log-socket\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-sys-fs\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-kubernetes\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051460 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xjzm\" (UniqueName: \"kubernetes.io/projected/f10eb032-87e3-4f19-8f07-8a414afd8725-kube-api-access-8xjzm\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051485 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-os-release\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051506 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-cni-bin\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-slash\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052000 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-tmp\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-k8s-cni-cncf-io\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc79f89e-5a00-4039-b647-cd0af3690ca7-iptables-alerter-script\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-ovn\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051684 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-cni-bin\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051701 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-systemd\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051723 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-hostroot\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-systemd-units\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051788 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-var-lib-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovnkube-config\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051845 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-os-release\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.052522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.051878 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovnkube-script-lib\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.054571 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.054553 2577 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 16:43:48.067080 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.067058 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 16:38:47 +0000 UTC" deadline="2027-11-22 15:11:33.016125417 +0000 UTC" Jun 03 16:43:48.067080 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.067079 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12886h27m44.949048885s" Jun 03 16:43:48.084863 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.084839 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzhd4" Jun 03 16:43:48.095497 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.095482 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vzhd4" Jun 03 16:43:48.152570 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152547 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjqsd\" (UniqueName: \"kubernetes.io/projected/cc79f89e-5a00-4039-b647-cd0af3690ca7-kube-api-access-vjqsd\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152577 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-cni-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152594 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nlztz\" (UniqueName: \"kubernetes.io/projected/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-kube-api-access-nlztz\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152635 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-etc-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152659 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-modprobe-d\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152669 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-cni-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152678 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysctl-conf\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152711 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-tuned\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152721 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-etc-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152744 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-serviceca\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.152772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152776 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152815 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152779 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-modprobe-d\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152843 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jc46\" (UniqueName: \"kubernetes.io/projected/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-kube-api-access-2jc46\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152866 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-host\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152876 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysctl-conf\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152904 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4611c661-a784-4315-88a1-38d0f09cc3f3-konnectivity-ca\") pod \"konnectivity-agent-wbw48\" (UID: \"4611c661-a784-4315-88a1-38d0f09cc3f3\") " pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152934 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-etc-kubernetes\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.152959 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0336c145-90b5-41f7-8938-634fafc7bbc1-tmp-dir\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153015 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-etc-kubernetes\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153127 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-systemd\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153117 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153207 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-systemd\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153222 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-host\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153253 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-run-ovn-kubernetes\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153324 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-run-ovn-kubernetes\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.153338 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153325 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovn-node-metrics-cert\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153363 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-cni-binary-copy\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153414 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-socket-dir-parent\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153443 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jw7j\" (UniqueName: \"kubernetes.io/projected/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-kube-api-access-8jw7j\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153485 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153494 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4611c661-a784-4315-88a1-38d0f09cc3f3-konnectivity-ca\") pod \"konnectivity-agent-wbw48\" (UID: \"4611c661-a784-4315-88a1-38d0f09cc3f3\") " pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153510 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cnibin\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153536 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153576 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-netns\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153601 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-kubelet\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153603 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153655 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-system-cni-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153413 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-serviceca\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153678 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-socket-dir-parent\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153684 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-socket-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153713 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0336c145-90b5-41f7-8938-634fafc7bbc1-tmp-dir\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-netns\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.154117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153727 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-device-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153793 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-system-cni-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153815 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153797 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-device-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0336c145-90b5-41f7-8938-634fafc7bbc1-hosts-file\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.153839 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153792 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0336c145-90b5-41f7-8938-634fafc7bbc1-hosts-file\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153860 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cnibin\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-kubelet\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153873 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc79f89e-5a00-4039-b647-cd0af3690ca7-host-slash\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-socket-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.153913 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:48.653891988 +0000 UTC m=+2.061374507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153930 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-cni-binary-copy\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153943 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cni-binary-copy\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cc79f89e-5a00-4039-b647-cd0af3690ca7-host-slash\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.153983 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154037 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-daemon-config\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.155041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154064 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-cni-netd\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154109 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-cni-netd\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154138 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-env-overrides\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154163 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdns\" (UniqueName: \"kubernetes.io/projected/9c6b6486-df8e-45bb-b8d0-024c5c749d05-kube-api-access-cwdns\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154197 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysctl-d\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154217 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-lib-modules\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154239 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmnz7\" (UniqueName: \"kubernetes.io/projected/2ca25510-f078-4fd3-a19d-6f3cca30a18f-kube-api-access-kmnz7\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154260 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-run-netns\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154282 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-registration-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154301 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-run\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154321 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-var-lib-kubelet\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154354 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dp4q\" (UniqueName: \"kubernetes.io/projected/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-kube-api-access-7dp4q\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154376 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4611c661-a784-4315-88a1-38d0f09cc3f3-agent-certs\") pod \"konnectivity-agent-wbw48\" (UID: \"4611c661-a784-4315-88a1-38d0f09cc3f3\") " pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154414 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-cnibin\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154464 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154493 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154503 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2ca25510-f078-4fd3-a19d-6f3cca30a18f-cni-binary-copy\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.155919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154502 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-etc-selinux\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-daemon-config\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-run-netns\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154548 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysconfig\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysconfig\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-etc-selinux\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154618 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-run\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154675 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-sys\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154679 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-sysctl-d\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154721 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-lib-modules\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-sys\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-var-lib-kubelet\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154825 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154920 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-cnibin\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.154961 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-host\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155000 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-system-cni-dir\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155013 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-env-overrides\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155032 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-node-log\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.156794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-registration-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155085 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-log-socket\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155128 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-log-socket\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155130 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-node-log\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155190 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-host\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155200 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-sys-fs\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155234 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-system-cni-dir\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155229 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-kubernetes\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155336 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8xjzm\" (UniqueName: \"kubernetes.io/projected/f10eb032-87e3-4f19-8f07-8a414afd8725-kube-api-access-8xjzm\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155339 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-kubernetes\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155366 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-os-release\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155400 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-sys-fs\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155450 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-cni-bin\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155480 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-cni-bin\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155481 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-slash\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155532 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-tmp\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155567 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-k8s-cni-cncf-io\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155594 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.157583 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155621 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc79f89e-5a00-4039-b647-cd0af3690ca7-iptables-alerter-script\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155651 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-ovn\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155674 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-cni-bin\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155702 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-systemd\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155726 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-hostroot\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155764 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-systemd-units\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155791 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-var-lib-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155819 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovnkube-config\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155830 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-slash\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155849 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-os-release\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155908 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-os-release\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-cni-bin\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155952 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovnkube-script-lib\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.155988 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-cni-multus\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156014 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-conf-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156040 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-multus-certs\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156071 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-kubelet\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156161 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.158365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156188 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dv2ll\" (UniqueName: \"kubernetes.io/projected/0336c145-90b5-41f7-8938-634fafc7bbc1-kube-api-access-dv2ll\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156297 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-k8s-cni-cncf-io\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156357 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2ca25510-f078-4fd3-a19d-6f3cca30a18f-os-release\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156445 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-host-kubelet\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovnkube-script-lib\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156482 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-systemd\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156509 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-var-lib-openvswitch\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156550 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-systemd-units\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c6b6486-df8e-45bb-b8d0-024c5c749d05-run-ovn\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156514 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-hostroot\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156644 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-run-multus-certs\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-host-var-lib-cni-multus\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156749 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.156757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-multus-conf-dir\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.157040 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovnkube-config\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.157149 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-etc-tuned\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.157272 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c6b6486-df8e-45bb-b8d0-024c5c749d05-ovn-node-metrics-cert\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.159207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.157305 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cc79f89e-5a00-4039-b647-cd0af3690ca7-iptables-alerter-script\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.160030 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.157435 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4611c661-a784-4315-88a1-38d0f09cc3f3-agent-certs\") pod \"konnectivity-agent-wbw48\" (UID: \"4611c661-a784-4315-88a1-38d0f09cc3f3\") " pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.160030 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.158489 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-tmp\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.183979 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.183958 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:43:48.183979 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.183978 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:43:48.184121 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.183988 2577 projected.go:194] Error preparing data for projected volume kube-api-access-l89zv for pod openshift-network-diagnostics/network-check-target-6bknm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:48.184121 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.184043 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv podName:9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d nodeName:}" failed. No retries permitted until 2026-06-03 16:43:48.684028862 +0000 UTC m=+2.091511375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l89zv" (UniqueName: "kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv") pod "network-check-target-6bknm" (UID: "9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:48.184121 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.184089 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjqsd\" (UniqueName: \"kubernetes.io/projected/cc79f89e-5a00-4039-b647-cd0af3690ca7-kube-api-access-vjqsd\") pod \"iptables-alerter-6kxbk\" (UID: \"cc79f89e-5a00-4039-b647-cd0af3690ca7\") " pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.189776 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.189757 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv2ll\" (UniqueName: \"kubernetes.io/projected/0336c145-90b5-41f7-8938-634fafc7bbc1-kube-api-access-dv2ll\") pod \"node-resolver-tc277\" (UID: \"0336c145-90b5-41f7-8938-634fafc7bbc1\") " pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.202392 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.201538 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdns\" (UniqueName: \"kubernetes.io/projected/9c6b6486-df8e-45bb-b8d0-024c5c749d05-kube-api-access-cwdns\") pod \"ovnkube-node-qxv8r\" (UID: \"9c6b6486-df8e-45bb-b8d0-024c5c749d05\") " pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.202392 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.201567 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jc46\" (UniqueName: \"kubernetes.io/projected/1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1-kube-api-access-2jc46\") pod \"aws-ebs-csi-driver-node-772ch\" (UID: \"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.202392 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.201773 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jw7j\" (UniqueName: \"kubernetes.io/projected/2283ed9f-3ed8-4c76-9cde-85998b9c24a6-kube-api-access-8jw7j\") pod \"node-ca-2x2v9\" (UID: \"2283ed9f-3ed8-4c76-9cde-85998b9c24a6\") " pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.204104 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.204083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dp4q\" (UniqueName: \"kubernetes.io/projected/d6f1d4e2-a4aa-4913-a16c-3d79527df3c9-kube-api-access-7dp4q\") pod \"tuned-tcfw9\" (UID: \"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9\") " pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.204252 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.204178 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlztz\" (UniqueName: \"kubernetes.io/projected/e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb-kube-api-access-nlztz\") pod \"multus-jc56l\" (UID: \"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb\") " pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.204316 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.204258 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xjzm\" (UniqueName: \"kubernetes.io/projected/f10eb032-87e3-4f19-8f07-8a414afd8725-kube-api-access-8xjzm\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:48.204316 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.204293 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmnz7\" (UniqueName: \"kubernetes.io/projected/2ca25510-f078-4fd3-a19d-6f3cca30a18f-kube-api-access-kmnz7\") pod \"multus-additional-cni-plugins-xfgcj\" (UID: \"2ca25510-f078-4fd3-a19d-6f3cca30a18f\") " pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.210278 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.210262 2577 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:43:48.240975 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.240946 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9922eb271972e23ed9988569fdb3c3.slice/crio-0d14e1fa4389432a4451122cd339f045acd6d5ef738df56bad1b3e4faa25935d WatchSource:0}: Error finding container 0d14e1fa4389432a4451122cd339f045acd6d5ef738df56bad1b3e4faa25935d: Status 404 returned error can't find the container with id 0d14e1fa4389432a4451122cd339f045acd6d5ef738df56bad1b3e4faa25935d Jun 03 16:43:48.243075 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.243050 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cde4eadd86c11b7e8e2f11f03cb015e.slice/crio-652e246031b424ff4c260598ac8a06913eeae325b214a2a3bb4d2725e1981ffd WatchSource:0}: Error finding container 652e246031b424ff4c260598ac8a06913eeae325b214a2a3bb4d2725e1981ffd: Status 404 returned error can't find the container with id 652e246031b424ff4c260598ac8a06913eeae325b214a2a3bb4d2725e1981ffd Jun 03 16:43:48.245191 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.245177 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:43:48.329473 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.329443 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bxr4l"] Jun 03 16:43:48.331434 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.331419 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.331493 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.331476 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:43:48.358008 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.357983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fbf8258-133c-4f34-b043-8d4f3dddc872-dbus\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.358160 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.358043 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.358160 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.358098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fbf8258-133c-4f34-b043-8d4f3dddc872-kubelet-config\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.364053 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.364035 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jc56l" Jun 03 16:43:48.371090 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.371068 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c68bd0_e8fd_4a8b_b155_c7901fa7adbb.slice/crio-b3c46bbf76aad6bec8065c3bd6fe2db23462788ddd6164d97dc708e32d1a66de WatchSource:0}: Error finding container b3c46bbf76aad6bec8065c3bd6fe2db23462788ddd6164d97dc708e32d1a66de: Status 404 returned error can't find the container with id b3c46bbf76aad6bec8065c3bd6fe2db23462788ddd6164d97dc708e32d1a66de Jun 03 16:43:48.376036 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.376020 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:43:48.382014 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.381991 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c6b6486_df8e_45bb_b8d0_024c5c749d05.slice/crio-fce647e41ae426075019db2b4a7329d6e31b21565292f98257a984564fcd9f77 WatchSource:0}: Error finding container fce647e41ae426075019db2b4a7329d6e31b21565292f98257a984564fcd9f77: Status 404 returned error can't find the container with id fce647e41ae426075019db2b4a7329d6e31b21565292f98257a984564fcd9f77 Jun 03 16:43:48.395815 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.395796 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:43:48.399357 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.399340 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" Jun 03 16:43:48.403468 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.403442 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4611c661_a784_4315_88a1_38d0f09cc3f3.slice/crio-af929237989f08f701a435534964e5f28c28b7e1661ef5fbcffbdcbd09dcd095 WatchSource:0}: Error finding container af929237989f08f701a435534964e5f28c28b7e1661ef5fbcffbdcbd09dcd095: Status 404 returned error can't find the container with id af929237989f08f701a435534964e5f28c28b7e1661ef5fbcffbdcbd09dcd095 Jun 03 16:43:48.405931 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.405910 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eedbdf4_36f2_4944_9e36_6ea2bfd5cda1.slice/crio-5bf2c68a82aa89ad457bdba1a764577f79f7215aa7fa250a01d91a0bec3850ef WatchSource:0}: Error finding container 5bf2c68a82aa89ad457bdba1a764577f79f7215aa7fa250a01d91a0bec3850ef: Status 404 returned error can't find the container with id 5bf2c68a82aa89ad457bdba1a764577f79f7215aa7fa250a01d91a0bec3850ef Jun 03 16:43:48.431862 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.431834 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc277" Jun 03 16:43:48.437417 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.437395 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0336c145_90b5_41f7_8938_634fafc7bbc1.slice/crio-940bf859beebe9b29a5a32a91eee9065670ac47e51556ae5249e1d4581b65a3d WatchSource:0}: Error finding container 940bf859beebe9b29a5a32a91eee9065670ac47e51556ae5249e1d4581b65a3d: Status 404 returned error can't find the container with id 940bf859beebe9b29a5a32a91eee9065670ac47e51556ae5249e1d4581b65a3d Jun 03 16:43:48.446216 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.446200 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6kxbk" Jun 03 16:43:48.452231 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.452212 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc79f89e_5a00_4039_b647_cd0af3690ca7.slice/crio-d031232e7f6d1edd33147d4029485cd7ee6284edaac212e9e69fa6be04af4e93 WatchSource:0}: Error finding container d031232e7f6d1edd33147d4029485cd7ee6284edaac212e9e69fa6be04af4e93: Status 404 returned error can't find the container with id d031232e7f6d1edd33147d4029485cd7ee6284edaac212e9e69fa6be04af4e93 Jun 03 16:43:48.458478 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.458460 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fbf8258-133c-4f34-b043-8d4f3dddc872-kubelet-config\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.458567 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.458501 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fbf8258-133c-4f34-b043-8d4f3dddc872-dbus\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.458623 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.458588 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.458623 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.458594 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fbf8258-133c-4f34-b043-8d4f3dddc872-kubelet-config\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.458718 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.458683 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fbf8258-133c-4f34-b043-8d4f3dddc872-dbus\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.458718 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.458695 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:48.458825 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.458771 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret podName:4fbf8258-133c-4f34-b043-8d4f3dddc872 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:48.958750158 +0000 UTC m=+2.366232897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret") pod "global-pull-secret-syncer-bxr4l" (UID: "4fbf8258-133c-4f34-b043-8d4f3dddc872") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:48.466489 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.466473 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" Jun 03 16:43:48.471879 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.471860 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6f1d4e2_a4aa_4913_a16c_3d79527df3c9.slice/crio-902d43c04a104dc461f7c46c74fd8245fae57432fdedba7469d24de5ff0b9bd3 WatchSource:0}: Error finding container 902d43c04a104dc461f7c46c74fd8245fae57432fdedba7469d24de5ff0b9bd3: Status 404 returned error can't find the container with id 902d43c04a104dc461f7c46c74fd8245fae57432fdedba7469d24de5ff0b9bd3 Jun 03 16:43:48.474523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.474507 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2x2v9" Jun 03 16:43:48.479671 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.479627 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2283ed9f_3ed8_4c76_9cde_85998b9c24a6.slice/crio-56e52890af0c3ec1ba73f872a1e2880d50f6b64c8f35587036a03ec8f9152861 WatchSource:0}: Error finding container 56e52890af0c3ec1ba73f872a1e2880d50f6b64c8f35587036a03ec8f9152861: Status 404 returned error can't find the container with id 56e52890af0c3ec1ba73f872a1e2880d50f6b64c8f35587036a03ec8f9152861 Jun 03 16:43:48.496456 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.496437 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" Jun 03 16:43:48.502521 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:43:48.502501 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca25510_f078_4fd3_a19d_6f3cca30a18f.slice/crio-65e6c19eb3a431726a2e0357a8166d3b0bb3eb785fbbcce1a6ea13a621e9ac15 WatchSource:0}: Error finding container 65e6c19eb3a431726a2e0357a8166d3b0bb3eb785fbbcce1a6ea13a621e9ac15: Status 404 returned error can't find the container with id 65e6c19eb3a431726a2e0357a8166d3b0bb3eb785fbbcce1a6ea13a621e9ac15 Jun 03 16:43:48.536198 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.536174 2577 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:43:48.660890 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.660339 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:48.660890 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.660487 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:48.660890 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.660549 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:49.660532415 +0000 UTC m=+3.068014932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:48.761051 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.760975 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:48.761191 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.761127 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:43:48.761191 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.761143 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:43:48.761191 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.761151 2577 projected.go:194] Error preparing data for projected volume kube-api-access-l89zv for pod openshift-network-diagnostics/network-check-target-6bknm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:48.761302 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.761205 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv podName:9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d nodeName:}" failed. No retries permitted until 2026-06-03 16:43:49.761187132 +0000 UTC m=+3.168669645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l89zv" (UniqueName: "kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv") pod "network-check-target-6bknm" (UID: "9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:48.962242 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:48.962191 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:48.962928 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.962333 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:48.962928 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:48.962399 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret podName:4fbf8258-133c-4f34-b043-8d4f3dddc872 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:49.962380318 +0000 UTC m=+3.369862822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret") pod "global-pull-secret-syncer-bxr4l" (UID: "4fbf8258-133c-4f34-b043-8d4f3dddc872") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:49.097816 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.097707 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:38:48 +0000 UTC" deadline="2028-03-09 00:52:16.918387366 +0000 UTC" Jun 03 16:43:49.097816 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.097765 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15464h8m27.820627352s" Jun 03 16:43:49.179918 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.179886 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:49.180082 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.180014 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:43:49.200378 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.200315 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2x2v9" event={"ID":"2283ed9f-3ed8-4c76-9cde-85998b9c24a6","Type":"ContainerStarted","Data":"56e52890af0c3ec1ba73f872a1e2880d50f6b64c8f35587036a03ec8f9152861"} Jun 03 16:43:49.215928 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.215893 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc277" event={"ID":"0336c145-90b5-41f7-8938-634fafc7bbc1","Type":"ContainerStarted","Data":"940bf859beebe9b29a5a32a91eee9065670ac47e51556ae5249e1d4581b65a3d"} Jun 03 16:43:49.225056 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.225026 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wbw48" event={"ID":"4611c661-a784-4315-88a1-38d0f09cc3f3","Type":"ContainerStarted","Data":"af929237989f08f701a435534964e5f28c28b7e1661ef5fbcffbdcbd09dcd095"} Jun 03 16:43:49.243857 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.243796 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"fce647e41ae426075019db2b4a7329d6e31b21565292f98257a984564fcd9f77"} Jun 03 16:43:49.263158 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.263131 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" event={"ID":"7cde4eadd86c11b7e8e2f11f03cb015e","Type":"ContainerStarted","Data":"652e246031b424ff4c260598ac8a06913eeae325b214a2a3bb4d2725e1981ffd"} Jun 03 16:43:49.290265 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.290182 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerStarted","Data":"65e6c19eb3a431726a2e0357a8166d3b0bb3eb785fbbcce1a6ea13a621e9ac15"} Jun 03 16:43:49.298844 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.298794 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" event={"ID":"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9","Type":"ContainerStarted","Data":"902d43c04a104dc461f7c46c74fd8245fae57432fdedba7469d24de5ff0b9bd3"} Jun 03 16:43:49.320261 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.320078 2577 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 16:43:49.325434 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.325380 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6kxbk" event={"ID":"cc79f89e-5a00-4039-b647-cd0af3690ca7","Type":"ContainerStarted","Data":"d031232e7f6d1edd33147d4029485cd7ee6284edaac212e9e69fa6be04af4e93"} Jun 03 16:43:49.338347 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.338311 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" event={"ID":"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1","Type":"ContainerStarted","Data":"5bf2c68a82aa89ad457bdba1a764577f79f7215aa7fa250a01d91a0bec3850ef"} Jun 03 16:43:49.364917 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.364823 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jc56l" event={"ID":"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb","Type":"ContainerStarted","Data":"b3c46bbf76aad6bec8065c3bd6fe2db23462788ddd6164d97dc708e32d1a66de"} Jun 03 16:43:49.388956 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.388917 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" event={"ID":"ab9922eb271972e23ed9988569fdb3c3","Type":"ContainerStarted","Data":"0d14e1fa4389432a4451122cd339f045acd6d5ef738df56bad1b3e4faa25935d"} Jun 03 16:43:49.669225 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.669129 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:49.669381 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.669297 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:49.669381 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.669353 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:51.66933663 +0000 UTC m=+5.076819129 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:49.770134 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.770083 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:49.770311 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.770255 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:43:49.770311 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.770273 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:43:49.770311 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.770284 2577 projected.go:194] Error preparing data for projected volume kube-api-access-l89zv for pod openshift-network-diagnostics/network-check-target-6bknm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:49.770476 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.770340 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv podName:9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d nodeName:}" failed. No retries permitted until 2026-06-03 16:43:51.770322605 +0000 UTC m=+5.177805118 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l89zv" (UniqueName: "kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv") pod "network-check-target-6bknm" (UID: "9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:49.972061 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:49.971975 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:49.972508 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.972165 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:49.972508 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:49.972231 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret podName:4fbf8258-133c-4f34-b043-8d4f3dddc872 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:51.972212114 +0000 UTC m=+5.379694640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret") pod "global-pull-secret-syncer-bxr4l" (UID: "4fbf8258-133c-4f34-b043-8d4f3dddc872") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:50.098418 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:50.098373 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 16:38:48 +0000 UTC" deadline="2027-11-29 12:14:21.015892388 +0000 UTC" Jun 03 16:43:50.098418 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:50.098417 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13051h30m30.917479531s" Jun 03 16:43:50.179284 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:50.179182 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:50.179457 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:50.179320 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:43:50.179457 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:50.179365 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:50.179567 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:50.179487 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:43:51.182693 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:51.182444 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:51.183162 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.182807 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:43:51.690937 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:51.690311 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:51.690937 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.690515 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:51.690937 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.690581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:55.690560795 +0000 UTC m=+9.098043297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:51.791158 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:51.790866 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:51.791158 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.791049 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:43:51.791158 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.791074 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:43:51.791158 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.791087 2577 projected.go:194] Error preparing data for projected volume kube-api-access-l89zv for pod openshift-network-diagnostics/network-check-target-6bknm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:51.791158 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.791144 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv podName:9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d nodeName:}" failed. No retries permitted until 2026-06-03 16:43:55.791126335 +0000 UTC m=+9.198608840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l89zv" (UniqueName: "kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv") pod "network-check-target-6bknm" (UID: "9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:51.992309 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:51.992222 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:51.992481 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.992403 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:51.992560 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:51.992488 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret podName:4fbf8258-133c-4f34-b043-8d4f3dddc872 nodeName:}" failed. No retries permitted until 2026-06-03 16:43:55.992467548 +0000 UTC m=+9.399950073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret") pod "global-pull-secret-syncer-bxr4l" (UID: "4fbf8258-133c-4f34-b043-8d4f3dddc872") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:52.179476 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:52.179442 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:52.179634 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:52.179442 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:52.179634 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:52.179566 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:43:52.179803 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:52.179698 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:43:53.179939 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:53.179901 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:53.180313 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:53.180046 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:43:54.179686 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:54.179652 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:54.179888 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:54.179822 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:43:54.179888 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:54.179829 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:54.180001 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:54.179928 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:43:55.180066 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:55.180037 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:55.180529 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:55.180185 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:43:55.723913 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:55.723875 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:55.724081 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:55.724025 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:55.724150 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:55.724088 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:03.724073366 +0000 UTC m=+17.131555870 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:43:55.824282 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:55.824244 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:55.824489 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:55.824430 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:43:55.824489 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:55.824450 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:43:55.824489 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:55.824462 2577 projected.go:194] Error preparing data for projected volume kube-api-access-l89zv for pod openshift-network-diagnostics/network-check-target-6bknm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:55.824646 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:55.824521 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv podName:9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d nodeName:}" failed. No retries permitted until 2026-06-03 16:44:03.824502943 +0000 UTC m=+17.231985446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l89zv" (UniqueName: "kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv") pod "network-check-target-6bknm" (UID: "9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:43:56.026146 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:56.026031 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:56.026302 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:56.026201 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:56.026302 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:56.026261 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret podName:4fbf8258-133c-4f34-b043-8d4f3dddc872 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:04.026245499 +0000 UTC m=+17.433728013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret") pod "global-pull-secret-syncer-bxr4l" (UID: "4fbf8258-133c-4f34-b043-8d4f3dddc872") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:43:56.180081 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:56.180048 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:56.180495 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:56.180183 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:43:56.180630 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:56.180604 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:56.180766 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:56.180711 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:43:57.180371 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:57.180336 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:57.180801 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:57.180474 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:43:58.179371 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:58.179334 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:43:58.179553 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:58.179333 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:43:58.179553 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:58.179465 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:43:58.179674 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:58.179563 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:43:59.180333 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:43:59.180034 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:43:59.180333 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:43:59.180170 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:00.179621 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:00.179585 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:00.179792 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:00.179587 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:00.179792 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:00.179746 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:00.179897 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:00.179804 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:01.179807 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:01.179767 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:01.180281 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:01.179893 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:02.179298 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:02.179259 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:02.179457 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:02.179259 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:02.179457 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:02.179389 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:02.179457 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:02.179443 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:03.179682 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:03.179599 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:03.180080 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:03.179720 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:03.787182 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:03.787141 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:03.787405 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:03.787327 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:44:03.787580 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:03.787408 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:19.787386129 +0000 UTC m=+33.194868645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:44:03.887880 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:03.887843 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:03.888047 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:03.888020 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:44:03.888047 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:03.888042 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:44:03.888130 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:03.888052 2577 projected.go:194] Error preparing data for projected volume kube-api-access-l89zv for pod openshift-network-diagnostics/network-check-target-6bknm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:44:03.888130 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:03.888112 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv podName:9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d nodeName:}" failed. No retries permitted until 2026-06-03 16:44:19.888096283 +0000 UTC m=+33.295578783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l89zv" (UniqueName: "kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv") pod "network-check-target-6bknm" (UID: "9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:44:04.090172 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:04.090085 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:04.090328 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:04.090212 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:44:04.090328 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:04.090286 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret podName:4fbf8258-133c-4f34-b043-8d4f3dddc872 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:20.090270635 +0000 UTC m=+33.497753134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret") pod "global-pull-secret-syncer-bxr4l" (UID: "4fbf8258-133c-4f34-b043-8d4f3dddc872") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:44:04.179312 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:04.179277 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:04.179312 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:04.179300 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:04.179511 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:04.179391 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:04.179511 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:04.179488 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:05.179970 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:05.179935 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:05.180425 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:05.180061 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:06.180196 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:06.180163 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:06.180604 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:06.180163 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:06.180604 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:06.180271 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:06.180604 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:06.180383 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:07.180296 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:07.180262 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:07.180765 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:07.180343 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:08.180350 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.180138 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:08.180699 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.180259 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:08.180699 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:08.180486 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:08.180699 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:08.180609 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:08.428245 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.426639 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerStarted","Data":"3d7e7eccea211ddf40b3f236423930ff1a590fafcffd22a7e90b551e2f867891"} Jun 03 16:44:08.443122 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.443086 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" event={"ID":"d6f1d4e2-a4aa-4913-a16c-3d79527df3c9","Type":"ContainerStarted","Data":"d67a60f2d152091a5cd338dd3ce8ef8cde577161524508879c1939f39f74ac48"} Jun 03 16:44:08.445389 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.445359 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" event={"ID":"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1","Type":"ContainerStarted","Data":"bfdddc2fb805ee8c31ac2385f9274a42ca743ad7507b0a19348005e3499e4a6d"} Jun 03 16:44:08.447052 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.446993 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jc56l" event={"ID":"e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb","Type":"ContainerStarted","Data":"df8d0a5f0c9b2289970a8542ae47c767dcaf76f77ad2c8af538b673ae8ecb887"} Jun 03 16:44:08.453439 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.453414 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wbw48" event={"ID":"4611c661-a784-4315-88a1-38d0f09cc3f3","Type":"ContainerStarted","Data":"55c5f2296fa2476847734f04cb58f58c5baa8a3d5b4635561b5287d1a764318b"} Jun 03 16:44:08.455395 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.455373 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"bd857362a1325a1d04d2bee8553175cd29f05570353ef25d8e42a67fda14a65d"} Jun 03 16:44:08.455480 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.455411 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"447e9f8b591238ea161514ac117c048107a7ec9fce81bc60abee7d047f2a7dd4"} Jun 03 16:44:08.455480 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.455422 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"ac35daea0299833405e629ac1360925938db163df2d8313336a6b9442c377ae0"} Jun 03 16:44:08.456833 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.456814 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" event={"ID":"7cde4eadd86c11b7e8e2f11f03cb015e","Type":"ContainerStarted","Data":"d4bf3a6136f29eada97f1866532842d7b9161a1aeba7e325e0bdf860779d5e11"} Jun 03 16:44:08.459798 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.459724 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tcfw9" podStartSLOduration=2.280722874 podStartE2EDuration="21.459713874s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.473212971 +0000 UTC m=+1.880695474" lastFinishedPulling="2026-06-03 16:44:07.652203958 +0000 UTC m=+21.059686474" observedRunningTime="2026-06-03 16:44:08.459472065 +0000 UTC m=+21.866954585" watchObservedRunningTime="2026-06-03 16:44:08.459713874 +0000 UTC m=+21.867196405" Jun 03 16:44:08.472424 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.472356 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-18.ec2.internal" podStartSLOduration=21.472346083 podStartE2EDuration="21.472346083s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:44:08.472248249 +0000 UTC m=+21.879730774" watchObservedRunningTime="2026-06-03 16:44:08.472346083 +0000 UTC m=+21.879828605" Jun 03 16:44:08.489464 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.489430 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-jc56l" podStartSLOduration=2.196619681 podStartE2EDuration="21.48941951s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.372574519 +0000 UTC m=+1.780057019" lastFinishedPulling="2026-06-03 16:44:07.665374348 +0000 UTC m=+21.072856848" observedRunningTime="2026-06-03 16:44:08.489224787 +0000 UTC m=+21.896707310" watchObservedRunningTime="2026-06-03 16:44:08.48941951 +0000 UTC m=+21.896902033" Jun 03 16:44:08.525627 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:08.525593 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wbw48" podStartSLOduration=7.127885938 podStartE2EDuration="21.525582733s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.404818432 +0000 UTC m=+1.812300932" lastFinishedPulling="2026-06-03 16:44:02.802515222 +0000 UTC m=+16.209997727" observedRunningTime="2026-06-03 16:44:08.525193574 +0000 UTC m=+21.932676095" watchObservedRunningTime="2026-06-03 16:44:08.525582733 +0000 UTC m=+21.933065255" Jun 03 16:44:09.182274 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.182243 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:09.182965 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:09.182336 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:09.459966 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.459937 2577 generic.go:358] "Generic (PLEG): container finished" podID="ab9922eb271972e23ed9988569fdb3c3" containerID="bd339373a89c29a8b6dfb9b6865fc11c88d604f3b878e5322af4214edfec1f4a" exitCode=0 Jun 03 16:44:09.460085 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.460005 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" event={"ID":"ab9922eb271972e23ed9988569fdb3c3","Type":"ContainerDied","Data":"bd339373a89c29a8b6dfb9b6865fc11c88d604f3b878e5322af4214edfec1f4a"} Jun 03 16:44:09.460153 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.460139 2577 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" Jun 03 16:44:09.461195 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.461173 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2x2v9" event={"ID":"2283ed9f-3ed8-4c76-9cde-85998b9c24a6","Type":"ContainerStarted","Data":"d30a4c79b1f64434ad301214694a68543f4d1c57bea07887f67028e287ee575d"} Jun 03 16:44:09.462325 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.462297 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc277" event={"ID":"0336c145-90b5-41f7-8938-634fafc7bbc1","Type":"ContainerStarted","Data":"32a40dbb563a88757984131444c8e17a359e3c091072594549e0b4e1a454e419"} Jun 03 16:44:09.464948 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.464925 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"e6e0a5d2598c0819d6ac5fb740ffd082729582d46b396d72f7ef3f14cfc325cf"} Jun 03 16:44:09.465024 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.464951 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"f938426776440e6a0a1943e15af56625f79c37a7e64b5a7fdd26b04d643a8919"} Jun 03 16:44:09.465024 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.464964 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"be71ea8cc4cb3b6ebc059b4d422e18e3c8b5c917be5070affe49fc33534eeb4c"} Jun 03 16:44:09.466161 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.466139 2577 generic.go:358] "Generic (PLEG): container finished" podID="2ca25510-f078-4fd3-a19d-6f3cca30a18f" containerID="3d7e7eccea211ddf40b3f236423930ff1a590fafcffd22a7e90b551e2f867891" exitCode=0 Jun 03 16:44:09.466246 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.466208 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerDied","Data":"3d7e7eccea211ddf40b3f236423930ff1a590fafcffd22a7e90b551e2f867891"} Jun 03 16:44:09.467485 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.467418 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6kxbk" event={"ID":"cc79f89e-5a00-4039-b647-cd0af3690ca7","Type":"ContainerStarted","Data":"a062b164267f25af3ae188e570618b25eae7287d7c7335e3d7ed3e6757e89de7"} Jun 03 16:44:09.476211 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.476195 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 16:44:09.476787 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.476768 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal"] Jun 03 16:44:09.482754 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.482697 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2x2v9" podStartSLOduration=8.161103868 podStartE2EDuration="22.482683613s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.480991365 +0000 UTC m=+1.888473865" lastFinishedPulling="2026-06-03 16:44:02.802571105 +0000 UTC m=+16.210053610" observedRunningTime="2026-06-03 16:44:09.482554011 +0000 UTC m=+22.890036545" watchObservedRunningTime="2026-06-03 16:44:09.482683613 +0000 UTC m=+22.890166138" Jun 03 16:44:09.499355 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.499322 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-tc277" podStartSLOduration=3.286779844 podStartE2EDuration="22.499312279s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.438792628 +0000 UTC m=+1.846275132" lastFinishedPulling="2026-06-03 16:44:07.651325068 +0000 UTC m=+21.058807567" observedRunningTime="2026-06-03 16:44:09.498819004 +0000 UTC m=+22.906301525" watchObservedRunningTime="2026-06-03 16:44:09.499312279 +0000 UTC m=+22.906794800" Jun 03 16:44:09.519311 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.519274 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6kxbk" podStartSLOduration=3.323031813 podStartE2EDuration="22.519262008s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.453804328 +0000 UTC m=+1.861286828" lastFinishedPulling="2026-06-03 16:44:07.650034509 +0000 UTC m=+21.057517023" observedRunningTime="2026-06-03 16:44:09.518851021 +0000 UTC m=+22.926333542" watchObservedRunningTime="2026-06-03 16:44:09.519262008 +0000 UTC m=+22.926744529" Jun 03 16:44:09.543244 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:09.543215 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 16:44:10.123958 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.123855 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T16:44:09.543237491Z","UUID":"ebc0da08-5d08-4eb3-8471-92898e445892","Handler":null,"Name":"","Endpoint":""} Jun 03 16:44:10.126948 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.126805 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 16:44:10.126948 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.126832 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 16:44:10.179597 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.179564 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:10.179826 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.179566 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:10.179826 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:10.179695 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:10.179826 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:10.179753 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:10.470944 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.470860 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" event={"ID":"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1","Type":"ContainerStarted","Data":"61a54b4383082cebbe147615b2b33086325ebfa3e7571335e2e560ce2e34c058"} Jun 03 16:44:10.472681 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.472646 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" event={"ID":"ab9922eb271972e23ed9988569fdb3c3","Type":"ContainerStarted","Data":"cb8e4815ad3b0e7df12b1688af77295c8af861f03597ef44da9fadac7fdcc316"} Jun 03 16:44:10.507966 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.507907 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-18.ec2.internal" podStartSLOduration=1.507887839 podStartE2EDuration="1.507887839s" podCreationTimestamp="2026-06-03 16:44:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:44:10.507327791 +0000 UTC m=+23.914810314" watchObservedRunningTime="2026-06-03 16:44:10.507887839 +0000 UTC m=+23.915370363" Jun 03 16:44:10.693954 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.693920 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:44:10.695065 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:10.695045 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:44:11.182604 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:11.182577 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:11.182766 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:11.182667 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:11.475999 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:11.475962 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" event={"ID":"1eedbdf4-36f2-4944-9e36-6ea2bfd5cda1","Type":"ContainerStarted","Data":"4a1bd2d95db9839e295d7dfd2477b91b7a878d895ff1c4efebdeebc5eacd9c62"} Jun 03 16:44:11.478707 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:11.478682 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"5ad6d431ac009758ab3e3fe804c9080f3eae9f576dabd931c2dd2ccd5ebb2dbc"} Jun 03 16:44:11.478985 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:11.478971 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:44:11.479342 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:11.479328 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wbw48" Jun 03 16:44:11.512292 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:11.512249 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-772ch" podStartSLOduration=1.968462903 podStartE2EDuration="24.512237662s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.407387789 +0000 UTC m=+1.814870289" lastFinishedPulling="2026-06-03 16:44:10.951162548 +0000 UTC m=+24.358645048" observedRunningTime="2026-06-03 16:44:11.494810069 +0000 UTC m=+24.902292591" watchObservedRunningTime="2026-06-03 16:44:11.512237662 +0000 UTC m=+24.919720183" Jun 03 16:44:12.179960 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:12.179759 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:12.180150 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:12.179773 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:12.180150 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:12.180078 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:12.180150 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:12.180127 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:13.179626 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:13.179423 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:13.179626 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:13.179547 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:13.486911 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:13.486577 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" event={"ID":"9c6b6486-df8e-45bb-b8d0-024c5c749d05","Type":"ContainerStarted","Data":"8dd46b84540a03d95aad212eca197e2bd8c3908957b8109b0634dc426f21a40c"} Jun 03 16:44:13.487158 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:13.487138 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:44:13.487255 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:13.487170 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:44:13.505070 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:13.505036 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:44:13.515643 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:13.515587 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" podStartSLOduration=6.782105401 podStartE2EDuration="26.515569877s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.383870254 +0000 UTC m=+1.791352754" lastFinishedPulling="2026-06-03 16:44:08.117334716 +0000 UTC m=+21.524817230" observedRunningTime="2026-06-03 16:44:13.515109067 +0000 UTC m=+26.922591589" watchObservedRunningTime="2026-06-03 16:44:13.515569877 +0000 UTC m=+26.923052402" Jun 03 16:44:14.179599 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:14.179568 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:14.179599 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:14.179590 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:14.180085 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:14.179681 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:14.180085 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:14.179783 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:14.489267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:14.489171 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:44:14.506677 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:14.506651 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:44:15.179771 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:15.179723 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:15.180157 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:15.179859 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:15.301379 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:15.301344 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhtsg"] Jun 03 16:44:15.301548 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:15.301456 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:15.301611 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:15.301571 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:15.302155 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:15.302133 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6bknm"] Jun 03 16:44:15.316827 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:15.316805 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bxr4l"] Jun 03 16:44:15.316913 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:15.316881 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:15.316973 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:15.316957 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:15.490320 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:15.490238 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:15.490468 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:15.490330 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:16.493728 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:16.493695 2577 generic.go:358] "Generic (PLEG): container finished" podID="2ca25510-f078-4fd3-a19d-6f3cca30a18f" containerID="85b95f1d6bb3870afdbc4dbfa6d41f6938415b45a30a542a4b652f571126b6f0" exitCode=0 Jun 03 16:44:16.494101 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:16.493770 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerDied","Data":"85b95f1d6bb3870afdbc4dbfa6d41f6938415b45a30a542a4b652f571126b6f0"} Jun 03 16:44:17.180485 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:17.180441 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:17.180643 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:17.180548 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:17.180771 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:17.180744 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:17.180897 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:17.180771 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:17.180897 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:17.180867 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:17.180982 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:17.180948 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:18.499113 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:18.498930 2577 generic.go:358] "Generic (PLEG): container finished" podID="2ca25510-f078-4fd3-a19d-6f3cca30a18f" containerID="b82fcf6e1e44a4f3c37da73ef765f5abbc0db7015876722d1ed0cc29197b5d5b" exitCode=0 Jun 03 16:44:18.499113 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:18.499014 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerDied","Data":"b82fcf6e1e44a4f3c37da73ef765f5abbc0db7015876722d1ed0cc29197b5d5b"} Jun 03 16:44:19.179830 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:19.179798 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:19.179994 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:19.179798 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:19.179994 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.179924 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bknm" podUID="9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d" Jun 03 16:44:19.179994 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:19.179798 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:19.180123 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.180007 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:44:19.180123 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.180043 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bxr4l" podUID="4fbf8258-133c-4f34-b043-8d4f3dddc872" Jun 03 16:44:19.812600 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:19.812564 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:19.813144 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.812672 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:44:19.813144 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.812724 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:51.812711097 +0000 UTC m=+65.220193597 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 16:44:19.913754 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:19.913649 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:19.913964 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.913803 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 16:44:19.913964 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.913819 2577 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 16:44:19.913964 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.913828 2577 projected.go:194] Error preparing data for projected volume kube-api-access-l89zv for pod openshift-network-diagnostics/network-check-target-6bknm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:44:19.913964 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:19.913882 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv podName:9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d nodeName:}" failed. No retries permitted until 2026-06-03 16:44:51.913868359 +0000 UTC m=+65.321350860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l89zv" (UniqueName: "kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv") pod "network-check-target-6bknm" (UID: "9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 16:44:20.114863 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.114831 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:20.115029 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:20.114967 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 16:44:20.115029 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:20.115027 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret podName:4fbf8258-133c-4f34-b043-8d4f3dddc872 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:52.115013361 +0000 UTC m=+65.522495861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret") pod "global-pull-secret-syncer-bxr4l" (UID: "4fbf8258-133c-4f34-b043-8d4f3dddc872") : object "kube-system"/"original-pull-secret" not registered Jun 03 16:44:20.503921 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.503891 2577 generic.go:358] "Generic (PLEG): container finished" podID="2ca25510-f078-4fd3-a19d-6f3cca30a18f" containerID="3f37b96ade1843f78da4a8baa88d9f4d706ada8965bfb974d968b91a30231448" exitCode=0 Jun 03 16:44:20.504027 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.503938 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerDied","Data":"3f37b96ade1843f78da4a8baa88d9f4d706ada8965bfb974d968b91a30231448"} Jun 03 16:44:20.875417 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.875341 2577 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-18.ec2.internal" event="NodeReady" Jun 03 16:44:20.875791 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.875520 2577 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 16:44:20.911226 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.911180 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk"] Jun 03 16:44:20.915552 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.915522 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:20.915872 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.915812 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh"] Jun 03 16:44:20.918675 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.918650 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 16:44:20.918828 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.918809 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 16:44:20.919053 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.918760 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 16:44:20.919053 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.919034 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 16:44:20.919288 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.919268 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 16:44:20.919288 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.919284 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 16:44:20.919506 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.919489 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 16:44:20.919934 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.919918 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m"] Jun 03 16:44:20.920084 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.920063 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:20.922306 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.922287 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 03 16:44:20.922611 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.922595 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66d6f6fbbb-qw9pd"] Jun 03 16:44:20.922823 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.922804 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:20.926416 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.925427 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ggzhv\"" Jun 03 16:44:20.926416 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.925519 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 03 16:44:20.926416 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.925532 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:20.928117 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.928098 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 16:44:20.928247 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.928196 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 16:44:20.929018 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.928996 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9p26t\"" Jun 03 16:44:20.929170 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.929000 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 16:44:20.929985 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.929966 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bbddz"] Jun 03 16:44:20.932986 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.932914 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjtw"] Jun 03 16:44:20.933431 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.933417 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:20.934439 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.934421 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 16:44:20.935588 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.935571 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk"] Jun 03 16:44:20.935689 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.935679 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:20.936628 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.936609 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 16:44:20.936719 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.936657 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 16:44:20.936719 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.936678 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6lvq\"" Jun 03 16:44:20.938302 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.938099 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vw2lw\"" Jun 03 16:44:20.938302 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.938214 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 16:44:20.938302 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.938216 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 16:44:20.938302 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.938279 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 16:44:20.940913 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.940896 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh"] Jun 03 16:44:20.942049 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.941799 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66d6f6fbbb-qw9pd"] Jun 03 16:44:20.942775 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.942756 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjtw"] Jun 03 16:44:20.949352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.949333 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m"] Jun 03 16:44:20.954110 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:20.954088 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbddz"] Jun 03 16:44:21.019955 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.019922 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-certificates\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.020133 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.019963 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e0b5b82-ff28-4685-852d-8c4c308a43b9-ca-trust-extracted\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.020133 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.019984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d3dc6394-b8db-41d8-b96f-822457c8cbe6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.020133 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020039 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-image-registry-private-configuration\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.020133 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-ca\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.020133 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020086 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-hub\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.020133 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020116 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7f4d\" (UniqueName: \"kubernetes.io/projected/d3dc6394-b8db-41d8-b96f-822457c8cbe6-kube-api-access-b7f4d\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.020438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020139 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk6fr\" (UniqueName: \"kubernetes.io/projected/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-kube-api-access-qk6fr\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.020438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020167 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.020438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-tmp\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.020438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020275 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p4pj\" (UniqueName: \"kubernetes.io/projected/27988c7a-a15b-48c9-b73f-1b354a1fcda7-kube-api-access-8p4pj\") pod \"managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m\" (UID: \"27988c7a-a15b-48c9-b73f-1b354a1fcda7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:21.020438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020328 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-bound-sa-token\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.020783 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.020911 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.020911 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:21.020911 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020885 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn8sz\" (UniqueName: \"kubernetes.io/projected/875cab77-14b7-4328-9c63-b90a3af052ff-kube-api-access-tn8sz\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:21.021069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.020924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-installation-pull-secrets\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.021069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvjsd\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-kube-api-access-mvjsd\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.021069 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021054 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-trusted-ca\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.021207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021106 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.021207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021142 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzzrz\" (UniqueName: \"kubernetes.io/projected/dfe4aa4c-1d75-4756-b199-4a831115dc45-kube-api-access-qzzrz\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.021207 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe4aa4c-1d75-4756-b199-4a831115dc45-tmp-dir\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.021341 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe4aa4c-1d75-4756-b199-4a831115dc45-config-volume\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.021341 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-klusterlet-config\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.021341 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.021323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/27988c7a-a15b-48c9-b73f-1b354a1fcda7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m\" (UID: \"27988c7a-a15b-48c9-b73f-1b354a1fcda7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:21.121865 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.121825 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tn8sz\" (UniqueName: \"kubernetes.io/projected/875cab77-14b7-4328-9c63-b90a3af052ff-kube-api-access-tn8sz\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:21.122041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.121879 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-installation-pull-secrets\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.122041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.121906 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mvjsd\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-kube-api-access-mvjsd\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.122041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.121938 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-trusted-ca\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.122041 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.121976 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.122196 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122175 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qzzrz\" (UniqueName: \"kubernetes.io/projected/dfe4aa4c-1d75-4756-b199-4a831115dc45-kube-api-access-qzzrz\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.122231 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122220 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe4aa4c-1d75-4756-b199-4a831115dc45-tmp-dir\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.122363 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122303 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe4aa4c-1d75-4756-b199-4a831115dc45-config-volume\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.122454 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122377 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-klusterlet-config\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.122454 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122399 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/27988c7a-a15b-48c9-b73f-1b354a1fcda7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m\" (UID: \"27988c7a-a15b-48c9-b73f-1b354a1fcda7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:21.122454 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.122407 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:44:21.122454 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.122426 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:44:21.122454 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122447 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-certificates\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.122486 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:21.6224648 +0000 UTC m=+35.029947299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122528 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e0b5b82-ff28-4685-852d-8c4c308a43b9-ca-trust-extracted\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122557 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d3dc6394-b8db-41d8-b96f-822457c8cbe6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122592 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfe4aa4c-1d75-4756-b199-4a831115dc45-tmp-dir\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122609 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-image-registry-private-configuration\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122657 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-ca\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122681 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-hub\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122712 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b7f4d\" (UniqueName: \"kubernetes.io/projected/d3dc6394-b8db-41d8-b96f-822457c8cbe6-kube-api-access-b7f4d\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.122781 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122761 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qk6fr\" (UniqueName: \"kubernetes.io/projected/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-kube-api-access-qk6fr\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122790 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122814 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-tmp\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122843 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8p4pj\" (UniqueName: \"kubernetes.io/projected/27988c7a-a15b-48c9-b73f-1b354a1fcda7-kube-api-access-8p4pj\") pod \"managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m\" (UID: \"27988c7a-a15b-48c9-b73f-1b354a1fcda7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122874 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-bound-sa-token\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122899 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122923 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.122948 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.123058 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.123090 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-trusted-ca\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.123097 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-certificates\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.123103 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:21.623087571 +0000 UTC m=+35.030570072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:44:21.123217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.123194 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dfe4aa4c-1d75-4756-b199-4a831115dc45-config-volume\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.123793 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.123438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e0b5b82-ff28-4685-852d-8c4c308a43b9-ca-trust-extracted\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.124425 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.124030 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/d3dc6394-b8db-41d8-b96f-822457c8cbe6-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.124425 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.124322 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-tmp\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.124425 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.124345 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:44:21.124425 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.124411 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:21.624393806 +0000 UTC m=+35.031876320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:44:21.127523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.127446 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-hub\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.127613 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.127527 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-image-registry-private-configuration\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.127613 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.127589 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/27988c7a-a15b-48c9-b73f-1b354a1fcda7-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m\" (UID: \"27988c7a-a15b-48c9-b73f-1b354a1fcda7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:21.127796 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.127762 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.127915 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.127898 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.128017 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.127998 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-installation-pull-secrets\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.128070 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.128014 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d3dc6394-b8db-41d8-b96f-822457c8cbe6-ca\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.129288 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.129255 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-klusterlet-config\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.132079 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.131478 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvjsd\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-kube-api-access-mvjsd\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.132079 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.131786 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzzrz\" (UniqueName: \"kubernetes.io/projected/dfe4aa4c-1d75-4756-b199-4a831115dc45-kube-api-access-qzzrz\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.132079 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.132039 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn8sz\" (UniqueName: \"kubernetes.io/projected/875cab77-14b7-4328-9c63-b90a3af052ff-kube-api-access-tn8sz\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:21.133407 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.133383 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7f4d\" (UniqueName: \"kubernetes.io/projected/d3dc6394-b8db-41d8-b96f-822457c8cbe6-kube-api-access-b7f4d\") pod \"cluster-proxy-proxy-agent-6c79f7c4f8-fdktk\" (UID: \"d3dc6394-b8db-41d8-b96f-822457c8cbe6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.133509 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.133490 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk6fr\" (UniqueName: \"kubernetes.io/projected/c6946d74-7fe8-44ba-b33f-0e66fdf7c11f-kube-api-access-qk6fr\") pod \"klusterlet-addon-workmgr-b9696f9c4-pdlkh\" (UID: \"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.133613 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.133588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p4pj\" (UniqueName: \"kubernetes.io/projected/27988c7a-a15b-48c9-b73f-1b354a1fcda7-kube-api-access-8p4pj\") pod \"managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m\" (UID: \"27988c7a-a15b-48c9-b73f-1b354a1fcda7\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:21.133869 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.133718 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-bound-sa-token\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.179683 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.179556 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:21.179683 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.179585 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:21.179683 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.179556 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:21.182599 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.182571 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h6q5l\"" Jun 03 16:44:21.182599 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.182583 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:44:21.182816 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.182760 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:44:21.182874 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.182851 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fvvv\"" Jun 03 16:44:21.182969 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.182956 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:44:21.183012 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.182998 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 16:44:21.238233 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.238200 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:44:21.247152 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.247130 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:21.255057 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.255030 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" Jun 03 16:44:21.437818 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.437617 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh"] Jun 03 16:44:21.441515 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.441457 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m"] Jun 03 16:44:21.442465 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:44:21.442442 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6946d74_7fe8_44ba_b33f_0e66fdf7c11f.slice/crio-eb488fd2d1aae1cd1ccc44c48385cb8605dd55f3f8363aed5de4a1e51185ba94 WatchSource:0}: Error finding container eb488fd2d1aae1cd1ccc44c48385cb8605dd55f3f8363aed5de4a1e51185ba94: Status 404 returned error can't find the container with id eb488fd2d1aae1cd1ccc44c48385cb8605dd55f3f8363aed5de4a1e51185ba94 Jun 03 16:44:21.442560 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.442540 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk"] Jun 03 16:44:21.444033 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:44:21.444012 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27988c7a_a15b_48c9_b73f_1b354a1fcda7.slice/crio-eb0e9dddd63dad518365ba567dcc17c58620e7e6b438a0c96813eaebab9103df WatchSource:0}: Error finding container eb0e9dddd63dad518365ba567dcc17c58620e7e6b438a0c96813eaebab9103df: Status 404 returned error can't find the container with id eb0e9dddd63dad518365ba567dcc17c58620e7e6b438a0c96813eaebab9103df Jun 03 16:44:21.445849 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:44:21.445828 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3dc6394_b8db_41d8_b96f_822457c8cbe6.slice/crio-1e7b1ab49de7cdd5f6e4b2f409195e391f1c90ef4e5ea0c515fc5deeaad3df2a WatchSource:0}: Error finding container 1e7b1ab49de7cdd5f6e4b2f409195e391f1c90ef4e5ea0c515fc5deeaad3df2a: Status 404 returned error can't find the container with id 1e7b1ab49de7cdd5f6e4b2f409195e391f1c90ef4e5ea0c515fc5deeaad3df2a Jun 03 16:44:21.506884 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.506847 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" event={"ID":"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f","Type":"ContainerStarted","Data":"eb488fd2d1aae1cd1ccc44c48385cb8605dd55f3f8363aed5de4a1e51185ba94"} Jun 03 16:44:21.507913 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.507881 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" event={"ID":"d3dc6394-b8db-41d8-b96f-822457c8cbe6","Type":"ContainerStarted","Data":"1e7b1ab49de7cdd5f6e4b2f409195e391f1c90ef4e5ea0c515fc5deeaad3df2a"} Jun 03 16:44:21.508920 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.508893 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" event={"ID":"27988c7a-a15b-48c9-b73f-1b354a1fcda7","Type":"ContainerStarted","Data":"eb0e9dddd63dad518365ba567dcc17c58620e7e6b438a0c96813eaebab9103df"} Jun 03 16:44:21.626854 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.626811 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:21.626854 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.626857 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:21.627077 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.626973 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:44:21.627077 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.626992 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:44:21.627077 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.627034 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:22.627012904 +0000 UTC m=+36.034495413 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:44:21.627077 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:21.627052 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:21.627268 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.627095 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:22.627085628 +0000 UTC m=+36.034568128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:44:21.627268 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.627144 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:44:21.627268 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.627157 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:44:21.627268 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:21.627197 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:22.627179198 +0000 UTC m=+36.034661703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:44:22.637169 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:22.637131 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:22.637181 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:22.637242 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:22.637435 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:22.637450 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:22.637507 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:24.637489366 +0000 UTC m=+38.044971885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:22.637929 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:22.637978 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:24.637962549 +0000 UTC m=+38.045445064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:22.638033 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:44:22.638119 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:22.638064 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:24.638053267 +0000 UTC m=+38.045535968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:44:24.659748 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:24.659686 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:24.660208 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:24.659758 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:24.660208 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:24.659801 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:24.660208 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:24.659926 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:44:24.660208 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:24.659960 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:44:24.660208 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:24.660015 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:28.660001353 +0000 UTC m=+42.067483854 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:44:24.660487 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:24.660398 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:44:24.660487 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:24.660433 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:28.660423288 +0000 UTC m=+42.067905788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:44:24.660487 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:24.660474 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:44:24.660645 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:24.660492 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:28.660486154 +0000 UTC m=+42.067968654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:44:28.692618 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:28.692580 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:28.692618 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:28.692624 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:28.692674 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:28.692758 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:28.692813 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:36.692794967 +0000 UTC m=+50.100277468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:28.692818 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:28.692862 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:28.692874 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:28.692887 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:36.692870553 +0000 UTC m=+50.100353056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:44:28.693182 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:28.692908 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:36.692897361 +0000 UTC m=+50.100379876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:44:32.532310 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.532271 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" event={"ID":"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f","Type":"ContainerStarted","Data":"49a85206e35c7d0ac2cb16a50500b83c444169b306eba52a7281d17362fe6e73"} Jun 03 16:44:32.532858 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.532559 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:32.534350 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.534302 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" event={"ID":"d3dc6394-b8db-41d8-b96f-822457c8cbe6","Type":"ContainerStarted","Data":"e9762385fae2e4d807602638dd79dbb953673a4c9dd8e886762667060db65292"} Jun 03 16:44:32.535180 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.535156 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:44:32.539194 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.539152 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" event={"ID":"27988c7a-a15b-48c9-b73f-1b354a1fcda7","Type":"ContainerStarted","Data":"2d3f5a40dd78bdb02603e035a4608409a03dd6b79f11adb997e65c8c85e07aae"} Jun 03 16:44:32.542374 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.542349 2577 generic.go:358] "Generic (PLEG): container finished" podID="2ca25510-f078-4fd3-a19d-6f3cca30a18f" containerID="17d764f6474bb92dd950b5700fbe89c42006e58e0c0e099270266f4ceb459f02" exitCode=0 Jun 03 16:44:32.542483 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.542392 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerDied","Data":"17d764f6474bb92dd950b5700fbe89c42006e58e0c0e099270266f4ceb459f02"} Jun 03 16:44:32.550961 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.550833 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" podStartSLOduration=31.430954071 podStartE2EDuration="41.550821536s" podCreationTimestamp="2026-06-03 16:43:51 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.444484209 +0000 UTC m=+34.851966709" lastFinishedPulling="2026-06-03 16:44:31.56435166 +0000 UTC m=+44.971834174" observedRunningTime="2026-06-03 16:44:32.549542011 +0000 UTC m=+45.957024533" watchObservedRunningTime="2026-06-03 16:44:32.550821536 +0000 UTC m=+45.958304057" Jun 03 16:44:32.586453 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:32.586382 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" podStartSLOduration=31.461574741 podStartE2EDuration="41.586360896s" podCreationTimestamp="2026-06-03 16:43:51 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.446041834 +0000 UTC m=+34.853524337" lastFinishedPulling="2026-06-03 16:44:31.570827981 +0000 UTC m=+44.978310492" observedRunningTime="2026-06-03 16:44:32.585557492 +0000 UTC m=+45.993040014" watchObservedRunningTime="2026-06-03 16:44:32.586360896 +0000 UTC m=+45.993843419" Jun 03 16:44:33.548012 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:33.547974 2577 generic.go:358] "Generic (PLEG): container finished" podID="2ca25510-f078-4fd3-a19d-6f3cca30a18f" containerID="6fb41fefbbbf7f90633babee4742061786a59f2d1d6a1dd0d1668272fc78351e" exitCode=0 Jun 03 16:44:33.548465 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:33.548063 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerDied","Data":"6fb41fefbbbf7f90633babee4742061786a59f2d1d6a1dd0d1668272fc78351e"} Jun 03 16:44:34.553205 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:34.553177 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" event={"ID":"2ca25510-f078-4fd3-a19d-6f3cca30a18f","Type":"ContainerStarted","Data":"7cb752c7efc0763679fa37b6f74b4702738c8dd4d9495d412c9e036c5ab56687"} Jun 03 16:44:34.554715 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:34.554692 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" event={"ID":"d3dc6394-b8db-41d8-b96f-822457c8cbe6","Type":"ContainerStarted","Data":"ed411bef0bb50164ed4e613a4a3aa6226abbca47f48a48e1e1ce3375eb2e64b4"} Jun 03 16:44:34.581292 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:34.581244 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xfgcj" podStartSLOduration=4.521168572 podStartE2EDuration="47.581231758s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:43:48.503896656 +0000 UTC m=+1.911379156" lastFinishedPulling="2026-06-03 16:44:31.563959828 +0000 UTC m=+44.971442342" observedRunningTime="2026-06-03 16:44:34.577113827 +0000 UTC m=+47.984596350" watchObservedRunningTime="2026-06-03 16:44:34.581231758 +0000 UTC m=+47.988714279" Jun 03 16:44:35.558405 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:35.558371 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" event={"ID":"d3dc6394-b8db-41d8-b96f-822457c8cbe6","Type":"ContainerStarted","Data":"9c8df6983bb59ec787c906fb48065e49a90a09906903ffa4fa76677a52bb3acc"} Jun 03 16:44:35.579509 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:35.579460 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" podStartSLOduration=31.661578994 podStartE2EDuration="44.579444515s" podCreationTimestamp="2026-06-03 16:43:51 +0000 UTC" firstStartedPulling="2026-06-03 16:44:21.447671514 +0000 UTC m=+34.855154017" lastFinishedPulling="2026-06-03 16:44:34.365537024 +0000 UTC m=+47.773019538" observedRunningTime="2026-06-03 16:44:35.577868213 +0000 UTC m=+48.985350734" watchObservedRunningTime="2026-06-03 16:44:35.579444515 +0000 UTC m=+48.986927037" Jun 03 16:44:36.760944 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:36.760899 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:36.760944 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:36.760945 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:36.761041 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:36.761057 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:36.761097 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:44:52.761083608 +0000 UTC m=+66.168566108 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:36.761127 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:36.761138 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:52.761119046 +0000 UTC m=+66.168601547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:36.761190 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:36.761201 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:44:36.761474 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:36.761242 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:44:52.76123176 +0000 UTC m=+66.168714260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:44:46.513941 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:46.513911 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qxv8r" Jun 03 16:44:51.879747 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:51.879670 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:44:51.882891 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:51.882869 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 16:44:51.890359 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:51.890343 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 16:44:51.890417 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:51.890398 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:55.890382204 +0000 UTC m=+129.297864704 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : secret "metrics-daemon-secret" not found Jun 03 16:44:51.980620 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:51.980580 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:51.983875 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:51.983856 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 16:44:51.994289 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:51.994261 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 16:44:52.005073 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.005049 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89zv\" (UniqueName: \"kubernetes.io/projected/9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d-kube-api-access-l89zv\") pod \"network-check-target-6bknm\" (UID: \"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d\") " pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:52.094950 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.094918 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h6q5l\"" Jun 03 16:44:52.103362 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.103345 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:52.182500 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.182468 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:52.185627 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.185606 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 16:44:52.196199 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.196168 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fbf8258-133c-4f34-b043-8d4f3dddc872-original-pull-secret\") pod \"global-pull-secret-syncer-bxr4l\" (UID: \"4fbf8258-133c-4f34-b043-8d4f3dddc872\") " pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:52.222754 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.222708 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6bknm"] Jun 03 16:44:52.225920 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:44:52.225890 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f2c4d1d_9625_4f4d_af1d_1ad0cd6f363d.slice/crio-e5a951748dcb5b8690d13d8311d2b544786e3799d2901ba518a6f17fd147fa51 WatchSource:0}: Error finding container e5a951748dcb5b8690d13d8311d2b544786e3799d2901ba518a6f17fd147fa51: Status 404 returned error can't find the container with id e5a951748dcb5b8690d13d8311d2b544786e3799d2901ba518a6f17fd147fa51 Jun 03 16:44:52.399225 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.399184 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bxr4l" Jun 03 16:44:52.515761 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.515706 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bxr4l"] Jun 03 16:44:52.518833 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:44:52.518801 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbf8258_133c_4f34_b043_8d4f3dddc872.slice/crio-2752c991a9333a2db0b3ee5d592d0168bb41fa9da36bf0c1ff7a08b8b3c2dda2 WatchSource:0}: Error finding container 2752c991a9333a2db0b3ee5d592d0168bb41fa9da36bf0c1ff7a08b8b3c2dda2: Status 404 returned error can't find the container with id 2752c991a9333a2db0b3ee5d592d0168bb41fa9da36bf0c1ff7a08b8b3c2dda2 Jun 03 16:44:52.594919 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.594872 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bxr4l" event={"ID":"4fbf8258-133c-4f34-b043-8d4f3dddc872","Type":"ContainerStarted","Data":"2752c991a9333a2db0b3ee5d592d0168bb41fa9da36bf0c1ff7a08b8b3c2dda2"} Jun 03 16:44:52.595778 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.595754 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6bknm" event={"ID":"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d","Type":"ContainerStarted","Data":"e5a951748dcb5b8690d13d8311d2b544786e3799d2901ba518a6f17fd147fa51"} Jun 03 16:44:52.788089 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.787999 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:44:52.788089 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.788046 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:52.788092 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:52.788149 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:52.788210 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:24.788194397 +0000 UTC m=+98.195676898 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:52.788219 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:52.788233 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:52.788246 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:52.788274 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:45:24.788255492 +0000 UTC m=+98.195737992 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:44:52.788306 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:44:52.788295 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:45:24.78828426 +0000 UTC m=+98.195766765 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:44:57.606635 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:57.606601 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bxr4l" event={"ID":"4fbf8258-133c-4f34-b043-8d4f3dddc872","Type":"ContainerStarted","Data":"fc82c638c5279522810b7f3a1af41407c7e43e2627e3378dcd8d280e7de73aa4"} Jun 03 16:44:57.607863 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:57.607839 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6bknm" event={"ID":"9f2c4d1d-9625-4f4d-af1d-1ad0cd6f363d","Type":"ContainerStarted","Data":"54d24f11d3222f25ea1ba9e16f3314871ed05ad01e856304120d75a541e79b3e"} Jun 03 16:44:57.607986 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:57.607976 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:44:57.623042 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:57.622996 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bxr4l" podStartSLOduration=65.114295874 podStartE2EDuration="1m9.622985391s" podCreationTimestamp="2026-06-03 16:43:48 +0000 UTC" firstStartedPulling="2026-06-03 16:44:52.522694941 +0000 UTC m=+65.930177446" lastFinishedPulling="2026-06-03 16:44:57.031384459 +0000 UTC m=+70.438866963" observedRunningTime="2026-06-03 16:44:57.622437502 +0000 UTC m=+71.029920039" watchObservedRunningTime="2026-06-03 16:44:57.622985391 +0000 UTC m=+71.030467913" Jun 03 16:44:57.637014 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:44:57.636976 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6bknm" podStartSLOduration=65.874371219 podStartE2EDuration="1m10.636966089s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:44:52.227823108 +0000 UTC m=+65.635305612" lastFinishedPulling="2026-06-03 16:44:56.990417976 +0000 UTC m=+70.397900482" observedRunningTime="2026-06-03 16:44:57.636483692 +0000 UTC m=+71.043966221" watchObservedRunningTime="2026-06-03 16:44:57.636966089 +0000 UTC m=+71.044448610" Jun 03 16:45:24.833954 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:45:24.833886 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:45:24.833954 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:45:24.833956 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:45:24.833989 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:24.834038 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:24.834084 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:24.834094 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:24.834093 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:24.834113 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:28.834096626 +0000 UTC m=+162.241579126 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:24.834136 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:28.834124535 +0000 UTC m=+162.241607034 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:45:24.834407 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:24.834148 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:46:28.834141859 +0000 UTC m=+162.241624358 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:45:28.615916 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:45:28.615887 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6bknm" Jun 03 16:45:55.962930 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:45:55.962887 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:45:55.963409 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:55.963028 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 16:45:55.963409 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:45:55.963099 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs podName:f10eb032-87e3-4f19-8f07-8a414afd8725 nodeName:}" failed. No retries permitted until 2026-06-03 16:47:57.963083944 +0000 UTC m=+251.370566444 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs") pod "network-metrics-daemon-dhtsg" (UID: "f10eb032-87e3-4f19-8f07-8a414afd8725") : secret "metrics-daemon-secret" not found Jun 03 16:46:23.970362 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:23.970317 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" podUID="9e0b5b82-ff28-4685-852d-8c4c308a43b9" Jun 03 16:46:23.977619 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:23.977573 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bbddz" podUID="dfe4aa4c-1d75-4756-b199-4a831115dc45" Jun 03 16:46:23.983724 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:23.983701 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-mqjtw" podUID="875cab77-14b7-4328-9c63-b90a3af052ff" Jun 03 16:46:24.204937 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:24.204894 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-dhtsg" podUID="f10eb032-87e3-4f19-8f07-8a414afd8725" Jun 03 16:46:24.812797 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:24.812765 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:46:24.812972 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:24.812767 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbddz" Jun 03 16:46:24.812972 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:24.812766 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:46:28.126353 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:28.126324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc277_0336c145-90b5-41f7-8938-634fafc7bbc1/dns-node-resolver/0.log" Jun 03 16:46:28.908301 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:28.908267 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") pod \"image-registry-66d6f6fbbb-qw9pd\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:46:28.908489 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:28.908339 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:46:28.908489 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:28.908362 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:46:28.908489 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:28.908427 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 16:46:28.908489 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:28.908441 2577 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 16:46:28.908489 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:28.908481 2577 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 16:46:28.908691 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:28.908501 2577 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d6f6fbbb-qw9pd: secret "image-registry-tls" not found Jun 03 16:46:28.908691 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:28.908486 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert podName:875cab77-14b7-4328-9c63-b90a3af052ff nodeName:}" failed. No retries permitted until 2026-06-03 16:48:30.90847302 +0000 UTC m=+284.315955520 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert") pod "ingress-canary-mqjtw" (UID: "875cab77-14b7-4328-9c63-b90a3af052ff") : secret "canary-serving-cert" not found Jun 03 16:46:28.908691 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:28.908581 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls podName:dfe4aa4c-1d75-4756-b199-4a831115dc45 nodeName:}" failed. No retries permitted until 2026-06-03 16:48:30.908560888 +0000 UTC m=+284.316043403 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls") pod "dns-default-bbddz" (UID: "dfe4aa4c-1d75-4756-b199-4a831115dc45") : secret "dns-default-metrics-tls" not found Jun 03 16:46:28.908691 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:28.908597 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls podName:9e0b5b82-ff28-4685-852d-8c4c308a43b9 nodeName:}" failed. No retries permitted until 2026-06-03 16:48:30.908591332 +0000 UTC m=+284.316073832 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls") pod "image-registry-66d6f6fbbb-qw9pd" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9") : secret "image-registry-tls" not found Jun 03 16:46:28.927158 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:28.927136 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2x2v9_2283ed9f-3ed8-4c76-9cde-85998b9c24a6/node-ca/0.log" Jun 03 16:46:31.833320 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:31.833289 2577 generic.go:358] "Generic (PLEG): container finished" podID="27988c7a-a15b-48c9-b73f-1b354a1fcda7" containerID="2d3f5a40dd78bdb02603e035a4608409a03dd6b79f11adb997e65c8c85e07aae" exitCode=255 Jun 03 16:46:31.833629 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:31.833351 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" event={"ID":"27988c7a-a15b-48c9-b73f-1b354a1fcda7","Type":"ContainerDied","Data":"2d3f5a40dd78bdb02603e035a4608409a03dd6b79f11adb997e65c8c85e07aae"} Jun 03 16:46:31.833669 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:31.833638 2577 scope.go:117] "RemoveContainer" containerID="2d3f5a40dd78bdb02603e035a4608409a03dd6b79f11adb997e65c8c85e07aae" Jun 03 16:46:32.533183 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:32.533137 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" podUID="c6946d74-7fe8-44ba-b33f-0e66fdf7c11f" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused" Jun 03 16:46:32.836861 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:32.836770 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-69fd65ddcd-4jg6m" event={"ID":"27988c7a-a15b-48c9-b73f-1b354a1fcda7","Type":"ContainerStarted","Data":"234c7987b38bb3ddfe9836f94e8ac4f5ea895a3daea168c10cb9979cb618cd13"} Jun 03 16:46:32.837939 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:32.837916 2577 generic.go:358] "Generic (PLEG): container finished" podID="c6946d74-7fe8-44ba-b33f-0e66fdf7c11f" containerID="49a85206e35c7d0ac2cb16a50500b83c444169b306eba52a7281d17362fe6e73" exitCode=1 Jun 03 16:46:32.838018 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:32.837953 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" event={"ID":"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f","Type":"ContainerDied","Data":"49a85206e35c7d0ac2cb16a50500b83c444169b306eba52a7281d17362fe6e73"} Jun 03 16:46:32.838199 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:32.838188 2577 scope.go:117] "RemoveContainer" containerID="49a85206e35c7d0ac2cb16a50500b83c444169b306eba52a7281d17362fe6e73" Jun 03 16:46:33.841757 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:33.841703 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" event={"ID":"c6946d74-7fe8-44ba-b33f-0e66fdf7c11f","Type":"ContainerStarted","Data":"6b4052069c8813cf6e26579959636ff123d8e09b508ad51aebe66bc1139b315d"} Jun 03 16:46:33.842153 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:33.842023 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:46:33.842638 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:33.842618 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b9696f9c4-pdlkh" Jun 03 16:46:39.179916 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:39.179826 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:46:49.588601 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.588565 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9n2sx"] Jun 03 16:46:49.591007 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.590984 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.597132 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.597110 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 16:46:49.597257 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.597213 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 16:46:49.597329 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.597270 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 16:46:49.597329 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.597297 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rc6mw\"" Jun 03 16:46:49.597553 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.597539 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 16:46:49.613070 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.613050 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9n2sx"] Jun 03 16:46:49.770060 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.770034 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6cfh\" (UniqueName: \"kubernetes.io/projected/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-kube-api-access-z6cfh\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.770205 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.770090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-crio-socket\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.770205 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.770151 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-data-volume\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.770205 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.770178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.770345 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.770224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.870529 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.870505 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z6cfh\" (UniqueName: \"kubernetes.io/projected/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-kube-api-access-z6cfh\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.870648 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.870572 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-crio-socket\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.870648 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.870615 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-data-volume\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.870648 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.870641 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.870825 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.870666 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.870825 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.870696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-crio-socket\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.870957 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.870940 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-data-volume\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.871161 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.871142 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.872946 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.872928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.879650 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.879628 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6cfh\" (UniqueName: \"kubernetes.io/projected/98587b47-40b3-4bc4-a10a-cffbd9e53b3a-kube-api-access-z6cfh\") pod \"insights-runtime-extractor-9n2sx\" (UID: \"98587b47-40b3-4bc4-a10a-cffbd9e53b3a\") " pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:49.899537 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:49.899521 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9n2sx" Jun 03 16:46:50.066874 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:50.066841 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9n2sx"] Jun 03 16:46:50.069998 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:46:50.069965 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98587b47_40b3_4bc4_a10a_cffbd9e53b3a.slice/crio-6e5019428e4d471c5e1b8d63fa9b89d60aebf8c4d425e53fcee04cf6f064748e WatchSource:0}: Error finding container 6e5019428e4d471c5e1b8d63fa9b89d60aebf8c4d425e53fcee04cf6f064748e: Status 404 returned error can't find the container with id 6e5019428e4d471c5e1b8d63fa9b89d60aebf8c4d425e53fcee04cf6f064748e Jun 03 16:46:50.885842 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:50.885814 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9n2sx" event={"ID":"98587b47-40b3-4bc4-a10a-cffbd9e53b3a","Type":"ContainerStarted","Data":"e09bb29bdb4dbd81ada8835e1adfada24f206d57452dbbea76a0b41ecfaf4fc2"} Jun 03 16:46:50.886157 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:50.885850 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9n2sx" event={"ID":"98587b47-40b3-4bc4-a10a-cffbd9e53b3a","Type":"ContainerStarted","Data":"0b1fdd05f85667b63a6342cfe6a74331bc99ba9182bbc28e6791fbca4339fee7"} Jun 03 16:46:50.886157 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:50.885865 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9n2sx" event={"ID":"98587b47-40b3-4bc4-a10a-cffbd9e53b3a","Type":"ContainerStarted","Data":"6e5019428e4d471c5e1b8d63fa9b89d60aebf8c4d425e53fcee04cf6f064748e"} Jun 03 16:46:51.239804 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:51.239761 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" podUID="d3dc6394-b8db-41d8-b96f-822457c8cbe6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:46:52.892473 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:52.892433 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9n2sx" event={"ID":"98587b47-40b3-4bc4-a10a-cffbd9e53b3a","Type":"ContainerStarted","Data":"6d795ddf6a904b4c3549164228b80f5aacc3bee3133f35197371a2ddb1b5a897"} Jun 03 16:46:52.915489 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:52.915436 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9n2sx" podStartSLOduration=1.477626132 podStartE2EDuration="3.915419198s" podCreationTimestamp="2026-06-03 16:46:49 +0000 UTC" firstStartedPulling="2026-06-03 16:46:50.115375516 +0000 UTC m=+183.522858023" lastFinishedPulling="2026-06-03 16:46:52.553168589 +0000 UTC m=+185.960651089" observedRunningTime="2026-06-03 16:46:52.914380957 +0000 UTC m=+186.321863476" watchObservedRunningTime="2026-06-03 16:46:52.915419198 +0000 UTC m=+186.322901724" Jun 03 16:46:56.931327 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.931292 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rzj88"] Jun 03 16:46:56.933307 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.933292 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:56.935894 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.935871 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 16:46:56.935985 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.935921 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 16:46:56.936370 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.936355 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f7b2x\"" Jun 03 16:46:56.937260 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.937244 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 16:46:56.937350 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.937269 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 16:46:56.937350 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.937337 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 16:46:56.937725 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:56.937709 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 16:46:57.023406 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023406 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023407 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023605 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023429 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-textfile\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023605 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023452 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-tls\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023605 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-wtmp\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023605 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023572 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-sys\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023728 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-root\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023728 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023673 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jh4\" (UniqueName: \"kubernetes.io/projected/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-kube-api-access-h5jh4\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.023728 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.023690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-metrics-client-ca\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.123988 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.123952 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jh4\" (UniqueName: \"kubernetes.io/projected/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-kube-api-access-h5jh4\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.123988 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.123990 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-metrics-client-ca\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124167 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124020 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124167 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124087 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124167 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124135 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-textfile\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124303 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124169 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-tls\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124303 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124205 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-wtmp\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124405 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:57.124314 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 16:46:57.124405 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124350 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-wtmp\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124405 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:46:57.124392 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-tls podName:70362cfd-183c-4fa6-b6ca-388fd10fb2b1 nodeName:}" failed. No retries permitted until 2026-06-03 16:46:57.624373108 +0000 UTC m=+191.031855615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-tls") pod "node-exporter-rzj88" (UID: "70362cfd-183c-4fa6-b6ca-388fd10fb2b1") : secret "node-exporter-tls" not found Jun 03 16:46:57.124541 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124415 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-sys\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124541 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124485 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-textfile\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124541 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124502 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-root\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124658 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124543 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-root\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124658 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124542 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-sys\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124777 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124761 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-accelerators-collector-config\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.124823 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.124782 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-metrics-client-ca\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.126276 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.126260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.134918 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.134896 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jh4\" (UniqueName: \"kubernetes.io/projected/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-kube-api-access-h5jh4\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.628970 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.628940 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-tls\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.631106 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.631079 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70362cfd-183c-4fa6-b6ca-388fd10fb2b1-node-exporter-tls\") pod \"node-exporter-rzj88\" (UID: \"70362cfd-183c-4fa6-b6ca-388fd10fb2b1\") " pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.842148 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.842118 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rzj88" Jun 03 16:46:57.850792 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:46:57.850764 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70362cfd_183c_4fa6_b6ca_388fd10fb2b1.slice/crio-ea1669cbbc97d94f82bb9cde94ff970f452378c27ecc351a3a0dec7406bab5d8 WatchSource:0}: Error finding container ea1669cbbc97d94f82bb9cde94ff970f452378c27ecc351a3a0dec7406bab5d8: Status 404 returned error can't find the container with id ea1669cbbc97d94f82bb9cde94ff970f452378c27ecc351a3a0dec7406bab5d8 Jun 03 16:46:57.906048 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:57.905968 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rzj88" event={"ID":"70362cfd-183c-4fa6-b6ca-388fd10fb2b1","Type":"ContainerStarted","Data":"ea1669cbbc97d94f82bb9cde94ff970f452378c27ecc351a3a0dec7406bab5d8"} Jun 03 16:46:59.911953 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:59.911919 2577 generic.go:358] "Generic (PLEG): container finished" podID="70362cfd-183c-4fa6-b6ca-388fd10fb2b1" containerID="87009fd070151bfc44a5a776b3ffe8b7fc018101099ad2f653abbf177db52556" exitCode=0 Jun 03 16:46:59.912362 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:46:59.911985 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rzj88" event={"ID":"70362cfd-183c-4fa6-b6ca-388fd10fb2b1","Type":"ContainerDied","Data":"87009fd070151bfc44a5a776b3ffe8b7fc018101099ad2f653abbf177db52556"} Jun 03 16:47:00.916309 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:00.916276 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rzj88" event={"ID":"70362cfd-183c-4fa6-b6ca-388fd10fb2b1","Type":"ContainerStarted","Data":"c2453f9553e8246d80e15cdad30f5e1f7581e4050b45b934eeffcfae94dd6ef3"} Jun 03 16:47:00.916309 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:00.916310 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rzj88" event={"ID":"70362cfd-183c-4fa6-b6ca-388fd10fb2b1","Type":"ContainerStarted","Data":"f4a58b44a90d28cc0e4ea199f7cc7482627044fb2929613ef1abc8d90c240bf6"} Jun 03 16:47:00.937300 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:00.937254 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rzj88" podStartSLOduration=3.7755909770000002 podStartE2EDuration="4.937242538s" podCreationTimestamp="2026-06-03 16:46:56 +0000 UTC" firstStartedPulling="2026-06-03 16:46:57.852890866 +0000 UTC m=+191.260373373" lastFinishedPulling="2026-06-03 16:46:59.014542421 +0000 UTC m=+192.422024934" observedRunningTime="2026-06-03 16:47:00.935263299 +0000 UTC m=+194.342745821" watchObservedRunningTime="2026-06-03 16:47:00.937242538 +0000 UTC m=+194.344725079" Jun 03 16:47:01.239806 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:01.239707 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" podUID="d3dc6394-b8db-41d8-b96f-822457c8cbe6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:47:11.239621 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:11.239581 2577 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" podUID="d3dc6394-b8db-41d8-b96f-822457c8cbe6" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 03 16:47:11.240086 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:11.239648 2577 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" Jun 03 16:47:11.240169 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:11.240139 2577 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9c8df6983bb59ec787c906fb48065e49a90a09906903ffa4fa76677a52bb3acc"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 03 16:47:11.240217 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:11.240202 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" podUID="d3dc6394-b8db-41d8-b96f-822457c8cbe6" containerName="service-proxy" containerID="cri-o://9c8df6983bb59ec787c906fb48065e49a90a09906903ffa4fa76677a52bb3acc" gracePeriod=30 Jun 03 16:47:11.944424 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:11.944390 2577 generic.go:358] "Generic (PLEG): container finished" podID="d3dc6394-b8db-41d8-b96f-822457c8cbe6" containerID="9c8df6983bb59ec787c906fb48065e49a90a09906903ffa4fa76677a52bb3acc" exitCode=2 Jun 03 16:47:11.944595 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:11.944443 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" event={"ID":"d3dc6394-b8db-41d8-b96f-822457c8cbe6","Type":"ContainerDied","Data":"9c8df6983bb59ec787c906fb48065e49a90a09906903ffa4fa76677a52bb3acc"} Jun 03 16:47:11.944595 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:11.944471 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c79f7c4f8-fdktk" event={"ID":"d3dc6394-b8db-41d8-b96f-822457c8cbe6","Type":"ContainerStarted","Data":"c4398185e7ca420a99eb9bf60062b728758fa2dbf4463159c6ff15a847946f5d"} Jun 03 16:47:36.292906 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:36.292878 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc277_0336c145-90b5-41f7-8938-634fafc7bbc1/dns-node-resolver/0.log" Jun 03 16:47:37.093083 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:37.093053 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2x2v9_2283ed9f-3ed8-4c76-9cde-85998b9c24a6/node-ca/0.log" Jun 03 16:47:39.999106 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:39.999066 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66d6f6fbbb-qw9pd"] Jun 03 16:47:39.999470 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:47:39.999271 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" podUID="9e0b5b82-ff28-4685-852d-8c4c308a43b9" Jun 03 16:47:40.010871 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.010847 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:47:40.014763 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.014745 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:47:40.074284 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074256 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-installation-pull-secrets\") pod \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " Jun 03 16:47:40.074284 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074287 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-trusted-ca\") pod \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " Jun 03 16:47:40.074438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074320 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-image-registry-private-configuration\") pod \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " Jun 03 16:47:40.074438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074351 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e0b5b82-ff28-4685-852d-8c4c308a43b9-ca-trust-extracted\") pod \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " Jun 03 16:47:40.074438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074369 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-bound-sa-token\") pod \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " Jun 03 16:47:40.074438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074409 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-certificates\") pod \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " Jun 03 16:47:40.074438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074435 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvjsd\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-kube-api-access-mvjsd\") pod \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\" (UID: \"9e0b5b82-ff28-4685-852d-8c4c308a43b9\") " Jun 03 16:47:40.074750 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074698 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0b5b82-ff28-4685-852d-8c4c308a43b9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9e0b5b82-ff28-4685-852d-8c4c308a43b9" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 16:47:40.074846 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.074794 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9e0b5b82-ff28-4685-852d-8c4c308a43b9" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:47:40.075055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.075030 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9e0b5b82-ff28-4685-852d-8c4c308a43b9" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 16:47:40.076674 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.076645 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9e0b5b82-ff28-4685-852d-8c4c308a43b9" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:47:40.076785 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.076668 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-kube-api-access-mvjsd" (OuterVolumeSpecName: "kube-api-access-mvjsd") pod "9e0b5b82-ff28-4685-852d-8c4c308a43b9" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9"). InnerVolumeSpecName "kube-api-access-mvjsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:47:40.076890 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.076859 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9e0b5b82-ff28-4685-852d-8c4c308a43b9" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 16:47:40.076949 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.076921 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9e0b5b82-ff28-4685-852d-8c4c308a43b9" (UID: "9e0b5b82-ff28-4685-852d-8c4c308a43b9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:47:40.175559 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.175520 2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-installation-pull-secrets\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:40.175559 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.175551 2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-trusted-ca\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:40.175559 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.175565 2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9e0b5b82-ff28-4685-852d-8c4c308a43b9-image-registry-private-configuration\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:40.175816 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.175578 2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9e0b5b82-ff28-4685-852d-8c4c308a43b9-ca-trust-extracted\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:40.175816 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.175590 2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-bound-sa-token\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:40.175816 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.175602 2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-certificates\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:40.175816 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:40.175613 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvjsd\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-kube-api-access-mvjsd\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:41.013386 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:41.013354 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d6f6fbbb-qw9pd" Jun 03 16:47:41.052517 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:41.052489 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66d6f6fbbb-qw9pd"] Jun 03 16:47:41.057398 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:41.057367 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66d6f6fbbb-qw9pd"] Jun 03 16:47:41.082899 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:41.082878 2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9e0b5b82-ff28-4685-852d-8c4c308a43b9-registry-tls\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:47:41.183118 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:41.183090 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0b5b82-ff28-4685-852d-8c4c308a43b9" path="/var/lib/kubelet/pods/9e0b5b82-ff28-4685-852d-8c4c308a43b9/volumes" Jun 03 16:47:58.017243 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:58.017201 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:47:58.023579 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:58.023546 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10eb032-87e3-4f19-8f07-8a414afd8725-metrics-certs\") pod \"network-metrics-daemon-dhtsg\" (UID: \"f10eb032-87e3-4f19-8f07-8a414afd8725\") " pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:47:58.083177 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:58.083142 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fvvv\"" Jun 03 16:47:58.091138 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:58.091106 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhtsg" Jun 03 16:47:58.210303 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:58.210260 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhtsg"] Jun 03 16:47:58.214060 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:47:58.214030 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10eb032_87e3_4f19_8f07_8a414afd8725.slice/crio-11576631c2f87633ab4287f36ee79b1e94126f4627854380bf4886b0a525fa68 WatchSource:0}: Error finding container 11576631c2f87633ab4287f36ee79b1e94126f4627854380bf4886b0a525fa68: Status 404 returned error can't find the container with id 11576631c2f87633ab4287f36ee79b1e94126f4627854380bf4886b0a525fa68 Jun 03 16:47:59.058272 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:47:59.058231 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhtsg" event={"ID":"f10eb032-87e3-4f19-8f07-8a414afd8725","Type":"ContainerStarted","Data":"11576631c2f87633ab4287f36ee79b1e94126f4627854380bf4886b0a525fa68"} Jun 03 16:48:00.062575 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:00.062541 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhtsg" event={"ID":"f10eb032-87e3-4f19-8f07-8a414afd8725","Type":"ContainerStarted","Data":"466b5a04f38d0963587a8846c725836cef8a2416d42a1e9d6a181d0d496541a7"} Jun 03 16:48:00.062575 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:00.062575 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhtsg" event={"ID":"f10eb032-87e3-4f19-8f07-8a414afd8725","Type":"ContainerStarted","Data":"d495d6e8f7ce14836208ee998d271f0a53e8921d9890945eb698701de7241a81"} Jun 03 16:48:00.079456 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:00.079408 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dhtsg" podStartSLOduration=251.793646627 podStartE2EDuration="4m13.079394386s" podCreationTimestamp="2026-06-03 16:43:47 +0000 UTC" firstStartedPulling="2026-06-03 16:47:58.215899872 +0000 UTC m=+251.623382372" lastFinishedPulling="2026-06-03 16:47:59.501647629 +0000 UTC m=+252.909130131" observedRunningTime="2026-06-03 16:48:00.077775231 +0000 UTC m=+253.485257754" watchObservedRunningTime="2026-06-03 16:48:00.079394386 +0000 UTC m=+253.486876907" Jun 03 16:48:27.814248 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:48:27.814197 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bbddz" podUID="dfe4aa4c-1d75-4756-b199-4a831115dc45" Jun 03 16:48:27.814248 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:48:27.814197 2577 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-mqjtw" podUID="875cab77-14b7-4328-9c63-b90a3af052ff" Jun 03 16:48:28.131951 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:28.131913 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:48:28.132139 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:28.131915 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbddz" Jun 03 16:48:30.974483 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:30.974443 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:48:30.974964 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:30.974501 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:48:30.976858 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:30.976833 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfe4aa4c-1d75-4756-b199-4a831115dc45-metrics-tls\") pod \"dns-default-bbddz\" (UID: \"dfe4aa4c-1d75-4756-b199-4a831115dc45\") " pod="openshift-dns/dns-default-bbddz" Jun 03 16:48:30.976960 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:30.976890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/875cab77-14b7-4328-9c63-b90a3af052ff-cert\") pod \"ingress-canary-mqjtw\" (UID: \"875cab77-14b7-4328-9c63-b90a3af052ff\") " pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:48:31.137684 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:31.137655 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g6lvq\"" Jun 03 16:48:31.137684 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:31.137667 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vw2lw\"" Jun 03 16:48:31.143635 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:31.143616 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mqjtw" Jun 03 16:48:31.143753 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:31.143696 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbddz" Jun 03 16:48:31.280634 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:31.280608 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbddz"] Jun 03 16:48:31.282824 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:48:31.282790 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfe4aa4c_1d75_4756_b199_4a831115dc45.slice/crio-8d7706da2a98186857641b827c413df1c3fa249a1ce8871be664167541b010ce WatchSource:0}: Error finding container 8d7706da2a98186857641b827c413df1c3fa249a1ce8871be664167541b010ce: Status 404 returned error can't find the container with id 8d7706da2a98186857641b827c413df1c3fa249a1ce8871be664167541b010ce Jun 03 16:48:31.295533 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:31.295510 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mqjtw"] Jun 03 16:48:31.298594 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:48:31.298569 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod875cab77_14b7_4328_9c63_b90a3af052ff.slice/crio-e6f18bec052c66224b399eff4a4625555425fa5b2693ed7adcb97d07ac84b6ee WatchSource:0}: Error finding container e6f18bec052c66224b399eff4a4625555425fa5b2693ed7adcb97d07ac84b6ee: Status 404 returned error can't find the container with id e6f18bec052c66224b399eff4a4625555425fa5b2693ed7adcb97d07ac84b6ee Jun 03 16:48:32.141949 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:32.141869 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbddz" event={"ID":"dfe4aa4c-1d75-4756-b199-4a831115dc45","Type":"ContainerStarted","Data":"8d7706da2a98186857641b827c413df1c3fa249a1ce8871be664167541b010ce"} Jun 03 16:48:32.143360 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:32.143325 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqjtw" event={"ID":"875cab77-14b7-4328-9c63-b90a3af052ff","Type":"ContainerStarted","Data":"e6f18bec052c66224b399eff4a4625555425fa5b2693ed7adcb97d07ac84b6ee"} Jun 03 16:48:34.150596 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:34.150557 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mqjtw" event={"ID":"875cab77-14b7-4328-9c63-b90a3af052ff","Type":"ContainerStarted","Data":"e79cb50340caba44e8e71c019a1de60091482c12e62f9d601f756b1e483ae7cc"} Jun 03 16:48:34.152083 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:34.152059 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbddz" event={"ID":"dfe4aa4c-1d75-4756-b199-4a831115dc45","Type":"ContainerStarted","Data":"01c720d289b2cc00cba9904104edf4e0fb61d4fe902095fc75960194d81b0783"} Jun 03 16:48:34.152185 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:34.152088 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbddz" event={"ID":"dfe4aa4c-1d75-4756-b199-4a831115dc45","Type":"ContainerStarted","Data":"0f2a54d9b61bce92853b4ab4b0ea0c94765506731e890336ade167b817dc00c0"} Jun 03 16:48:34.152185 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:34.152172 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bbddz" Jun 03 16:48:34.168107 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:34.168063 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mqjtw" podStartSLOduration=252.145585047 podStartE2EDuration="4m14.168051752s" podCreationTimestamp="2026-06-03 16:44:20 +0000 UTC" firstStartedPulling="2026-06-03 16:48:31.300490104 +0000 UTC m=+284.707972607" lastFinishedPulling="2026-06-03 16:48:33.322956809 +0000 UTC m=+286.730439312" observedRunningTime="2026-06-03 16:48:34.167060589 +0000 UTC m=+287.574543112" watchObservedRunningTime="2026-06-03 16:48:34.168051752 +0000 UTC m=+287.575534313" Jun 03 16:48:34.184009 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:34.183946 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-bbddz" podStartSLOduration=252.144254968 podStartE2EDuration="4m14.183932178s" podCreationTimestamp="2026-06-03 16:44:20 +0000 UTC" firstStartedPulling="2026-06-03 16:48:31.284556776 +0000 UTC m=+284.692039276" lastFinishedPulling="2026-06-03 16:48:33.324233983 +0000 UTC m=+286.731716486" observedRunningTime="2026-06-03 16:48:34.183618401 +0000 UTC m=+287.591100927" watchObservedRunningTime="2026-06-03 16:48:34.183932178 +0000 UTC m=+287.591414711" Jun 03 16:48:44.157353 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:44.157317 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bbddz" Jun 03 16:48:47.059996 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:48:47.059971 2577 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 16:52:44.902728 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.902693 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-9z9g6"] Jun 03 16:52:44.905672 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.905650 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:44.908211 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.908191 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q7c5k\"" Jun 03 16:52:44.908320 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.908209 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 16:52:44.909366 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.909344 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 16:52:44.914489 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.914468 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-9z9g6"] Jun 03 16:52:44.975382 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.975339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkdfj\" (UniqueName: \"kubernetes.io/projected/04170fb5-e57c-49a7-a9da-687ae3898e0a-kube-api-access-nkdfj\") pod \"cert-manager-79c8d999ff-9z9g6\" (UID: \"04170fb5-e57c-49a7-a9da-687ae3898e0a\") " pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:44.975382 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:44.975383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04170fb5-e57c-49a7-a9da-687ae3898e0a-bound-sa-token\") pod \"cert-manager-79c8d999ff-9z9g6\" (UID: \"04170fb5-e57c-49a7-a9da-687ae3898e0a\") " pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:45.075854 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.075813 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkdfj\" (UniqueName: \"kubernetes.io/projected/04170fb5-e57c-49a7-a9da-687ae3898e0a-kube-api-access-nkdfj\") pod \"cert-manager-79c8d999ff-9z9g6\" (UID: \"04170fb5-e57c-49a7-a9da-687ae3898e0a\") " pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:45.075854 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.075859 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04170fb5-e57c-49a7-a9da-687ae3898e0a-bound-sa-token\") pod \"cert-manager-79c8d999ff-9z9g6\" (UID: \"04170fb5-e57c-49a7-a9da-687ae3898e0a\") " pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:45.086469 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.086437 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/04170fb5-e57c-49a7-a9da-687ae3898e0a-bound-sa-token\") pod \"cert-manager-79c8d999ff-9z9g6\" (UID: \"04170fb5-e57c-49a7-a9da-687ae3898e0a\") " pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:45.086651 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.086632 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkdfj\" (UniqueName: \"kubernetes.io/projected/04170fb5-e57c-49a7-a9da-687ae3898e0a-kube-api-access-nkdfj\") pod \"cert-manager-79c8d999ff-9z9g6\" (UID: \"04170fb5-e57c-49a7-a9da-687ae3898e0a\") " pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:45.214183 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.214091 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-9z9g6" Jun 03 16:52:45.333891 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.333783 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-9z9g6"] Jun 03 16:52:45.336463 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:52:45.336426 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04170fb5_e57c_49a7_a9da_687ae3898e0a.slice/crio-fd1b76c8c1a4141617f0278201e40b6ff61618dc7ae6e93f635724829ebc2cdc WatchSource:0}: Error finding container fd1b76c8c1a4141617f0278201e40b6ff61618dc7ae6e93f635724829ebc2cdc: Status 404 returned error can't find the container with id fd1b76c8c1a4141617f0278201e40b6ff61618dc7ae6e93f635724829ebc2cdc Jun 03 16:52:45.338134 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.338118 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:52:45.784646 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:45.784605 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-9z9g6" event={"ID":"04170fb5-e57c-49a7-a9da-687ae3898e0a","Type":"ContainerStarted","Data":"fd1b76c8c1a4141617f0278201e40b6ff61618dc7ae6e93f635724829ebc2cdc"} Jun 03 16:52:48.794182 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:48.794136 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-9z9g6" event={"ID":"04170fb5-e57c-49a7-a9da-687ae3898e0a","Type":"ContainerStarted","Data":"4e76f8d1a74d321483a2f16200b97d5b77b1eba9db2986c15a4886b2a4f9bf23"} Jun 03 16:52:48.810599 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:52:48.810544 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-9z9g6" podStartSLOduration=1.879795447 podStartE2EDuration="4.81053063s" podCreationTimestamp="2026-06-03 16:52:44 +0000 UTC" firstStartedPulling="2026-06-03 16:52:45.338241402 +0000 UTC m=+538.745723902" lastFinishedPulling="2026-06-03 16:52:48.268976582 +0000 UTC m=+541.676459085" observedRunningTime="2026-06-03 16:52:48.808961895 +0000 UTC m=+542.216444417" watchObservedRunningTime="2026-06-03 16:52:48.81053063 +0000 UTC m=+542.218013151" Jun 03 16:53:06.587862 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.587832 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58"] Jun 03 16:53:06.589803 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.589787 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.593845 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.593824 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 16:53:06.595016 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.594994 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 16:53:06.595127 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.595004 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 16:53:06.595127 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.595034 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 16:53:06.595127 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.595089 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cmn8q\"" Jun 03 16:53:06.627780 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.627752 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58"] Jun 03 16:53:06.731063 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.731022 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d5122f4-ed60-48b7-99bc-5c20fb785723-manifests\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.731063 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.731067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d5122f4-ed60-48b7-99bc-5c20fb785723-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.731267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.731089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5122f4-ed60-48b7-99bc-5c20fb785723-tmp\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.731267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.731164 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d5122f4-ed60-48b7-99bc-5c20fb785723-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.731267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.731188 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcks\" (UniqueName: \"kubernetes.io/projected/7d5122f4-ed60-48b7-99bc-5c20fb785723-kube-api-access-mqcks\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.831835 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.831798 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5122f4-ed60-48b7-99bc-5c20fb785723-tmp\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.831995 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.831858 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d5122f4-ed60-48b7-99bc-5c20fb785723-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.831995 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.831883 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcks\" (UniqueName: \"kubernetes.io/projected/7d5122f4-ed60-48b7-99bc-5c20fb785723-kube-api-access-mqcks\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.831995 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.831902 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d5122f4-ed60-48b7-99bc-5c20fb785723-manifests\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.831995 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.831920 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d5122f4-ed60-48b7-99bc-5c20fb785723-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.832289 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.832260 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7d5122f4-ed60-48b7-99bc-5c20fb785723-manifests\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.833994 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.833974 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5122f4-ed60-48b7-99bc-5c20fb785723-tmp\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.834357 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.834335 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7d5122f4-ed60-48b7-99bc-5c20fb785723-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.834357 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.834349 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d5122f4-ed60-48b7-99bc-5c20fb785723-webhook-cert\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.840352 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.840292 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcks\" (UniqueName: \"kubernetes.io/projected/7d5122f4-ed60-48b7-99bc-5c20fb785723-kube-api-access-mqcks\") pod \"opendatahub-operator-controller-manager-d99597487-qrb58\" (UID: \"7d5122f4-ed60-48b7-99bc-5c20fb785723\") " pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:06.899292 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:06.899252 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:07.039642 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.039608 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58"] Jun 03 16:53:07.044271 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:53:07.044237 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5122f4_ed60_48b7_99bc_5c20fb785723.slice/crio-ba6adc5b3d8b6ce97354c37440f44c2e86aef239456ca46d5aed524b7ec1e3a0 WatchSource:0}: Error finding container ba6adc5b3d8b6ce97354c37440f44c2e86aef239456ca46d5aed524b7ec1e3a0: Status 404 returned error can't find the container with id ba6adc5b3d8b6ce97354c37440f44c2e86aef239456ca46d5aed524b7ec1e3a0 Jun 03 16:53:07.215961 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.215934 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f"] Jun 03 16:53:07.220604 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.220334 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.224664 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.224643 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 16:53:07.224809 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.224645 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 16:53:07.225141 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.225124 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 16:53:07.225227 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.225131 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 16:53:07.225227 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.225189 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c8ncx\"" Jun 03 16:53:07.225383 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.225370 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 16:53:07.254094 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.254066 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f"] Jun 03 16:53:07.336605 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.336573 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc76d96-5088-4a0d-81be-b1172dc03a17-cert\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.336605 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.336607 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7g25\" (UniqueName: \"kubernetes.io/projected/0dc76d96-5088-4a0d-81be-b1172dc03a17-kube-api-access-d7g25\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.336835 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.336632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dc76d96-5088-4a0d-81be-b1172dc03a17-metrics-cert\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.336835 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.336652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0dc76d96-5088-4a0d-81be-b1172dc03a17-manager-config\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.437174 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.437137 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc76d96-5088-4a0d-81be-b1172dc03a17-cert\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.437174 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.437176 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7g25\" (UniqueName: \"kubernetes.io/projected/0dc76d96-5088-4a0d-81be-b1172dc03a17-kube-api-access-d7g25\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.437373 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.437199 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dc76d96-5088-4a0d-81be-b1172dc03a17-metrics-cert\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.437373 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.437217 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0dc76d96-5088-4a0d-81be-b1172dc03a17-manager-config\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.437802 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.437778 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0dc76d96-5088-4a0d-81be-b1172dc03a17-manager-config\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.439632 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.439613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0dc76d96-5088-4a0d-81be-b1172dc03a17-metrics-cert\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.439708 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.439648 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dc76d96-5088-4a0d-81be-b1172dc03a17-cert\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.446662 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.446635 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7g25\" (UniqueName: \"kubernetes.io/projected/0dc76d96-5088-4a0d-81be-b1172dc03a17-kube-api-access-d7g25\") pod \"lws-controller-manager-849d86d84c-cff9f\" (UID: \"0dc76d96-5088-4a0d-81be-b1172dc03a17\") " pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.531068 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.530983 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:07.682857 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.682643 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f"] Jun 03 16:53:07.686227 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:53:07.686194 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc76d96_5088_4a0d_81be_b1172dc03a17.slice/crio-ff0665dfc42bc5de4e135998205b471908d8ad690c4c525c5db75d579770605f WatchSource:0}: Error finding container ff0665dfc42bc5de4e135998205b471908d8ad690c4c525c5db75d579770605f: Status 404 returned error can't find the container with id ff0665dfc42bc5de4e135998205b471908d8ad690c4c525c5db75d579770605f Jun 03 16:53:07.843463 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.843358 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" event={"ID":"7d5122f4-ed60-48b7-99bc-5c20fb785723","Type":"ContainerStarted","Data":"ba6adc5b3d8b6ce97354c37440f44c2e86aef239456ca46d5aed524b7ec1e3a0"} Jun 03 16:53:07.844939 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:07.844913 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" event={"ID":"0dc76d96-5088-4a0d-81be-b1172dc03a17","Type":"ContainerStarted","Data":"ff0665dfc42bc5de4e135998205b471908d8ad690c4c525c5db75d579770605f"} Jun 03 16:53:11.857626 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:11.857596 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" event={"ID":"0dc76d96-5088-4a0d-81be-b1172dc03a17","Type":"ContainerStarted","Data":"6414e7ec700a71e0604ff125b532d69fa2cc66c07b628a112136b24f39e336e8"} Jun 03 16:53:11.858076 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:11.857651 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:11.858923 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:11.858903 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" event={"ID":"7d5122f4-ed60-48b7-99bc-5c20fb785723","Type":"ContainerStarted","Data":"87732f3b6a6160435e17cd787a9ebb66ed43a32dad0a53bad613d9242c5f8d6a"} Jun 03 16:53:11.878067 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:11.878028 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" podStartSLOduration=1.5643999979999998 podStartE2EDuration="4.878016072s" podCreationTimestamp="2026-06-03 16:53:07 +0000 UTC" firstStartedPulling="2026-06-03 16:53:07.688787968 +0000 UTC m=+561.096270472" lastFinishedPulling="2026-06-03 16:53:11.002404033 +0000 UTC m=+564.409886546" observedRunningTime="2026-06-03 16:53:11.876650447 +0000 UTC m=+565.284132970" watchObservedRunningTime="2026-06-03 16:53:11.878016072 +0000 UTC m=+565.285498593" Jun 03 16:53:12.863158 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:12.863124 2577 generic.go:358] "Generic (PLEG): container finished" podID="7d5122f4-ed60-48b7-99bc-5c20fb785723" containerID="87732f3b6a6160435e17cd787a9ebb66ed43a32dad0a53bad613d9242c5f8d6a" exitCode=0 Jun 03 16:53:12.863532 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:12.863213 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" event={"ID":"7d5122f4-ed60-48b7-99bc-5c20fb785723","Type":"ContainerDied","Data":"87732f3b6a6160435e17cd787a9ebb66ed43a32dad0a53bad613d9242c5f8d6a"} Jun 03 16:53:13.868071 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:13.868031 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" event={"ID":"7d5122f4-ed60-48b7-99bc-5c20fb785723","Type":"ContainerStarted","Data":"bd939934fc55b3c81776e51c50d6e3b983dbc196507b976eeb5ec957894be6bc"} Jun 03 16:53:13.868457 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:13.868162 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:13.893445 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:13.893398 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" podStartSLOduration=1.6876253490000002 podStartE2EDuration="7.893385539s" podCreationTimestamp="2026-06-03 16:53:06 +0000 UTC" firstStartedPulling="2026-06-03 16:53:07.04671436 +0000 UTC m=+560.454196860" lastFinishedPulling="2026-06-03 16:53:13.252474549 +0000 UTC m=+566.659957050" observedRunningTime="2026-06-03 16:53:13.891072608 +0000 UTC m=+567.298555131" watchObservedRunningTime="2026-06-03 16:53:13.893385539 +0000 UTC m=+567.300868061" Jun 03 16:53:22.865339 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:22.865303 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-849d86d84c-cff9f" Jun 03 16:53:24.873252 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:24.873222 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d99597487-qrb58" Jun 03 16:53:42.617448 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.617415 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-78b89f755d-466pc"] Jun 03 16:53:42.620421 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.620405 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:42.623539 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.623518 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pxxg2\"" Jun 03 16:53:42.623644 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.623577 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 16:53:42.633378 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.633357 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78b89f755d-466pc"] Jun 03 16:53:42.701412 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.701376 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9221838a-aabd-469e-bf45-2d7e3f5d62b3-redirect-config\") pod \"dashboard-redirect-78b89f755d-466pc\" (UID: \"9221838a-aabd-469e-bf45-2d7e3f5d62b3\") " pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:42.701595 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.701428 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqg7\" (UniqueName: \"kubernetes.io/projected/9221838a-aabd-469e-bf45-2d7e3f5d62b3-kube-api-access-wpqg7\") pod \"dashboard-redirect-78b89f755d-466pc\" (UID: \"9221838a-aabd-469e-bf45-2d7e3f5d62b3\") " pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:42.802107 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.802073 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9221838a-aabd-469e-bf45-2d7e3f5d62b3-redirect-config\") pod \"dashboard-redirect-78b89f755d-466pc\" (UID: \"9221838a-aabd-469e-bf45-2d7e3f5d62b3\") " pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:42.802213 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.802131 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqg7\" (UniqueName: \"kubernetes.io/projected/9221838a-aabd-469e-bf45-2d7e3f5d62b3-kube-api-access-wpqg7\") pod \"dashboard-redirect-78b89f755d-466pc\" (UID: \"9221838a-aabd-469e-bf45-2d7e3f5d62b3\") " pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:42.802761 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.802714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/9221838a-aabd-469e-bf45-2d7e3f5d62b3-redirect-config\") pod \"dashboard-redirect-78b89f755d-466pc\" (UID: \"9221838a-aabd-469e-bf45-2d7e3f5d62b3\") " pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:42.816329 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.816303 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqg7\" (UniqueName: \"kubernetes.io/projected/9221838a-aabd-469e-bf45-2d7e3f5d62b3-kube-api-access-wpqg7\") pod \"dashboard-redirect-78b89f755d-466pc\" (UID: \"9221838a-aabd-469e-bf45-2d7e3f5d62b3\") " pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:42.930311 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:42.930234 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-78b89f755d-466pc" Jun 03 16:53:43.061243 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:43.061204 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-78b89f755d-466pc"] Jun 03 16:53:43.064342 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:53:43.064313 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9221838a_aabd_469e_bf45_2d7e3f5d62b3.slice/crio-5bdcf9d6449a2f3cd1e62dee8aff1019ed6c2dc46226d71c1eb4edcad5e742b6 WatchSource:0}: Error finding container 5bdcf9d6449a2f3cd1e62dee8aff1019ed6c2dc46226d71c1eb4edcad5e742b6: Status 404 returned error can't find the container with id 5bdcf9d6449a2f3cd1e62dee8aff1019ed6c2dc46226d71c1eb4edcad5e742b6 Jun 03 16:53:43.952608 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:43.952556 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78b89f755d-466pc" event={"ID":"9221838a-aabd-469e-bf45-2d7e3f5d62b3","Type":"ContainerStarted","Data":"5bdcf9d6449a2f3cd1e62dee8aff1019ed6c2dc46226d71c1eb4edcad5e742b6"} Jun 03 16:53:47.968430 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:47.968347 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-78b89f755d-466pc" event={"ID":"9221838a-aabd-469e-bf45-2d7e3f5d62b3","Type":"ContainerStarted","Data":"6808d7336d855a665e57165412976352b57a3a857fc3253fd3aa39923e3b2c69"} Jun 03 16:53:47.984590 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:53:47.984540 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-78b89f755d-466pc" podStartSLOduration=1.400665561 podStartE2EDuration="5.984525572s" podCreationTimestamp="2026-06-03 16:53:42 +0000 UTC" firstStartedPulling="2026-06-03 16:53:43.065631589 +0000 UTC m=+596.473114089" lastFinishedPulling="2026-06-03 16:53:47.649491597 +0000 UTC m=+601.056974100" observedRunningTime="2026-06-03 16:53:47.983049421 +0000 UTC m=+601.390531945" watchObservedRunningTime="2026-06-03 16:53:47.984525572 +0000 UTC m=+601.392008093" Jun 03 16:54:08.351179 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.351099 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl"] Jun 03 16:54:08.355666 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.355646 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.358705 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.358684 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 16:54:08.358853 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.358784 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vj7gn\"" Jun 03 16:54:08.359015 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.359000 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 16:54:08.359279 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.359261 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 16:54:08.366395 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.366374 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl"] Jun 03 16:54:08.496624 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.496624 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496624 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.496872 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496644 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqc24\" (UniqueName: \"kubernetes.io/projected/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-kube-api-access-pqc24\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.496872 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496668 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.496872 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496768 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.496872 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496798 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.496872 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496824 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.496872 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496857 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.497055 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.496916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598040 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598007 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598040 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598043 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598233 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598061 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqc24\" (UniqueName: \"kubernetes.io/projected/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-kube-api-access-pqc24\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598233 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598086 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598308 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598257 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598348 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598304 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598449 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598346 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598449 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598377 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598449 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598408 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598449 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598425 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598720 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598794 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.598836 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.598818 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.599095 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.599077 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.600306 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.600288 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.600457 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.600439 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.605908 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.605850 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqc24\" (UniqueName: \"kubernetes.io/projected/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-kube-api-access-pqc24\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.606476 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.606451 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87d1ce34-9dc7-4ad3-ac51-f8f39cb22404-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl\" (UID: \"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.666385 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.666346 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:08.818479 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:08.818425 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl"] Jun 03 16:54:08.822282 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:54:08.822254 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d1ce34_9dc7_4ad3_ac51_f8f39cb22404.slice/crio-060825572ae00b608bf662ab87bc683443a938096837cece84d0fed078b2aaba WatchSource:0}: Error finding container 060825572ae00b608bf662ab87bc683443a938096837cece84d0fed078b2aaba: Status 404 returned error can't find the container with id 060825572ae00b608bf662ab87bc683443a938096837cece84d0fed078b2aaba Jun 03 16:54:09.023604 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:09.023514 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" event={"ID":"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404","Type":"ContainerStarted","Data":"060825572ae00b608bf662ab87bc683443a938096837cece84d0fed078b2aaba"} Jun 03 16:54:11.014395 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:11.014356 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 16:54:11.014679 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:11.014424 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 16:54:11.014679 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:11.014451 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 16:54:12.033307 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:12.033263 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" event={"ID":"87d1ce34-9dc7-4ad3-ac51-f8f39cb22404","Type":"ContainerStarted","Data":"5dd84e0d09c7852f4a00e45ceb5b9b1249f96b32e03ec887d1d1f1e64565823f"} Jun 03 16:54:12.058246 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:12.058197 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" podStartSLOduration=1.868369518 podStartE2EDuration="4.058183576s" podCreationTimestamp="2026-06-03 16:54:08 +0000 UTC" firstStartedPulling="2026-06-03 16:54:08.824274336 +0000 UTC m=+622.231756837" lastFinishedPulling="2026-06-03 16:54:11.014088395 +0000 UTC m=+624.421570895" observedRunningTime="2026-06-03 16:54:12.056007391 +0000 UTC m=+625.463489913" watchObservedRunningTime="2026-06-03 16:54:12.058183576 +0000 UTC m=+625.465666098" Jun 03 16:54:12.667402 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:12.667357 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:12.672346 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:12.672322 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:13.036571 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:13.036487 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:13.037474 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:13.037453 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl" Jun 03 16:54:28.177427 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.177393 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jwsh9"] Jun 03 16:54:28.180899 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.180881 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" Jun 03 16:54:28.186022 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.186000 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 16:54:28.186538 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.186516 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wbr77\"" Jun 03 16:54:28.186538 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.186520 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 16:54:28.200315 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.200293 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jwsh9"] Jun 03 16:54:28.259680 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.259651 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84cnt\" (UniqueName: \"kubernetes.io/projected/1cee6cba-2d82-4789-88b4-e9fa1165a3bb-kube-api-access-84cnt\") pod \"kuadrant-operator-catalog-jwsh9\" (UID: \"1cee6cba-2d82-4789-88b4-e9fa1165a3bb\") " pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" Jun 03 16:54:28.360873 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.360841 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84cnt\" (UniqueName: \"kubernetes.io/projected/1cee6cba-2d82-4789-88b4-e9fa1165a3bb-kube-api-access-84cnt\") pod \"kuadrant-operator-catalog-jwsh9\" (UID: \"1cee6cba-2d82-4789-88b4-e9fa1165a3bb\") " pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" Jun 03 16:54:28.379554 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.379531 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84cnt\" (UniqueName: \"kubernetes.io/projected/1cee6cba-2d82-4789-88b4-e9fa1165a3bb-kube-api-access-84cnt\") pod \"kuadrant-operator-catalog-jwsh9\" (UID: \"1cee6cba-2d82-4789-88b4-e9fa1165a3bb\") " pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" Jun 03 16:54:28.489209 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.489127 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" Jun 03 16:54:28.534715 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.534684 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jwsh9"] Jun 03 16:54:28.614760 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.614715 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jwsh9"] Jun 03 16:54:28.618264 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:54:28.618233 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cee6cba_2d82_4789_88b4_e9fa1165a3bb.slice/crio-f99fb043ff5a9fd585bdfea82c7ddf2c17055f490f1bb3ec22e9eafbce302bcc WatchSource:0}: Error finding container f99fb043ff5a9fd585bdfea82c7ddf2c17055f490f1bb3ec22e9eafbce302bcc: Status 404 returned error can't find the container with id f99fb043ff5a9fd585bdfea82c7ddf2c17055f490f1bb3ec22e9eafbce302bcc Jun 03 16:54:28.732523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.732491 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhk2p"] Jun 03 16:54:28.736804 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.736788 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:28.747625 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.747602 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhk2p"] Jun 03 16:54:28.865374 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.865341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqq4m\" (UniqueName: \"kubernetes.io/projected/a50e426b-2adf-476f-a445-9e29b8f0a33b-kube-api-access-vqq4m\") pod \"kuadrant-operator-catalog-rhk2p\" (UID: \"a50e426b-2adf-476f-a445-9e29b8f0a33b\") " pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:28.966592 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.966558 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqq4m\" (UniqueName: \"kubernetes.io/projected/a50e426b-2adf-476f-a445-9e29b8f0a33b-kube-api-access-vqq4m\") pod \"kuadrant-operator-catalog-rhk2p\" (UID: \"a50e426b-2adf-476f-a445-9e29b8f0a33b\") " pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:28.980557 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:28.980534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqq4m\" (UniqueName: \"kubernetes.io/projected/a50e426b-2adf-476f-a445-9e29b8f0a33b-kube-api-access-vqq4m\") pod \"kuadrant-operator-catalog-rhk2p\" (UID: \"a50e426b-2adf-476f-a445-9e29b8f0a33b\") " pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:29.045785 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:29.045674 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:29.077873 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:29.077835 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" event={"ID":"1cee6cba-2d82-4789-88b4-e9fa1165a3bb","Type":"ContainerStarted","Data":"f99fb043ff5a9fd585bdfea82c7ddf2c17055f490f1bb3ec22e9eafbce302bcc"} Jun 03 16:54:29.179757 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:29.179715 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rhk2p"] Jun 03 16:54:29.181411 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:54:29.181388 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50e426b_2adf_476f_a445_9e29b8f0a33b.slice/crio-00206b20fe9b861502e0db0bfd77d28e2b041ee17b9bdb0f077a167c1e48842f WatchSource:0}: Error finding container 00206b20fe9b861502e0db0bfd77d28e2b041ee17b9bdb0f077a167c1e48842f: Status 404 returned error can't find the container with id 00206b20fe9b861502e0db0bfd77d28e2b041ee17b9bdb0f077a167c1e48842f Jun 03 16:54:30.082934 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:30.082892 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" event={"ID":"a50e426b-2adf-476f-a445-9e29b8f0a33b","Type":"ContainerStarted","Data":"00206b20fe9b861502e0db0bfd77d28e2b041ee17b9bdb0f077a167c1e48842f"} Jun 03 16:54:31.087524 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.087489 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" event={"ID":"a50e426b-2adf-476f-a445-9e29b8f0a33b","Type":"ContainerStarted","Data":"b316733dadf6f293fc59815969c746cdb24c9234e7c5d746d59ac8af57cb90fd"} Jun 03 16:54:31.088828 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.088802 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" event={"ID":"1cee6cba-2d82-4789-88b4-e9fa1165a3bb","Type":"ContainerStarted","Data":"6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962"} Jun 03 16:54:31.088958 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.088865 2577 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" podUID="1cee6cba-2d82-4789-88b4-e9fa1165a3bb" containerName="registry-server" containerID="cri-o://6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962" gracePeriod=2 Jun 03 16:54:31.125869 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.125775 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" podStartSLOduration=1.435926751 podStartE2EDuration="3.125761115s" podCreationTimestamp="2026-06-03 16:54:28 +0000 UTC" firstStartedPulling="2026-06-03 16:54:29.183252141 +0000 UTC m=+642.590734646" lastFinishedPulling="2026-06-03 16:54:30.873086507 +0000 UTC m=+644.280569010" observedRunningTime="2026-06-03 16:54:31.125105375 +0000 UTC m=+644.532587907" watchObservedRunningTime="2026-06-03 16:54:31.125761115 +0000 UTC m=+644.533243636" Jun 03 16:54:31.161370 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.161324 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" podStartSLOduration=0.910688507 podStartE2EDuration="3.161308993s" podCreationTimestamp="2026-06-03 16:54:28 +0000 UTC" firstStartedPulling="2026-06-03 16:54:28.619525754 +0000 UTC m=+642.027008254" lastFinishedPulling="2026-06-03 16:54:30.870146231 +0000 UTC m=+644.277628740" observedRunningTime="2026-06-03 16:54:31.15962636 +0000 UTC m=+644.567108882" watchObservedRunningTime="2026-06-03 16:54:31.161308993 +0000 UTC m=+644.568791537" Jun 03 16:54:31.323364 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.323336 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" Jun 03 16:54:31.488289 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.488212 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84cnt\" (UniqueName: \"kubernetes.io/projected/1cee6cba-2d82-4789-88b4-e9fa1165a3bb-kube-api-access-84cnt\") pod \"1cee6cba-2d82-4789-88b4-e9fa1165a3bb\" (UID: \"1cee6cba-2d82-4789-88b4-e9fa1165a3bb\") " Jun 03 16:54:31.490297 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.490275 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cee6cba-2d82-4789-88b4-e9fa1165a3bb-kube-api-access-84cnt" (OuterVolumeSpecName: "kube-api-access-84cnt") pod "1cee6cba-2d82-4789-88b4-e9fa1165a3bb" (UID: "1cee6cba-2d82-4789-88b4-e9fa1165a3bb"). InnerVolumeSpecName "kube-api-access-84cnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 16:54:31.589125 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:31.589087 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84cnt\" (UniqueName: \"kubernetes.io/projected/1cee6cba-2d82-4789-88b4-e9fa1165a3bb-kube-api-access-84cnt\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 16:54:32.093015 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.092978 2577 generic.go:358] "Generic (PLEG): container finished" podID="1cee6cba-2d82-4789-88b4-e9fa1165a3bb" containerID="6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962" exitCode=0 Jun 03 16:54:32.093416 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.093028 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" Jun 03 16:54:32.093416 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.093064 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" event={"ID":"1cee6cba-2d82-4789-88b4-e9fa1165a3bb","Type":"ContainerDied","Data":"6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962"} Jun 03 16:54:32.093416 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.093101 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jwsh9" event={"ID":"1cee6cba-2d82-4789-88b4-e9fa1165a3bb","Type":"ContainerDied","Data":"f99fb043ff5a9fd585bdfea82c7ddf2c17055f490f1bb3ec22e9eafbce302bcc"} Jun 03 16:54:32.093416 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.093123 2577 scope.go:117] "RemoveContainer" containerID="6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962" Jun 03 16:54:32.101443 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.101417 2577 scope.go:117] "RemoveContainer" containerID="6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962" Jun 03 16:54:32.101708 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:54:32.101689 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962\": container with ID starting with 6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962 not found: ID does not exist" containerID="6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962" Jun 03 16:54:32.101786 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.101718 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962"} err="failed to get container status \"6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962\": rpc error: code = NotFound desc = could not find container \"6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962\": container with ID starting with 6648c6eb064cee3e6b6e7986aa70c7a43e9a764e4aab0862d91b3055c91db962 not found: ID does not exist" Jun 03 16:54:32.122625 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.122599 2577 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jwsh9"] Jun 03 16:54:32.127505 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:32.127485 2577 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jwsh9"] Jun 03 16:54:33.183009 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:33.182971 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cee6cba-2d82-4789-88b4-e9fa1165a3bb" path="/var/lib/kubelet/pods/1cee6cba-2d82-4789-88b4-e9fa1165a3bb/volumes" Jun 03 16:54:39.046460 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:39.046419 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:39.046460 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:39.046463 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:39.068095 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:39.068069 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:39.138003 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:39.137971 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-rhk2p" Jun 03 16:54:50.819377 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.819334 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk"] Jun 03 16:54:50.819853 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.819706 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cee6cba-2d82-4789-88b4-e9fa1165a3bb" containerName="registry-server" Jun 03 16:54:50.819853 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.819722 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cee6cba-2d82-4789-88b4-e9fa1165a3bb" containerName="registry-server" Jun 03 16:54:50.819853 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.819809 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="1cee6cba-2d82-4789-88b4-e9fa1165a3bb" containerName="registry-server" Jun 03 16:54:50.829390 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.829358 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" Jun 03 16:54:50.833032 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.833010 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 03 16:54:50.833441 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.833423 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-f2z97\"" Jun 03 16:54:50.837563 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.837543 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk"] Jun 03 16:54:50.843419 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.843396 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ctvl\" (UniqueName: \"kubernetes.io/projected/bbb440d4-d07c-421f-b3ec-d3b585e82de5-kube-api-access-4ctvl\") pod \"dns-operator-controller-manager-648d5c98bc-nhclk\" (UID: \"bbb440d4-d07c-421f-b3ec-d3b585e82de5\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" Jun 03 16:54:50.944777 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.944729 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ctvl\" (UniqueName: \"kubernetes.io/projected/bbb440d4-d07c-421f-b3ec-d3b585e82de5-kube-api-access-4ctvl\") pod \"dns-operator-controller-manager-648d5c98bc-nhclk\" (UID: \"bbb440d4-d07c-421f-b3ec-d3b585e82de5\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" Jun 03 16:54:50.970808 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:50.970774 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ctvl\" (UniqueName: \"kubernetes.io/projected/bbb440d4-d07c-421f-b3ec-d3b585e82de5-kube-api-access-4ctvl\") pod \"dns-operator-controller-manager-648d5c98bc-nhclk\" (UID: \"bbb440d4-d07c-421f-b3ec-d3b585e82de5\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" Jun 03 16:54:51.140216 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:51.140181 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" Jun 03 16:54:51.266392 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:51.266362 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk"] Jun 03 16:54:51.269186 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:54:51.269156 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb440d4_d07c_421f_b3ec_d3b585e82de5.slice/crio-8051fdc7bf9d60226acc8ccb31716f80ef82209e2c2fac5e5af5253ff10a2b1e WatchSource:0}: Error finding container 8051fdc7bf9d60226acc8ccb31716f80ef82209e2c2fac5e5af5253ff10a2b1e: Status 404 returned error can't find the container with id 8051fdc7bf9d60226acc8ccb31716f80ef82209e2c2fac5e5af5253ff10a2b1e Jun 03 16:54:52.154502 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:52.154466 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" event={"ID":"bbb440d4-d07c-421f-b3ec-d3b585e82de5","Type":"ContainerStarted","Data":"8051fdc7bf9d60226acc8ccb31716f80ef82209e2c2fac5e5af5253ff10a2b1e"} Jun 03 16:54:54.161835 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:54.161799 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" event={"ID":"bbb440d4-d07c-421f-b3ec-d3b585e82de5","Type":"ContainerStarted","Data":"407973b833b7fa4ae7396e249c78e855a4bea716a3a1dcf5d45b53dbc9f78331"} Jun 03 16:54:54.162201 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:54.161972 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" Jun 03 16:54:55.350841 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.350787 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" podStartSLOduration=3.196163151 podStartE2EDuration="5.350770653s" podCreationTimestamp="2026-06-03 16:54:50 +0000 UTC" firstStartedPulling="2026-06-03 16:54:51.271098517 +0000 UTC m=+664.678581017" lastFinishedPulling="2026-06-03 16:54:53.425706016 +0000 UTC m=+666.833188519" observedRunningTime="2026-06-03 16:54:54.222069579 +0000 UTC m=+667.629552106" watchObservedRunningTime="2026-06-03 16:54:55.350770653 +0000 UTC m=+668.758253175" Jun 03 16:54:55.351253 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.351238 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-lwh42"] Jun 03 16:54:55.354438 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.354422 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-lwh42" Jun 03 16:54:55.357835 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.357813 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-5z5x7\"" Jun 03 16:54:55.376038 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.376009 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-lwh42"] Jun 03 16:54:55.378624 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.378602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbrjq\" (UniqueName: \"kubernetes.io/projected/5e7af513-0a95-4fbf-bc28-abf061164255-kube-api-access-lbrjq\") pod \"authorino-operator-657f44b778-lwh42\" (UID: \"5e7af513-0a95-4fbf-bc28-abf061164255\") " pod="kuadrant-system/authorino-operator-657f44b778-lwh42" Jun 03 16:54:55.479022 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.478983 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lbrjq\" (UniqueName: \"kubernetes.io/projected/5e7af513-0a95-4fbf-bc28-abf061164255-kube-api-access-lbrjq\") pod \"authorino-operator-657f44b778-lwh42\" (UID: \"5e7af513-0a95-4fbf-bc28-abf061164255\") " pod="kuadrant-system/authorino-operator-657f44b778-lwh42" Jun 03 16:54:55.526350 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.526317 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbrjq\" (UniqueName: \"kubernetes.io/projected/5e7af513-0a95-4fbf-bc28-abf061164255-kube-api-access-lbrjq\") pod \"authorino-operator-657f44b778-lwh42\" (UID: \"5e7af513-0a95-4fbf-bc28-abf061164255\") " pod="kuadrant-system/authorino-operator-657f44b778-lwh42" Jun 03 16:54:55.664175 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.664075 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-lwh42" Jun 03 16:54:55.817297 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:54:55.817265 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7af513_0a95_4fbf_bc28_abf061164255.slice/crio-3c2177679da56ca7df5e5d11d55fbc7d890eddd11869ca18364de7ba987658fa WatchSource:0}: Error finding container 3c2177679da56ca7df5e5d11d55fbc7d890eddd11869ca18364de7ba987658fa: Status 404 returned error can't find the container with id 3c2177679da56ca7df5e5d11d55fbc7d890eddd11869ca18364de7ba987658fa Jun 03 16:54:55.821629 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:55.821607 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-lwh42"] Jun 03 16:54:56.168415 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:56.168378 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-lwh42" event={"ID":"5e7af513-0a95-4fbf-bc28-abf061164255","Type":"ContainerStarted","Data":"3c2177679da56ca7df5e5d11d55fbc7d890eddd11869ca18364de7ba987658fa"} Jun 03 16:54:58.175851 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:58.175813 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-lwh42" event={"ID":"5e7af513-0a95-4fbf-bc28-abf061164255","Type":"ContainerStarted","Data":"9750e77db790f7d909e1df5fe11f74b2206a974e9213b649091cec9c44afbdda"} Jun 03 16:54:58.176257 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:58.175937 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-lwh42" Jun 03 16:54:58.226266 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:54:58.226183 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-lwh42" podStartSLOduration=1.11404763 podStartE2EDuration="3.226170967s" podCreationTimestamp="2026-06-03 16:54:55 +0000 UTC" firstStartedPulling="2026-06-03 16:54:55.819262461 +0000 UTC m=+669.226744961" lastFinishedPulling="2026-06-03 16:54:57.931385798 +0000 UTC m=+671.338868298" observedRunningTime="2026-06-03 16:54:58.225540744 +0000 UTC m=+671.633023267" watchObservedRunningTime="2026-06-03 16:54:58.226170967 +0000 UTC m=+671.633653565" Jun 03 16:55:05.166944 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:05.166910 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-nhclk" Jun 03 16:55:09.184439 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:09.184401 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-lwh42" Jun 03 16:55:14.325672 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.325638 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp"] Jun 03 16:55:14.329034 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.329018 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.335855 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.335831 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 16:55:14.336089 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.336073 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lz6p5\"" Jun 03 16:55:14.336518 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.336503 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 16:55:14.374669 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.374634 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp"] Jun 03 16:55:14.433212 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.433180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/963d19fe-575b-41cf-b996-2e27c175ac2d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.433380 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.433243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/963d19fe-575b-41cf-b996-2e27c175ac2d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.433380 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.433289 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ffzv\" (UniqueName: \"kubernetes.io/projected/963d19fe-575b-41cf-b996-2e27c175ac2d-kube-api-access-7ffzv\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.533893 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.533859 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/963d19fe-575b-41cf-b996-2e27c175ac2d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.533893 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.533896 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7ffzv\" (UniqueName: \"kubernetes.io/projected/963d19fe-575b-41cf-b996-2e27c175ac2d-kube-api-access-7ffzv\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.534096 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.533949 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/963d19fe-575b-41cf-b996-2e27c175ac2d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.534096 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:55:14.533993 2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 03 16:55:14.534096 ip-10-0-141-18 kubenswrapper[2577]: E0603 16:55:14.534065 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/963d19fe-575b-41cf-b996-2e27c175ac2d-plugin-serving-cert podName:963d19fe-575b-41cf-b996-2e27c175ac2d nodeName:}" failed. No retries permitted until 2026-06-03 16:55:15.034047747 +0000 UTC m=+688.441530247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/963d19fe-575b-41cf-b996-2e27c175ac2d-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-4cnvp" (UID: "963d19fe-575b-41cf-b996-2e27c175ac2d") : secret "plugin-serving-cert" not found Jun 03 16:55:14.534605 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.534588 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/963d19fe-575b-41cf-b996-2e27c175ac2d-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:14.554393 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:14.554365 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ffzv\" (UniqueName: \"kubernetes.io/projected/963d19fe-575b-41cf-b996-2e27c175ac2d-kube-api-access-7ffzv\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:15.039176 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:15.039106 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/963d19fe-575b-41cf-b996-2e27c175ac2d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:15.041655 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:15.041627 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/963d19fe-575b-41cf-b996-2e27c175ac2d-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-4cnvp\" (UID: \"963d19fe-575b-41cf-b996-2e27c175ac2d\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:15.237365 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:15.237335 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" Jun 03 16:55:15.393932 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:15.393794 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp"] Jun 03 16:55:15.396638 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:55:15.396610 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod963d19fe_575b_41cf_b996_2e27c175ac2d.slice/crio-5c0da7572db80e9014d1d825ced6f47533bf0dc363c929b13a5296e789dac6c2 WatchSource:0}: Error finding container 5c0da7572db80e9014d1d825ced6f47533bf0dc363c929b13a5296e789dac6c2: Status 404 returned error can't find the container with id 5c0da7572db80e9014d1d825ced6f47533bf0dc363c929b13a5296e789dac6c2 Jun 03 16:55:16.230406 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:16.230368 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" event={"ID":"963d19fe-575b-41cf-b996-2e27c175ac2d","Type":"ContainerStarted","Data":"5c0da7572db80e9014d1d825ced6f47533bf0dc363c929b13a5296e789dac6c2"} Jun 03 16:55:40.315195 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:40.315155 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" event={"ID":"963d19fe-575b-41cf-b996-2e27c175ac2d","Type":"ContainerStarted","Data":"ae67029850f5c1c46ce3ab60d500683acc50475edf5e582edc564ac99513fecc"} Jun 03 16:55:40.375184 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:40.375133 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-4cnvp" podStartSLOduration=2.40670423 podStartE2EDuration="26.375119489s" podCreationTimestamp="2026-06-03 16:55:14 +0000 UTC" firstStartedPulling="2026-06-03 16:55:15.397916396 +0000 UTC m=+688.805398910" lastFinishedPulling="2026-06-03 16:55:39.366331665 +0000 UTC m=+712.773814169" observedRunningTime="2026-06-03 16:55:40.374543377 +0000 UTC m=+713.782025900" watchObservedRunningTime="2026-06-03 16:55:40.375119489 +0000 UTC m=+713.782602010" Jun 03 16:55:59.926158 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:55:59.926123 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn"] Jun 03 16:56:00.073085 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.073050 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn"] Jun 03 16:56:00.073283 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.073175 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.080157 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.080129 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-png94\"" Jun 03 16:56:00.135866 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.135829 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw6cv\" (UniqueName: \"kubernetes.io/projected/cac35f2d-c984-45f3-902e-3802cf061871-kube-api-access-cw6cv\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.135866 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.135868 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.136120 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.135891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cac35f2d-c984-45f3-902e-3802cf061871-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.136120 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.135987 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.136120 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.136067 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.136120 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.136097 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.136316 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.136160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.136316 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.136187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cac35f2d-c984-45f3-902e-3802cf061871-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.136316 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.136217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cac35f2d-c984-45f3-902e-3802cf061871-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.236993 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.236906 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.236993 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.236943 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.236993 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.236971 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237275 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237199 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cac35f2d-c984-45f3-902e-3802cf061871-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237275 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237252 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cac35f2d-c984-45f3-902e-3802cf061871-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237376 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237298 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cw6cv\" (UniqueName: \"kubernetes.io/projected/cac35f2d-c984-45f3-902e-3802cf061871-kube-api-access-cw6cv\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237376 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237334 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237376 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237360 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237399 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237368 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cac35f2d-c984-45f3-902e-3802cf061871-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237444 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237523 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237469 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.237772 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237754 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.238009 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.237989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cac35f2d-c984-45f3-902e-3802cf061871-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.239467 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.239448 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cac35f2d-c984-45f3-902e-3802cf061871-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.239704 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.239685 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cac35f2d-c984-45f3-902e-3802cf061871-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.248108 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.248084 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cac35f2d-c984-45f3-902e-3802cf061871-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.251380 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.251351 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw6cv\" (UniqueName: \"kubernetes.io/projected/cac35f2d-c984-45f3-902e-3802cf061871-kube-api-access-cw6cv\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-rwhjn\" (UID: \"cac35f2d-c984-45f3-902e-3802cf061871\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.384436 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.384401 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:00.526879 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.526853 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn"] Jun 03 16:56:00.528678 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:56:00.528651 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac35f2d_c984_45f3_902e_3802cf061871.slice/crio-f1a28d3e88933b914f5b50899916402d06fed9e12efda632a1674edf9065ad56 WatchSource:0}: Error finding container f1a28d3e88933b914f5b50899916402d06fed9e12efda632a1674edf9065ad56: Status 404 returned error can't find the container with id f1a28d3e88933b914f5b50899916402d06fed9e12efda632a1674edf9065ad56 Jun 03 16:56:00.530626 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.530597 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 16:56:00.530711 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.530667 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 16:56:00.530821 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:00.530711 2577 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 03 16:56:01.378823 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:01.378772 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" event={"ID":"cac35f2d-c984-45f3-902e-3802cf061871","Type":"ContainerStarted","Data":"6bb6cca4ae1aa56767407cb1c07a0979f1f29e5b7477bf639a4e7762271640b7"} Jun 03 16:56:01.378823 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:01.378826 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" event={"ID":"cac35f2d-c984-45f3-902e-3802cf061871","Type":"ContainerStarted","Data":"f1a28d3e88933b914f5b50899916402d06fed9e12efda632a1674edf9065ad56"} Jun 03 16:56:01.384704 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:01.384677 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:01.388921 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:01.388903 2577 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:01.412472 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:01.412420 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" podStartSLOduration=2.4124090000000002 podStartE2EDuration="2.412409s" podCreationTimestamp="2026-06-03 16:55:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 16:56:01.410525772 +0000 UTC m=+734.818008295" watchObservedRunningTime="2026-06-03 16:56:01.412409 +0000 UTC m=+734.819891520" Jun 03 16:56:02.381479 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:02.381443 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:02.382390 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:02.382375 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-rwhjn" Jun 03 16:56:04.892557 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:04.892517 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:56:04.954002 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:04.953964 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:56:04.954166 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:04.954121 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:04.957994 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:04.957971 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 16:56:04.968703 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:04.968674 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:56:05.082233 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.082191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6ttg\" (UniqueName: \"kubernetes.io/projected/6a5515bd-8afb-4db3-871a-0f6a474efd25-kube-api-access-v6ttg\") pod \"limitador-limitador-78c99df468-jrhx4\" (UID: \"6a5515bd-8afb-4db3-871a-0f6a474efd25\") " pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:05.082408 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.082268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a5515bd-8afb-4db3-871a-0f6a474efd25-config-file\") pod \"limitador-limitador-78c99df468-jrhx4\" (UID: \"6a5515bd-8afb-4db3-871a-0f6a474efd25\") " pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:05.183034 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.182947 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6ttg\" (UniqueName: \"kubernetes.io/projected/6a5515bd-8afb-4db3-871a-0f6a474efd25-kube-api-access-v6ttg\") pod \"limitador-limitador-78c99df468-jrhx4\" (UID: \"6a5515bd-8afb-4db3-871a-0f6a474efd25\") " pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:05.183034 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.182989 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a5515bd-8afb-4db3-871a-0f6a474efd25-config-file\") pod \"limitador-limitador-78c99df468-jrhx4\" (UID: \"6a5515bd-8afb-4db3-871a-0f6a474efd25\") " pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:05.183578 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.183560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6a5515bd-8afb-4db3-871a-0f6a474efd25-config-file\") pod \"limitador-limitador-78c99df468-jrhx4\" (UID: \"6a5515bd-8afb-4db3-871a-0f6a474efd25\") " pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:05.198600 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.198576 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6ttg\" (UniqueName: \"kubernetes.io/projected/6a5515bd-8afb-4db3-871a-0f6a474efd25-kube-api-access-v6ttg\") pod \"limitador-limitador-78c99df468-jrhx4\" (UID: \"6a5515bd-8afb-4db3-871a-0f6a474efd25\") " pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:05.264323 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.264284 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:05.412795 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:05.412773 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:56:05.415286 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:56:05.415261 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5515bd_8afb_4db3_871a_0f6a474efd25.slice/crio-6a1c40d0e22d1a54fa9b9caa44d27fd2f730863d9f270414a8d3d2b85fc753f0 WatchSource:0}: Error finding container 6a1c40d0e22d1a54fa9b9caa44d27fd2f730863d9f270414a8d3d2b85fc753f0: Status 404 returned error can't find the container with id 6a1c40d0e22d1a54fa9b9caa44d27fd2f730863d9f270414a8d3d2b85fc753f0 Jun 03 16:56:06.395040 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:06.395004 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" event={"ID":"6a5515bd-8afb-4db3-871a-0f6a474efd25","Type":"ContainerStarted","Data":"6a1c40d0e22d1a54fa9b9caa44d27fd2f730863d9f270414a8d3d2b85fc753f0"} Jun 03 16:56:09.407620 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:09.407584 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" event={"ID":"6a5515bd-8afb-4db3-871a-0f6a474efd25","Type":"ContainerStarted","Data":"b98255fa47a71675f0d78861eca1c2fd182bcf98c494fd4782b8074e715b82a3"} Jun 03 16:56:09.408062 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:09.407694 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:56:09.427366 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:09.427317 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" podStartSLOduration=1.930676068 podStartE2EDuration="5.427301318s" podCreationTimestamp="2026-06-03 16:56:04 +0000 UTC" firstStartedPulling="2026-06-03 16:56:05.417209323 +0000 UTC m=+738.824691823" lastFinishedPulling="2026-06-03 16:56:08.913834555 +0000 UTC m=+742.321317073" observedRunningTime="2026-06-03 16:56:09.426109209 +0000 UTC m=+742.833591733" watchObservedRunningTime="2026-06-03 16:56:09.427301318 +0000 UTC m=+742.834783839" Jun 03 16:56:20.411971 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:56:20.411939 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-jrhx4" Jun 03 16:58:11.986022 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:58:11.985985 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:59:14.989389 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:14.989336 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:59:20.734486 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.734452 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7"] Jun 03 16:59:20.737855 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.737838 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.740505 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.740481 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 16:59:20.740505 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.740497 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 16:59:20.740646 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.740526 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6zvg\"" Jun 03 16:59:20.741802 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.741778 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 16:59:20.747998 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.747969 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7"] Jun 03 16:59:20.846084 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.846050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.846293 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.846090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgq9w\" (UniqueName: \"kubernetes.io/projected/a7083492-6a39-40bf-b036-6a56977c118e-kube-api-access-tgq9w\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.846293 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.846194 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7083492-6a39-40bf-b036-6a56977c118e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.846293 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.846235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.846293 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.846266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.846442 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.846339 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947008 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.946971 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7083492-6a39-40bf-b036-6a56977c118e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947008 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947011 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947031 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947064 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947088 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947267 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947205 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tgq9w\" (UniqueName: \"kubernetes.io/projected/a7083492-6a39-40bf-b036-6a56977c118e-kube-api-access-tgq9w\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947522 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947499 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947614 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947593 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.947677 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.947599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.949333 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.949298 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7083492-6a39-40bf-b036-6a56977c118e-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.949669 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.949649 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7083492-6a39-40bf-b036-6a56977c118e-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:20.955962 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:20.955943 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgq9w\" (UniqueName: \"kubernetes.io/projected/a7083492-6a39-40bf-b036-6a56977c118e-kube-api-access-tgq9w\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7\" (UID: \"a7083492-6a39-40bf-b036-6a56977c118e\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:21.050015 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:21.049930 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" Jun 03 16:59:21.173009 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:21.172979 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7"] Jun 03 16:59:21.175443 ip-10-0-141-18 kubenswrapper[2577]: W0603 16:59:21.175417 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7083492_6a39_40bf_b036_6a56977c118e.slice/crio-26875f9ef4c116b73141b55176eeffde6eef4f8db0d43e773f8bf621e24ddc0c WatchSource:0}: Error finding container 26875f9ef4c116b73141b55176eeffde6eef4f8db0d43e773f8bf621e24ddc0c: Status 404 returned error can't find the container with id 26875f9ef4c116b73141b55176eeffde6eef4f8db0d43e773f8bf621e24ddc0c Jun 03 16:59:21.177271 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:21.177255 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 16:59:21.296790 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:21.296756 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:59:22.007904 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:22.007852 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" event={"ID":"a7083492-6a39-40bf-b036-6a56977c118e","Type":"ContainerStarted","Data":"26875f9ef4c116b73141b55176eeffde6eef4f8db0d43e773f8bf621e24ddc0c"} Jun 03 16:59:25.019163 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:25.019117 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7" event={"ID":"a7083492-6a39-40bf-b036-6a56977c118e","Type":"ContainerStarted","Data":"cd2ab79b9e4e436dc772dfe8a46312dd7d185f6040a9b7669e954d5a5123e393"} Jun 03 16:59:26.007150 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:26.007105 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:59:35.307235 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:35.307185 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:59:41.188158 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:41.188129 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 16:59:52.127278 ip-10-0-141-18 kubenswrapper[2577]: I0603 16:59:52.127241 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-jrhx4"] Jun 03 17:00:00.137583 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.137550 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29675100-qp76x"] Jun 03 17:00:00.140948 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.140931 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" Jun 03 17:00:00.144090 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.144066 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gd45d\"" Jun 03 17:00:00.149673 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.149645 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675100-qp76x"] Jun 03 17:00:00.170166 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.170140 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w5k6\" (UniqueName: \"kubernetes.io/projected/e31697f8-7ffd-4e75-83f4-5321f8c3dc6a-kube-api-access-5w5k6\") pod \"maas-api-key-cleanup-29675100-qp76x\" (UID: \"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a\") " pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" Jun 03 17:00:00.270549 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.270513 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5w5k6\" (UniqueName: \"kubernetes.io/projected/e31697f8-7ffd-4e75-83f4-5321f8c3dc6a-kube-api-access-5w5k6\") pod \"maas-api-key-cleanup-29675100-qp76x\" (UID: \"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a\") " pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" Jun 03 17:00:00.281167 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.281141 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w5k6\" (UniqueName: \"kubernetes.io/projected/e31697f8-7ffd-4e75-83f4-5321f8c3dc6a-kube-api-access-5w5k6\") pod \"maas-api-key-cleanup-29675100-qp76x\" (UID: \"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a\") " pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" Jun 03 17:00:00.451221 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.451122 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" Jun 03 17:00:00.573462 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:00.573431 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29675100-qp76x"] Jun 03 17:00:00.576383 ip-10-0-141-18 kubenswrapper[2577]: W0603 17:00:00.576358 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31697f8_7ffd_4e75_83f4_5321f8c3dc6a.slice/crio-acfcf8e55ea7fb7daf10ec6fc61d7687d04af15d2a6dcd8007251bfa420ba2fb WatchSource:0}: Error finding container acfcf8e55ea7fb7daf10ec6fc61d7687d04af15d2a6dcd8007251bfa420ba2fb: Status 404 returned error can't find the container with id acfcf8e55ea7fb7daf10ec6fc61d7687d04af15d2a6dcd8007251bfa420ba2fb Jun 03 17:00:01.126224 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:01.126189 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" event={"ID":"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a","Type":"ContainerStarted","Data":"acfcf8e55ea7fb7daf10ec6fc61d7687d04af15d2a6dcd8007251bfa420ba2fb"} Jun 03 17:00:22.195928 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:22.195894 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" event={"ID":"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a","Type":"ContainerStarted","Data":"730b4c317e834b40b2e12fa31beaf898b9ca6a2f956f54afdd76df9d921dd9c5"} Jun 03 17:00:22.211872 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:22.211827 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" podStartSLOduration=1.281977768 podStartE2EDuration="22.211813542s" podCreationTimestamp="2026-06-03 17:00:00 +0000 UTC" firstStartedPulling="2026-06-03 17:00:00.578507402 +0000 UTC m=+973.985989904" lastFinishedPulling="2026-06-03 17:00:21.508343165 +0000 UTC m=+994.915825678" observedRunningTime="2026-06-03 17:00:22.210873606 +0000 UTC m=+995.618356127" watchObservedRunningTime="2026-06-03 17:00:22.211813542 +0000 UTC m=+995.619296060" Jun 03 17:00:23.199589 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:23.199550 2577 generic.go:358] "Generic (PLEG): container finished" podID="e31697f8-7ffd-4e75-83f4-5321f8c3dc6a" containerID="730b4c317e834b40b2e12fa31beaf898b9ca6a2f956f54afdd76df9d921dd9c5" exitCode=0 Jun 03 17:00:23.199979 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:23.199634 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" event={"ID":"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a","Type":"ContainerDied","Data":"730b4c317e834b40b2e12fa31beaf898b9ca6a2f956f54afdd76df9d921dd9c5"} Jun 03 17:00:24.321927 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:24.321901 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" Jun 03 17:00:24.472203 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:24.472114 2577 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w5k6\" (UniqueName: \"kubernetes.io/projected/e31697f8-7ffd-4e75-83f4-5321f8c3dc6a-kube-api-access-5w5k6\") pod \"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a\" (UID: \"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a\") " Jun 03 17:00:24.474297 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:24.474273 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e31697f8-7ffd-4e75-83f4-5321f8c3dc6a-kube-api-access-5w5k6" (OuterVolumeSpecName: "kube-api-access-5w5k6") pod "e31697f8-7ffd-4e75-83f4-5321f8c3dc6a" (UID: "e31697f8-7ffd-4e75-83f4-5321f8c3dc6a"). InnerVolumeSpecName "kube-api-access-5w5k6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 17:00:24.573194 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:24.573160 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w5k6\" (UniqueName: \"kubernetes.io/projected/e31697f8-7ffd-4e75-83f4-5321f8c3dc6a-kube-api-access-5w5k6\") on node \"ip-10-0-141-18.ec2.internal\" DevicePath \"\"" Jun 03 17:00:25.207110 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:25.207079 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" event={"ID":"e31697f8-7ffd-4e75-83f4-5321f8c3dc6a","Type":"ContainerDied","Data":"acfcf8e55ea7fb7daf10ec6fc61d7687d04af15d2a6dcd8007251bfa420ba2fb"} Jun 03 17:00:25.207110 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:25.207111 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="acfcf8e55ea7fb7daf10ec6fc61d7687d04af15d2a6dcd8007251bfa420ba2fb" Jun 03 17:00:25.207283 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:00:25.207134 2577 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29675100-qp76x" Jun 03 17:06:12.138571 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:12.138489 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78b89f755d-466pc_9221838a-aabd-469e-bf45-2d7e3f5d62b3/nginx/0.log" Jun 03 17:06:12.709291 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:12.709251 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675100-qp76x_e31697f8-7ffd-4e75-83f4-5321f8c3dc6a/cleanup/0.log" Jun 03 17:06:13.421142 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:13.421113 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-qrb58_7d5122f4-ed60-48b7-99bc-5c20fb785723/copy-manifests/0.log" Jun 03 17:06:13.428551 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:13.428521 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-qrb58_7d5122f4-ed60-48b7-99bc-5c20fb785723/manager/0.log" Jun 03 17:06:14.906792 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:14.906758 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-lwh42_5e7af513-0a95-4fbf-bc28-abf061164255/manager/0.log" Jun 03 17:06:15.011712 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:15.011668 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-nhclk_bbb440d4-d07c-421f-b3ec-d3b585e82de5/manager/0.log" Jun 03 17:06:15.119368 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:15.119340 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4cnvp_963d19fe-575b-41cf-b996-2e27c175ac2d/kuadrant-console-plugin/0.log" Jun 03 17:06:15.241646 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:15.241560 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rhk2p_a50e426b-2adf-476f-a445-9e29b8f0a33b/registry-server/0.log" Jun 03 17:06:15.475815 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:15.475787 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jrhx4_6a5515bd-8afb-4db3-871a-0f6a474efd25/limitador/0.log" Jun 03 17:06:15.923376 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:15.923345 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl_87d1ce34-9dc7-4ad3-ac51-f8f39cb22404/istio-proxy/0.log" Jun 03 17:06:16.347176 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:16.347096 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-rwhjn_cac35f2d-c984-45f3-902e-3802cf061871/istio-proxy/0.log" Jun 03 17:06:17.031416 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:17.031381 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-j8hh7_a7083492-6a39-40bf-b036-6a56977c118e/storage-initializer/0.log" Jun 03 17:06:21.152091 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.152059 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jxqt/must-gather-fdj9s"] Jun 03 17:06:21.152491 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.152348 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e31697f8-7ffd-4e75-83f4-5321f8c3dc6a" containerName="cleanup" Jun 03 17:06:21.152491 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.152358 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e31697f8-7ffd-4e75-83f4-5321f8c3dc6a" containerName="cleanup" Jun 03 17:06:21.152491 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.152412 2577 memory_manager.go:356] "RemoveStaleState removing state" podUID="e31697f8-7ffd-4e75-83f4-5321f8c3dc6a" containerName="cleanup" Jun 03 17:06:21.155231 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.155211 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.158165 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.158143 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jxqt\"/\"kube-root-ca.crt\"" Jun 03 17:06:21.159377 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.159359 2577 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6jxqt\"/\"default-dockercfg-t9nhb\"" Jun 03 17:06:21.159461 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.159391 2577 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6jxqt\"/\"openshift-service-ca.crt\"" Jun 03 17:06:21.172680 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.172648 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jxqt/must-gather-fdj9s"] Jun 03 17:06:21.175366 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.175346 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a3bd70d-2d9f-4633-b37c-fbea004b44ac-must-gather-output\") pod \"must-gather-fdj9s\" (UID: \"9a3bd70d-2d9f-4633-b37c-fbea004b44ac\") " pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.175466 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.175421 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctmn\" (UniqueName: \"kubernetes.io/projected/9a3bd70d-2d9f-4633-b37c-fbea004b44ac-kube-api-access-8ctmn\") pod \"must-gather-fdj9s\" (UID: \"9a3bd70d-2d9f-4633-b37c-fbea004b44ac\") " pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.276648 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.276617 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctmn\" (UniqueName: \"kubernetes.io/projected/9a3bd70d-2d9f-4633-b37c-fbea004b44ac-kube-api-access-8ctmn\") pod \"must-gather-fdj9s\" (UID: \"9a3bd70d-2d9f-4633-b37c-fbea004b44ac\") " pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.276827 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.276656 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a3bd70d-2d9f-4633-b37c-fbea004b44ac-must-gather-output\") pod \"must-gather-fdj9s\" (UID: \"9a3bd70d-2d9f-4633-b37c-fbea004b44ac\") " pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.276982 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.276966 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9a3bd70d-2d9f-4633-b37c-fbea004b44ac-must-gather-output\") pod \"must-gather-fdj9s\" (UID: \"9a3bd70d-2d9f-4633-b37c-fbea004b44ac\") " pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.287395 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.287372 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctmn\" (UniqueName: \"kubernetes.io/projected/9a3bd70d-2d9f-4633-b37c-fbea004b44ac-kube-api-access-8ctmn\") pod \"must-gather-fdj9s\" (UID: \"9a3bd70d-2d9f-4633-b37c-fbea004b44ac\") " pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.464306 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.464231 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jxqt/must-gather-fdj9s" Jun 03 17:06:21.588843 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.588815 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jxqt/must-gather-fdj9s"] Jun 03 17:06:21.591444 ip-10-0-141-18 kubenswrapper[2577]: W0603 17:06:21.591407 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a3bd70d_2d9f_4633_b37c_fbea004b44ac.slice/crio-e5e02fa72b6b493569249954bca9a72f79999044095ffea538869a4688a389b2 WatchSource:0}: Error finding container e5e02fa72b6b493569249954bca9a72f79999044095ffea538869a4688a389b2: Status 404 returned error can't find the container with id e5e02fa72b6b493569249954bca9a72f79999044095ffea538869a4688a389b2 Jun 03 17:06:21.593225 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:21.593207 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 17:06:22.342023 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:22.341981 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jxqt/must-gather-fdj9s" event={"ID":"9a3bd70d-2d9f-4633-b37c-fbea004b44ac","Type":"ContainerStarted","Data":"e5e02fa72b6b493569249954bca9a72f79999044095ffea538869a4688a389b2"} Jun 03 17:06:23.348117 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:23.348066 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jxqt/must-gather-fdj9s" event={"ID":"9a3bd70d-2d9f-4633-b37c-fbea004b44ac","Type":"ContainerStarted","Data":"d515e196a723864340df8a5a6daf91199aef338515d41b4d53f259bfa79b1757"} Jun 03 17:06:23.348117 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:23.348122 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jxqt/must-gather-fdj9s" event={"ID":"9a3bd70d-2d9f-4633-b37c-fbea004b44ac","Type":"ContainerStarted","Data":"a4f49cb89795410393bfebecbf840bf64e7b65a4da06ef13a3d1f55f61700b1c"} Jun 03 17:06:23.368062 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:23.367998 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6jxqt/must-gather-fdj9s" podStartSLOduration=1.446839553 podStartE2EDuration="2.367979999s" podCreationTimestamp="2026-06-03 17:06:21 +0000 UTC" firstStartedPulling="2026-06-03 17:06:21.593372504 +0000 UTC m=+1355.000855004" lastFinishedPulling="2026-06-03 17:06:22.514512942 +0000 UTC m=+1355.921995450" observedRunningTime="2026-06-03 17:06:23.365369774 +0000 UTC m=+1356.772852293" watchObservedRunningTime="2026-06-03 17:06:23.367979999 +0000 UTC m=+1356.775462519" Jun 03 17:06:24.398716 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:24.398680 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bxr4l_4fbf8258-133c-4f34-b043-8d4f3dddc872/global-pull-secret-syncer/0.log" Jun 03 17:06:24.551590 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:24.551555 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wbw48_4611c661-a784-4315-88a1-38d0f09cc3f3/konnectivity-agent/0.log" Jun 03 17:06:24.593690 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:24.593651 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-18.ec2.internal_7cde4eadd86c11b7e8e2f11f03cb015e/haproxy/0.log" Jun 03 17:06:28.828302 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:28.828207 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-lwh42_5e7af513-0a95-4fbf-bc28-abf061164255/manager/0.log" Jun 03 17:06:28.849173 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:28.849103 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-nhclk_bbb440d4-d07c-421f-b3ec-d3b585e82de5/manager/0.log" Jun 03 17:06:28.876565 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:28.876533 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-4cnvp_963d19fe-575b-41cf-b996-2e27c175ac2d/kuadrant-console-plugin/0.log" Jun 03 17:06:28.908186 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:28.908154 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-rhk2p_a50e426b-2adf-476f-a445-9e29b8f0a33b/registry-server/0.log" Jun 03 17:06:28.992292 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:28.992266 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-jrhx4_6a5515bd-8afb-4db3-871a-0f6a474efd25/limitador/0.log" Jun 03 17:06:31.073239 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:31.073203 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rzj88_70362cfd-183c-4fa6-b6ca-388fd10fb2b1/node-exporter/0.log" Jun 03 17:06:31.098060 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:31.098034 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rzj88_70362cfd-183c-4fa6-b6ca-388fd10fb2b1/kube-rbac-proxy/0.log" Jun 03 17:06:31.121296 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:31.121269 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rzj88_70362cfd-183c-4fa6-b6ca-388fd10fb2b1/init-textfile/0.log" Jun 03 17:06:33.596394 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.596352 2577 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw"] Jun 03 17:06:33.603963 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.603932 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.617914 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.617886 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw"] Jun 03 17:06:33.700074 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.700017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-sys\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.700074 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.700078 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52575\" (UniqueName: \"kubernetes.io/projected/eb777445-738c-48f7-a875-4133916ccade-kube-api-access-52575\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.700316 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.700136 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-proc\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.700316 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.700180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-lib-modules\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.700316 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.700259 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-podres\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801349 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801311 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-sys\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801527 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801358 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-52575\" (UniqueName: \"kubernetes.io/projected/eb777445-738c-48f7-a875-4133916ccade-kube-api-access-52575\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801527 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801433 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-sys\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801527 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801478 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-proc\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801527 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801519 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-lib-modules\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801722 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801593 2577 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-podres\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801722 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-proc\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801722 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801710 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-podres\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.801722 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.801714 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb777445-738c-48f7-a875-4133916ccade-lib-modules\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.810874 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.810843 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52575\" (UniqueName: \"kubernetes.io/projected/eb777445-738c-48f7-a875-4133916ccade-kube-api-access-52575\") pod \"perf-node-gather-daemonset-m45rw\" (UID: \"eb777445-738c-48f7-a875-4133916ccade\") " pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:33.916745 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:33.916682 2577 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:34.070913 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:34.070869 2577 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw"] Jun 03 17:06:34.400762 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:34.400702 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" event={"ID":"eb777445-738c-48f7-a875-4133916ccade","Type":"ContainerStarted","Data":"49d70c4a12e691bde8526248db9512b9cbdd592a7c493668fcec53451872660e"} Jun 03 17:06:34.400762 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:34.400767 2577 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" event={"ID":"eb777445-738c-48f7-a875-4133916ccade","Type":"ContainerStarted","Data":"a025e12f4b341ea333196883d2969652d94d769cc09c0d2b187b1a92d84509b7"} Jun 03 17:06:34.401548 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:34.401520 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:34.419711 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:34.419665 2577 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" podStartSLOduration=1.419652375 podStartE2EDuration="1.419652375s" podCreationTimestamp="2026-06-03 17:06:33 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 17:06:34.418288407 +0000 UTC m=+1367.825770930" watchObservedRunningTime="2026-06-03 17:06:34.419652375 +0000 UTC m=+1367.827134926" Jun 03 17:06:35.398330 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:35.398304 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbddz_dfe4aa4c-1d75-4756-b199-4a831115dc45/dns/0.log" Jun 03 17:06:35.427107 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:35.427078 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbddz_dfe4aa4c-1d75-4756-b199-4a831115dc45/kube-rbac-proxy/0.log" Jun 03 17:06:35.566048 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:35.566017 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc277_0336c145-90b5-41f7-8938-634fafc7bbc1/dns-node-resolver/0.log" Jun 03 17:06:36.126805 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:36.126777 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2x2v9_2283ed9f-3ed8-4c76-9cde-85998b9c24a6/node-ca/0.log" Jun 03 17:06:37.063901 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:37.063873 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bsz5bl_87d1ce34-9dc7-4ad3-ac51-f8f39cb22404/istio-proxy/0.log" Jun 03 17:06:37.195604 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:37.195569 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-rwhjn_cac35f2d-c984-45f3-902e-3802cf061871/istio-proxy/0.log" Jun 03 17:06:37.763413 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:37.763376 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mqjtw_875cab77-14b7-4328-9c63-b90a3af052ff/serve-healthcheck-canary/0.log" Jun 03 17:06:38.340631 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:38.340605 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9n2sx_98587b47-40b3-4bc4-a10a-cffbd9e53b3a/kube-rbac-proxy/0.log" Jun 03 17:06:38.364273 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:38.364252 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9n2sx_98587b47-40b3-4bc4-a10a-cffbd9e53b3a/exporter/0.log" Jun 03 17:06:38.392552 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:38.392520 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9n2sx_98587b47-40b3-4bc4-a10a-cffbd9e53b3a/extractor/0.log" Jun 03 17:06:40.690362 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:40.690308 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-78b89f755d-466pc_9221838a-aabd-469e-bf45-2d7e3f5d62b3/nginx/0.log" Jun 03 17:06:40.836323 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:40.836294 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29675100-qp76x_e31697f8-7ffd-4e75-83f4-5321f8c3dc6a/cleanup/0.log" Jun 03 17:06:41.100329 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:41.100300 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-qrb58_7d5122f4-ed60-48b7-99bc-5c20fb785723/manager/0.log" Jun 03 17:06:41.122417 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:41.122391 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d99597487-qrb58_7d5122f4-ed60-48b7-99bc-5c20fb785723/copy-manifests/0.log" Jun 03 17:06:41.416778 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:41.416679 2577 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6jxqt/perf-node-gather-daemonset-m45rw" Jun 03 17:06:42.686531 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:42.686494 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-849d86d84c-cff9f_0dc76d96-5088-4a0d-81be-b1172dc03a17/manager/0.log" Jun 03 17:06:49.849977 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:49.849945 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xfgcj_2ca25510-f078-4fd3-a19d-6f3cca30a18f/kube-multus-additional-cni-plugins/0.log" Jun 03 17:06:49.872422 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:49.872370 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xfgcj_2ca25510-f078-4fd3-a19d-6f3cca30a18f/egress-router-binary-copy/0.log" Jun 03 17:06:49.892571 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:49.892546 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xfgcj_2ca25510-f078-4fd3-a19d-6f3cca30a18f/cni-plugins/0.log" Jun 03 17:06:49.911582 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:49.911556 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xfgcj_2ca25510-f078-4fd3-a19d-6f3cca30a18f/bond-cni-plugin/0.log" Jun 03 17:06:49.931089 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:49.931062 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xfgcj_2ca25510-f078-4fd3-a19d-6f3cca30a18f/routeoverride-cni/0.log" Jun 03 17:06:49.950849 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:49.950830 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xfgcj_2ca25510-f078-4fd3-a19d-6f3cca30a18f/whereabouts-cni-bincopy/0.log" Jun 03 17:06:49.971132 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:49.971107 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xfgcj_2ca25510-f078-4fd3-a19d-6f3cca30a18f/whereabouts-cni/0.log" Jun 03 17:06:50.000498 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:50.000465 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jc56l_e3c68bd0-e8fd-4a8b-b155-c7901fa7adbb/kube-multus/0.log" Jun 03 17:06:50.097592 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:50.097482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhtsg_f10eb032-87e3-4f19-8f07-8a414afd8725/network-metrics-daemon/0.log" Jun 03 17:06:50.118182 ip-10-0-141-18 kubenswrapper[2577]: I0603 17:06:50.118149 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhtsg_f10eb032-87e3-4f19-8f07-8a414afd8725/kube-rbac-proxy/0.log"