Jun 02 18:37:06.427753 ip-10-0-140-185 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 02 18:37:06.427766 ip-10-0-140-185 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 02 18:37:06.427775 ip-10-0-140-185 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 02 18:37:06.428077 ip-10-0-140-185 systemd[1]: Failed to start Kubernetes Kubelet. Jun 02 18:37:16.560420 ip-10-0-140-185 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 02 18:37:16.560437 ip-10-0-140-185 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b045778941514bfd9c37fa22f9b0c9ba -- Jun 02 18:39:45.073459 ip-10-0-140-185 systemd[1]: Starting Kubernetes Kubelet... Jun 02 18:39:45.493000 ip-10-0-140-185 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:45.493000 ip-10-0-140-185 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 18:39:45.493000 ip-10-0-140-185 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:45.493000 ip-10-0-140-185 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 18:39:45.493000 ip-10-0-140-185 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 18:39:45.495582 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.495500 2567 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 18:39:45.503044 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503021 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:45.503044 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503041 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:45.503044 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503046 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:45.503044 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503049 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503052 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503055 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503058 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503061 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503066 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503070 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503073 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503076 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503079 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503082 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503085 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503088 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503091 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503093 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503096 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503098 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503101 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503104 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503107 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:45.503245 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503110 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503112 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503115 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503117 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503120 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503123 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503128 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503131 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503133 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503136 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503138 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503141 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503152 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503156 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503159 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503162 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503165 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503168 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503170 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503173 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:45.503719 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503176 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503195 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503201 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503204 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503206 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503209 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503212 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503214 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503217 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503220 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503222 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503225 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503228 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503231 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503234 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503236 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503239 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503242 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503245 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:45.504229 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503247 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503250 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503254 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503257 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503260 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503263 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503266 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503270 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503273 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503276 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503278 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503281 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503283 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503286 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503288 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503290 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503294 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503297 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503300 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:45.504689 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503302 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503305 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503308 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503310 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503313 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503693 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503697 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503700 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503703 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503705 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503708 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503711 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503713 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503717 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503719 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503722 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503725 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503728 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503731 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503733 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:45.505164 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503736 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503739 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503741 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503744 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503747 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503749 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503752 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503754 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503757 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503760 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503763 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503765 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503768 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503771 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503773 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503776 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503778 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503781 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503785 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503787 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:45.505655 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503790 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503793 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503796 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503798 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503801 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503804 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503806 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503809 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503811 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503813 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503816 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503821 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503825 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503828 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503832 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503834 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503837 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503840 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503843 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503846 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:45.506190 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503849 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503851 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503855 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503858 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503861 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503864 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503866 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503869 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503872 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503875 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503877 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503880 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503882 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503885 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503887 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503890 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503893 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503896 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503899 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:45.506695 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503902 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503905 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503908 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503911 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503913 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503915 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503918 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503920 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503923 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503926 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503928 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.503931 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504669 2567 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504679 2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504686 2567 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504691 2567 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504697 2567 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504700 2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504705 2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504710 2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504713 2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 18:39:45.507165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504716 2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504719 2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504723 2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504726 2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504729 2567 flags.go:64] FLAG: --cgroup-root="" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504731 2567 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504734 2567 flags.go:64] FLAG: --client-ca-file="" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504737 2567 flags.go:64] FLAG: --cloud-config="" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504740 2567 flags.go:64] FLAG: --cloud-provider="external" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504743 2567 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504748 2567 flags.go:64] FLAG: --cluster-domain="" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504751 2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504756 2567 flags.go:64] FLAG: --config-dir="" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504759 2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504763 2567 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504767 2567 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504769 2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504772 2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504776 2567 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504779 2567 flags.go:64] FLAG: --contention-profiling="false" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504782 2567 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504785 2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504788 2567 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504791 2567 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504795 2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 18:39:45.507711 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504798 2567 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504802 2567 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504804 2567 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504808 2567 flags.go:64] FLAG: --enable-server="true" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504811 2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504815 2567 flags.go:64] FLAG: --event-burst="100" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504818 2567 flags.go:64] FLAG: --event-qps="50" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504821 2567 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504824 2567 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504826 2567 flags.go:64] FLAG: --eviction-hard="" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504830 2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504833 2567 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504836 2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504839 2567 flags.go:64] FLAG: --eviction-soft="" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504842 2567 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504845 2567 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504848 2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504851 2567 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504853 2567 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504858 2567 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504861 2567 flags.go:64] FLAG: --feature-gates="" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504865 2567 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504868 2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504871 2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504874 2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504877 2567 flags.go:64] FLAG: --healthz-port="10248" Jun 02 18:39:45.508354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504880 2567 flags.go:64] FLAG: --help="false" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504883 2567 flags.go:64] FLAG: --hostname-override="ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504886 2567 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504889 2567 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504892 2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504895 2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504899 2567 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504902 2567 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504904 2567 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504907 2567 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504911 2567 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504914 2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504917 2567 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504920 2567 flags.go:64] FLAG: --kube-reserved="" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504922 2567 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504925 2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504928 2567 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504931 2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504934 2567 flags.go:64] FLAG: --lock-file="" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504937 2567 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504940 2567 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504943 2567 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504948 2567 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 18:39:45.509034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504951 2567 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504953 2567 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504957 2567 flags.go:64] FLAG: --logging-format="text" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504960 2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504964 2567 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504967 2567 flags.go:64] FLAG: --manifest-url="" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504969 2567 flags.go:64] FLAG: --manifest-url-header="" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504973 2567 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504976 2567 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504981 2567 flags.go:64] FLAG: --max-pods="110" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504984 2567 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504987 2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504989 2567 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504992 2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504995 2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.504999 2567 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505002 2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505009 2567 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505012 2567 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505015 2567 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505019 2567 flags.go:64] FLAG: --pod-cidr="" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505022 2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505027 2567 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505030 2567 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 18:39:45.509612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505033 2567 flags.go:64] FLAG: --pods-per-core="0" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505036 2567 flags.go:64] FLAG: --port="10250" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505039 2567 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505042 2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09258403bb7ebcdfc" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505045 2567 flags.go:64] FLAG: --qos-reserved="" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505048 2567 flags.go:64] FLAG: --read-only-port="10255" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505051 2567 flags.go:64] FLAG: --register-node="true" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505054 2567 flags.go:64] FLAG: --register-schedulable="true" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505057 2567 flags.go:64] FLAG: --register-with-taints="" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505060 2567 flags.go:64] FLAG: --registry-burst="10" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505063 2567 flags.go:64] FLAG: --registry-qps="5" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505067 2567 flags.go:64] FLAG: --reserved-cpus="" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505070 2567 flags.go:64] FLAG: --reserved-memory="" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505074 2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505077 2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505080 2567 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505083 2567 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505086 2567 flags.go:64] FLAG: --runonce="false" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505089 2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505091 2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505094 2567 flags.go:64] FLAG: --seccomp-default="false" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505097 2567 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505100 2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505103 2567 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505106 2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505110 2567 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 18:39:45.510175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505112 2567 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505115 2567 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505118 2567 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505121 2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505124 2567 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505127 2567 flags.go:64] FLAG: --system-cgroups="" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505130 2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505135 2567 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505138 2567 flags.go:64] FLAG: --tls-cert-file="" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505141 2567 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505146 2567 flags.go:64] FLAG: --tls-min-version="" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505149 2567 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505152 2567 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505155 2567 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505160 2567 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505163 2567 flags.go:64] FLAG: --v="2" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505168 2567 flags.go:64] FLAG: --version="false" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505174 2567 flags.go:64] FLAG: --vmodule="" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505189 2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505193 2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505292 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505296 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505299 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505302 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:45.511029 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505305 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505308 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505311 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505313 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505316 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505318 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505321 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505324 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505326 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505329 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505331 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505334 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505337 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505339 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505342 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505344 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505347 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505350 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505352 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505354 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:45.512124 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505358 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505360 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505364 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505367 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505369 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505374 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505378 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505381 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505383 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505386 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505388 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505391 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505394 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505396 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505399 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505401 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505404 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505406 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505409 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:45.513024 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505412 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505414 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505417 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505419 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505422 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505424 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505427 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505430 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505433 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505435 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505438 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505440 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505443 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505445 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505448 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505452 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505454 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505457 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505461 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505463 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:45.513855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505466 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505468 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505471 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505474 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505476 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505479 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505481 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505484 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505487 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505491 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505494 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505497 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505499 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505502 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505505 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505507 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505510 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505512 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505515 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505519 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:45.514447 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505521 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505524 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.505526 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.505535 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.512556 2567 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.512575 2567 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512647 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512655 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512661 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512666 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512671 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512676 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512680 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512684 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512689 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512693 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:45.514994 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512697 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512701 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512706 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512710 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512714 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512719 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512723 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512727 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512731 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512736 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512740 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512746 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512752 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512757 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512762 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512766 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512770 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512774 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512778 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:45.515688 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512782 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512787 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512794 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512798 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512802 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512807 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512811 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512816 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512820 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512825 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512829 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512833 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512837 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512842 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512846 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512850 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512853 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512858 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512863 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512867 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:45.516714 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512871 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512875 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512879 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512883 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512887 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512891 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512895 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512899 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512903 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512907 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512911 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512916 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512919 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512924 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512929 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512934 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512938 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512942 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512946 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512950 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:45.517334 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512955 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512959 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512965 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512971 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512976 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512980 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512985 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512990 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512994 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.512998 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513002 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513007 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513011 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513015 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513019 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513023 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:45.517981 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513026 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.513034 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513235 2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513245 2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513250 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513255 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513259 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513264 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513268 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513273 2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513279 2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513283 2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513288 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513293 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 18:39:45.518401 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513297 2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513304 2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513309 2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513314 2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513319 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513323 2567 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513327 2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513331 2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513335 2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513340 2567 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513344 2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513348 2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513352 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513357 2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513361 2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513366 2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513370 2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513374 2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513378 2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 18:39:45.518819 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513383 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513387 2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513392 2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513396 2567 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513400 2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513404 2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513409 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513413 2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513417 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513422 2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513426 2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513430 2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513436 2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513440 2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513445 2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513449 2567 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513453 2567 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513457 2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513461 2567 feature_gate.go:328] unrecognized feature gate: Example Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513465 2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 18:39:45.519316 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513469 2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513475 2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513482 2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513486 2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513491 2567 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513495 2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513499 2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513502 2567 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513506 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513511 2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513515 2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513519 2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513523 2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513528 2567 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513532 2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513536 2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513540 2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513544 2567 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513548 2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513552 2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 18:39:45.519850 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513556 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513560 2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513565 2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513569 2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513574 2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513579 2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513583 2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513587 2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513591 2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513595 2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513599 2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513603 2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513608 2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513612 2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:45.513616 2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 18:39:45.520459 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.513624 2567 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 18:39:45.520862 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.514323 2567 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 18:39:45.520862 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.517492 2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 18:39:45.520862 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.518594 2567 server.go:1019] "Starting client certificate rotation" Jun 02 18:39:45.520862 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.518694 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 18:39:45.520862 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.518733 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 18:39:45.543509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.543487 2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 18:39:45.545485 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.545466 2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 18:39:45.560247 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.560226 2567 log.go:25] "Validated CRI v1 runtime API" Jun 02 18:39:45.566237 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.566217 2567 log.go:25] "Validated CRI v1 image API" Jun 02 18:39:45.567870 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.567853 2567 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 18:39:45.571363 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.571331 2567 fs.go:135] Filesystem UUIDs: map[2f64dec0-a951-4829-8eb4-75dc6073bd81:/dev/nvme0n1p4 539297ae-be95-41fc-9f83-ae06c8525131:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 02 18:39:45.571363 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.571362 2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 18:39:45.573429 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.573410 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 18:39:45.575694 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.575593 2567 manager.go:217] Machine: {Timestamp:2026-06-02 18:39:45.575057791 +0000 UTC m=+0.387520594 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100385 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2be972c70dcab91358bc0c23840cde SystemUUID:ec2be972-c70d-cab9-1358-bc0c23840cde BootID:b0457789-4151-4bfd-9c37-fa22f9b0c9ba Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a2:a8:94:2b:df Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a2:a8:94:2b:df Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:26:51:11:d6:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 18:39:45.576451 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.576440 2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 18:39:45.576531 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.576520 2567 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 18:39:45.579636 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.579612 2567 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 18:39:45.579768 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.579638 2567 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-185.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 18:39:45.579817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.579778 2567 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 18:39:45.579817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.579787 2567 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 18:39:45.579817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.579795 2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 18:39:45.581295 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.581285 2567 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 18:39:45.582706 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.582696 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 18:39:45.582810 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.582801 2567 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 18:39:45.585326 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.585317 2567 kubelet.go:491] "Attempting to sync node with API server" Jun 02 18:39:45.585360 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.585330 2567 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 18:39:45.585360 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.585342 2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 18:39:45.585360 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.585351 2567 kubelet.go:397] "Adding apiserver pod source" Jun 02 18:39:45.585360 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.585360 2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 18:39:45.586531 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.586517 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 18:39:45.586595 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.586537 2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 18:39:45.589646 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.589631 2567 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 18:39:45.591779 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.591765 2567 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 18:39:45.594260 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594245 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594267 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594277 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594283 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594292 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594300 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594306 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594312 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594318 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594324 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 18:39:45.594334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594337 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 18:39:45.594593 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.594343 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 18:39:45.595234 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.595223 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 18:39:45.595234 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.595234 2567 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 18:39:45.599073 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.599059 2567 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 18:39:45.599171 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.599102 2567 server.go:1295] "Started kubelet" Jun 02 18:39:45.599245 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.599165 2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 18:39:45.599953 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.599212 2567 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 18:39:45.600038 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.599982 2567 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 18:39:45.600415 ip-10-0-140-185 systemd[1]: Started Kubernetes Kubelet. Jun 02 18:39:45.600530 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.600488 2567 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-185.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 18:39:45.600721 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.600694 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-185.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 18:39:45.600988 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.600938 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 18:39:45.602843 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.602822 2567 server.go:317] "Adding debug handlers to kubelet server" Jun 02 18:39:45.605108 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.605090 2567 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 18:39:45.608540 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.607635 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-185.ec2.internal.18b557a312a64a77 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-185.ec2.internal,UID:ip-10-0-140-185.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-185.ec2.internal,},FirstTimestamp:2026-06-02 18:39:45.599072887 +0000 UTC m=+0.411535692,LastTimestamp:2026-06-02 18:39:45.599072887 +0000 UTC m=+0.411535692,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-185.ec2.internal,}" Jun 02 18:39:45.609055 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609038 2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 18:39:45.609055 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609050 2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 18:39:45.609167 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609118 2567 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 18:39:45.609167 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609125 2567 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 18:39:45.609248 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609238 2567 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 18:39:45.609313 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609300 2567 reconstruct.go:97] "Volume reconstruction finished" Jun 02 18:39:45.609313 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609312 2567 reconciler.go:26] "Reconciler: start to sync state" Jun 02 18:39:45.609931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609782 2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 18:39:45.609931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609798 2567 factory.go:55] Registering systemd factory Jun 02 18:39:45.609931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.609808 2567 factory.go:223] Registration of the systemd container factory successfully Jun 02 18:39:45.609931 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.609852 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:45.610142 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.610124 2567 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 18:39:45.610217 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.610202 2567 factory.go:153] Registering CRI-O factory Jun 02 18:39:45.610217 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.610216 2567 factory.go:223] Registration of the crio container factory successfully Jun 02 18:39:45.610361 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.610232 2567 factory.go:103] Registering Raw factory Jun 02 18:39:45.610361 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.610240 2567 manager.go:1196] Started watching for new ooms in manager Jun 02 18:39:45.611154 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.611136 2567 manager.go:319] Starting recovery of all containers Jun 02 18:39:45.616983 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.616861 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 18:39:45.619919 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.619901 2567 manager.go:324] Recovery completed Jun 02 18:39:45.620528 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.620499 2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-185.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 18:39:45.620643 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.620615 2567 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 18:39:45.623701 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.623682 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m8wvs" Jun 02 18:39:45.624646 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.624634 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:45.626741 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.626680 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:45.626741 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.626702 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:45.626741 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.626713 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:45.627229 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.627214 2567 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 18:39:45.627229 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.627225 2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 18:39:45.627346 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.627240 2567 state_mem.go:36] "Initialized new in-memory state store" Jun 02 18:39:45.628534 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.628471 2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-185.ec2.internal.18b557a3144bc0ee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-185.ec2.internal,UID:ip-10-0-140-185.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-185.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-185.ec2.internal,},FirstTimestamp:2026-06-02 18:39:45.62669387 +0000 UTC m=+0.439156675,LastTimestamp:2026-06-02 18:39:45.62669387 +0000 UTC m=+0.439156675,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-185.ec2.internal,}" Jun 02 18:39:45.629349 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.629336 2567 policy_none.go:49] "None policy: Start" Jun 02 18:39:45.629400 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.629353 2567 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 18:39:45.629400 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.629363 2567 state_mem.go:35] "Initializing new in-memory state store" Jun 02 18:39:45.631357 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.631339 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m8wvs" Jun 02 18:39:45.673745 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.673729 2567 manager.go:341] "Starting Device Plugin manager" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.673758 2567 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.673769 2567 server.go:85] "Starting device plugin registration server" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.673997 2567 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.674008 2567 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.674116 2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.674215 2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.674222 2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.674780 2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 18:39:45.684731 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.674835 2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:45.705921 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.705901 2567 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 18:39:45.706001 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.705927 2567 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 18:39:45.706001 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.705942 2567 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 18:39:45.706001 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.705949 2567 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 18:39:45.706001 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.705979 2567 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 18:39:45.708627 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.708610 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:45.774532 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.774476 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:45.775498 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.775484 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:45.775564 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.775511 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:45.775564 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.775522 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:45.775564 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.775544 2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.781750 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.781736 2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.781802 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.781755 2567 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-185.ec2.internal\": node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:45.801599 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.801582 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:45.806626 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.806604 2567 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal"] Jun 02 18:39:45.806716 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.806663 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:45.808475 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.808463 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:45.808535 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.808487 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:45.808535 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.808496 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:45.809590 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.809578 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:45.809786 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.809754 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.809786 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.809782 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:45.810225 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.810211 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:45.810321 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.810230 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:45.810321 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.810239 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:45.810321 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.810251 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:45.810321 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.810274 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:45.810321 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.810288 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:45.811505 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.811489 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.811582 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.811520 2567 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 18:39:45.812131 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.812118 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientMemory" Jun 02 18:39:45.812209 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.812140 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 18:39:45.812209 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.812154 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeHasSufficientPID" Jun 02 18:39:45.827727 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.827710 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-185.ec2.internal\" not found" node="ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.830853 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.830839 2567 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-185.ec2.internal\" not found" node="ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.902065 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:45.902037 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:45.910280 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.910260 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5aeaf278a0e5b76b237c975d46dc71d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-185.ec2.internal\" (UID: \"5aeaf278a0e5b76b237c975d46dc71d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.910341 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.910286 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec075e2df0600a3a46f0e48af57f0d12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"ec075e2df0600a3a46f0e48af57f0d12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:45.910341 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:45.910305 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec075e2df0600a3a46f0e48af57f0d12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"ec075e2df0600a3a46f0e48af57f0d12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.002408 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.002376 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:46.010664 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.010641 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5aeaf278a0e5b76b237c975d46dc71d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-185.ec2.internal\" (UID: \"5aeaf278a0e5b76b237c975d46dc71d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.010730 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.010675 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec075e2df0600a3a46f0e48af57f0d12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"ec075e2df0600a3a46f0e48af57f0d12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.010730 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.010693 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec075e2df0600a3a46f0e48af57f0d12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"ec075e2df0600a3a46f0e48af57f0d12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.010807 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.010744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec075e2df0600a3a46f0e48af57f0d12-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"ec075e2df0600a3a46f0e48af57f0d12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.010807 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.010763 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ec075e2df0600a3a46f0e48af57f0d12-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal\" (UID: \"ec075e2df0600a3a46f0e48af57f0d12\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.010807 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.010744 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5aeaf278a0e5b76b237c975d46dc71d9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-185.ec2.internal\" (UID: \"5aeaf278a0e5b76b237c975d46dc71d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.103056 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.103035 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:46.129449 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.129430 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.133957 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.133941 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.203458 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.203417 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:46.303934 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.303899 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:46.404438 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.404369 2567 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-185.ec2.internal\" not found" Jun 02 18:39:46.421761 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.421740 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:46.479557 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.479535 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:46.510274 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.510251 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.517845 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.517826 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 18:39:46.518764 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.518290 2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 18:39:46.518764 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.518418 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:46.518764 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.518457 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:46.518764 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.518487 2567 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 18:39:46.521040 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.521022 2567 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" Jun 02 18:39:46.542639 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.542265 2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 18:39:46.552507 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.552487 2567 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:46.585848 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.585829 2567 apiserver.go:52] "Watching apiserver" Jun 02 18:39:46.592969 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.592949 2567 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 18:39:46.596084 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.594597 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-hbpbt","openshift-cluster-node-tuning-operator/tuned-ktk84","openshift-dns/node-resolver-wpp2r","openshift-multus/multus-additional-cni-plugins-jkqnl","openshift-multus/multus-vnnpk","openshift-multus/network-metrics-daemon-tbm7r","openshift-network-diagnostics/network-check-target-h75lh","openshift-network-operator/iptables-alerter-bjqbt","kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq","openshift-image-registry/node-ca-hqr7x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-86wdb"] Jun 02 18:39:46.596723 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.596703 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.598348 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.598325 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.599894 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.599878 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.601125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.601107 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.602277 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.602261 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.602534 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.602514 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:39:46.602628 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.602616 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 18:39:46.603106 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603084 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 18:39:46.603161 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603084 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 18:39:46.603323 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603305 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-phwbv\"" Jun 02 18:39:46.603386 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603316 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 18:39:46.603386 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603372 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 18:39:46.603475 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603393 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 18:39:46.603475 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603378 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 18:39:46.603475 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603432 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cs5xf\"" Jun 02 18:39:46.603617 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603491 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 18:39:46.603617 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603513 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 18:39:46.603810 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.603795 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:46.603865 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.603853 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:39:46.605043 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.605026 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.606361 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.606344 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:46.606451 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.606414 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:39:46.607621 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.607603 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.608489 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.608472 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 18:39:46.609205 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.608892 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.609205 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609054 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-b5jjj\"" Jun 02 18:39:46.609205 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609147 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 18:39:46.609205 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609163 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 18:39:46.609205 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609198 2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 18:39:46.609508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609222 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 18:39:46.609508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609163 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 18:39:46.609508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609278 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m28xb\"" Jun 02 18:39:46.609508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609341 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-frbnd\"" Jun 02 18:39:46.609508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609388 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 18:39:46.609508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609343 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 18:39:46.609508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609482 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 18:39:46.609801 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609557 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rkz6\"" Jun 02 18:39:46.609801 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609627 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 18:39:46.609801 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609720 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 18:39:46.609801 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.609173 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 18:39:46.610304 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.610290 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 18:39:46.610567 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.610549 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.610841 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.610824 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-84vkv\"" Jun 02 18:39:46.610980 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.610963 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 18:39:46.611023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.610983 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 18:39:46.611730 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.611716 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d4cdr\"" Jun 02 18:39:46.613234 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613218 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 18:39:46.613347 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613316 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9l96b\"" Jun 02 18:39:46.613489 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613473 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgn2d\" (UniqueName: \"kubernetes.io/projected/52f2e98a-b555-4a0b-af02-01d34a9b0d23-kube-api-access-sgn2d\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.613557 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613505 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-socket-dir-parent\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.613613 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613560 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-etc-kubernetes\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.613613 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613587 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-run\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.613705 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613613 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-host\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.613705 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613637 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/154022e6-248f-4861-b053-a9994a9e9a30-hosts-file\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.613705 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613661 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-sys-fs\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.613810 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.613699 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj2wp\" (UniqueName: \"kubernetes.io/projected/e568234e-886d-43ff-bd5b-49182e59d2e9-kube-api-access-zj2wp\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.614049 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614017 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-log-socket\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.614104 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614090 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-ovnkube-config\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.614150 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614140 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-os-release\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.614223 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614200 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27555d26-14a0-4551-b300-38ab47ce8ebc-konnectivity-ca\") pod \"konnectivity-agent-hbpbt\" (UID: \"27555d26-14a0-4551-b300-38ab47ce8ebc\") " pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.614291 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-device-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.614604 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614579 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-hostroot\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.614707 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614620 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-conf-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.614761 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysctl-conf\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.614817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614757 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-systemd\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.614817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614790 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:39:46.614817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-var-lib-kubelet\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.614817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614811 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 18:39:46.614995 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.614906 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-run-netns\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.615048 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615023 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-cni-netd\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.615101 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzpn\" (UniqueName: \"kubernetes.io/projected/e9286a64-8422-458b-9bcb-95aa44f00567-kube-api-access-vvzpn\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.615154 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-k8s-cni-cncf-io\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.615154 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615134 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnrc9\" (UniqueName: \"kubernetes.io/projected/5e04a94e-1507-48de-be8a-939b4a8d0ce7-kube-api-access-gnrc9\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.615276 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615154 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysconfig\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.615276 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615258 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-slash\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.615372 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615302 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wqgm\" (UniqueName: \"kubernetes.io/projected/a8ce9161-c49b-4a7c-af89-1294da53da1d-kube-api-access-5wqgm\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:46.615372 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615337 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-netns\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.615460 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615368 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-cni-bin\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.615460 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615424 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-tmp\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.615550 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615482 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-systemd\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.615550 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615533 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/154022e6-248f-4861-b053-a9994a9e9a30-tmp-dir\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.615642 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615596 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sjgw\" (UniqueName: \"kubernetes.io/projected/154022e6-248f-4861-b053-a9994a9e9a30-kube-api-access-8sjgw\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.615719 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615701 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-host-slash\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.615772 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615758 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-cnibin\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.615822 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-os-release\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.615873 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-registration-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.615918 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615890 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-kubernetes\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.615966 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-tuned\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.616019 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9286a64-8422-458b-9bcb-95aa44f00567-ovn-node-metrics-cert\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.616019 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.615996 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27555d26-14a0-4551-b300-38ab47ce8ebc-agent-certs\") pod \"konnectivity-agent-hbpbt\" (UID: \"27555d26-14a0-4551-b300-38ab47ce8ebc\") " pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.616108 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cnibin\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.616108 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616074 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.616221 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616125 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-multus-certs\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.616221 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616150 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysctl-d\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616369 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-kubelet\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616421 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-var-lib-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616452 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-ovn\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-system-cni-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-lib-modules\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616582 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj668\" (UniqueName: \"kubernetes.io/projected/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-kube-api-access-nj668\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616627 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-systemd-units\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616652 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-node-log\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616734 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616773 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-ovnkube-script-lib\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616800 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrf2m\" (UniqueName: \"kubernetes.io/projected/a5892822-06c6-452e-ad71-7aba446f1618-kube-api-access-zrf2m\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616833 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-socket-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616899 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5892822-06c6-452e-ad71-7aba446f1618-host\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616938 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-system-cni-dir\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.617168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.616993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-sys\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617025 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-env-overrides\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617054 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-kubelet\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617165 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-modprobe-d\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617233 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-iptables-alerter-script\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-etc-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617304 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617372 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-cni-multus\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617412 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e04a94e-1507-48de-be8a-939b4a8d0ce7-cni-binary-copy\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617456 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-cni-bin\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617485 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617515 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617548 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617666 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.617879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617775 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-daemon-config\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.618450 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617808 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdzvv\" (UniqueName: \"kubernetes.io/projected/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-kube-api-access-pdzvv\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.618450 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.617953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-run-ovn-kubernetes\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.618450 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.618007 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-cni-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.618450 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.618066 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5892822-06c6-452e-ad71-7aba446f1618-serviceca\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.625786 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.625766 2567 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 18:39:46.633929 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.633899 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 18:34:45 +0000 UTC" deadline="2028-01-22 23:03:33.841828188 +0000 UTC" Jun 02 18:39:46.633929 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.633927 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14380h23m47.207903213s" Jun 02 18:39:46.638785 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.638753 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aeaf278a0e5b76b237c975d46dc71d9.slice/crio-51c8f1dde70002b3cf06882b44232a07a68a37fe825255ab1a3a3b0424dc6a77 WatchSource:0}: Error finding container 51c8f1dde70002b3cf06882b44232a07a68a37fe825255ab1a3a3b0424dc6a77: Status 404 returned error can't find the container with id 51c8f1dde70002b3cf06882b44232a07a68a37fe825255ab1a3a3b0424dc6a77 Jun 02 18:39:46.638980 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.638957 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec075e2df0600a3a46f0e48af57f0d12.slice/crio-0757258a9243a476bcfa32688a8b443da451a4484c88bdaa73cf8a7f900dc064 WatchSource:0}: Error finding container 0757258a9243a476bcfa32688a8b443da451a4484c88bdaa73cf8a7f900dc064: Status 404 returned error can't find the container with id 0757258a9243a476bcfa32688a8b443da451a4484c88bdaa73cf8a7f900dc064 Jun 02 18:39:46.642060 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.642046 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:39:46.647804 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.647789 2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bqnzj" Jun 02 18:39:46.655161 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.655145 2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bqnzj" Jun 02 18:39:46.709299 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.709255 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" event={"ID":"ec075e2df0600a3a46f0e48af57f0d12","Type":"ContainerStarted","Data":"0757258a9243a476bcfa32688a8b443da451a4484c88bdaa73cf8a7f900dc064"} Jun 02 18:39:46.709858 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.709834 2567 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 18:39:46.710222 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.710200 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" event={"ID":"5aeaf278a0e5b76b237c975d46dc71d9","Type":"ContainerStarted","Data":"51c8f1dde70002b3cf06882b44232a07a68a37fe825255ab1a3a3b0424dc6a77"} Jun 02 18:39:46.718219 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718200 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-system-cni-dir\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.718269 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718224 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.718269 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718240 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-sys\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.718328 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718287 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-system-cni-dir\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.718364 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718330 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-env-overrides\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.718364 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718352 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.718437 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718367 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-kubelet\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.718437 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718409 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-modprobe-d\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.718524 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718461 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-sys\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.718524 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718477 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.718524 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718476 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-kubelet\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.718524 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718504 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-iptables-alerter-script\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.718524 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718512 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-modprobe-d\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718570 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-etc-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718599 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-etc-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718626 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718660 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718664 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-cni-multus\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718691 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e04a94e-1507-48de-be8a-939b4a8d0ce7-cni-binary-copy\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.718709 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718715 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-cni-bin\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.718756 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718742 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.718788 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:39:47.218748575 +0000 UTC m=+2.031211366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718819 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718846 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-env-overrides\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718850 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718880 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718907 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-daemon-config\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718708 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cni-binary-copy\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719095 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.719252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719219 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-cni-multus\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719296 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-cni-bin\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719322 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.718944 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdzvv\" (UniqueName: \"kubernetes.io/projected/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-kube-api-access-pdzvv\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719489 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-run-ovn-kubernetes\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719520 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-cni-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719545 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5892822-06c6-452e-ad71-7aba446f1618-serviceca\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719563 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719573 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-iptables-alerter-script\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719592 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-run-ovn-kubernetes\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719574 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgn2d\" (UniqueName: \"kubernetes.io/projected/52f2e98a-b555-4a0b-af02-01d34a9b0d23-kube-api-access-sgn2d\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-cni-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.719681 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719620 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-daemon-config\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719630 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-socket-dir-parent\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719907 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-socket-dir-parent\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719921 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-etc-kubernetes\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719956 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-run\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.719984 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-host\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720018 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/154022e6-248f-4861-b053-a9994a9e9a30-hosts-file\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720039 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-etc-kubernetes\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720049 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-sys-fs\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.720125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720125 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-run\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720145 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zj2wp\" (UniqueName: \"kubernetes.io/projected/e568234e-886d-43ff-bd5b-49182e59d2e9-kube-api-access-zj2wp\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720155 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e04a94e-1507-48de-be8a-939b4a8d0ce7-cni-binary-copy\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720200 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-host\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720200 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-log-socket\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720245 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-ovnkube-config\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-sys-fs\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720280 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-os-release\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720246 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-log-socket\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720314 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27555d26-14a0-4551-b300-38ab47ce8ebc-konnectivity-ca\") pod \"konnectivity-agent-hbpbt\" (UID: \"27555d26-14a0-4551-b300-38ab47ce8ebc\") " pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720327 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/154022e6-248f-4861-b053-a9994a9e9a30-hosts-file\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720345 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-device-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720371 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-hostroot\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720369 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a5892822-06c6-452e-ad71-7aba446f1618-serviceca\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720391 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-os-release\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720426 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-device-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720444 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-hostroot\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720465 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-conf-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.720509 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720501 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysctl-conf\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.721308 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720533 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-systemd\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.721308 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720565 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-var-lib-kubelet\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.721420 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720588 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-multus-conf-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.721471 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720596 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-run-netns\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.721518 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721503 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-cni-netd\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.721566 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721532 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzpn\" (UniqueName: \"kubernetes.io/projected/e9286a64-8422-458b-9bcb-95aa44f00567-kube-api-access-vvzpn\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.721621 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721563 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-k8s-cni-cncf-io\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.721621 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721594 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gnrc9\" (UniqueName: \"kubernetes.io/projected/5e04a94e-1507-48de-be8a-939b4a8d0ce7-kube-api-access-gnrc9\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.721709 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721625 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysconfig\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.721709 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721654 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-slash\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.721709 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721688 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5wqgm\" (UniqueName: \"kubernetes.io/projected/a8ce9161-c49b-4a7c-af89-1294da53da1d-kube-api-access-5wqgm\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:46.721836 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721713 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-netns\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.721836 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721744 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-cni-bin\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.721836 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721774 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-tmp\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.721836 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721805 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-systemd\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721839 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/154022e6-248f-4861-b053-a9994a9e9a30-tmp-dir\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.722023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721867 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8sjgw\" (UniqueName: \"kubernetes.io/projected/154022e6-248f-4861-b053-a9994a9e9a30-kube-api-access-8sjgw\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.722023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721900 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-host-slash\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.722023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721932 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-cnibin\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.722023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721962 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-os-release\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.722023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.721992 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-registration-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.722023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722019 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-kubernetes\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722047 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-tuned\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722077 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9286a64-8422-458b-9bcb-95aa44f00567-ovn-node-metrics-cert\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722117 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27555d26-14a0-4551-b300-38ab47ce8ebc-agent-certs\") pod \"konnectivity-agent-hbpbt\" (UID: \"27555d26-14a0-4551-b300-38ab47ce8ebc\") " pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722146 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cnibin\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722172 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722230 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-multus-certs\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722255 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysctl-d\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722285 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-kubelet\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722315 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-var-lib-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722347 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-ovn\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722377 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-system-cni-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722405 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-lib-modules\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722431 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nj668\" (UniqueName: \"kubernetes.io/projected/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-kube-api-access-nj668\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722461 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-systemd-units\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722495 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-node-log\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722527 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722558 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-ovnkube-script-lib\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722585 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrf2m\" (UniqueName: \"kubernetes.io/projected/a5892822-06c6-452e-ad71-7aba446f1618-kube-api-access-zrf2m\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722617 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-socket-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722646 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5892822-06c6-452e-ad71-7aba446f1618-host\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720641 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-run-netns\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720900 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/27555d26-14a0-4551-b300-38ab47ce8ebc-konnectivity-ca\") pod \"konnectivity-agent-hbpbt\" (UID: \"27555d26-14a0-4551-b300-38ab47ce8ebc\") " pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722704 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-var-lib-openvswitch\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720644 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysctl-conf\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720665 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-systemd\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.722770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720691 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-var-lib-kubelet\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722801 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-systemd\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722806 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-kubernetes\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.720795 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-ovnkube-config\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722863 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-netns\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.722712 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-cni-netd\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723010 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-registration-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723014 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-os-release\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723047 2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723061 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-kubelet\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723112 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/154022e6-248f-4861-b053-a9994a9e9a30-tmp-dir\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723114 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-host-slash\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723159 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a5892822-06c6-452e-ad71-7aba446f1618-host\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723163 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysctl-d\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723208 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-cnibin\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723243 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-systemd-units\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723261 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-lib-modules\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.723522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723045 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-run-ovn\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723338 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-multus-certs\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723515 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-run-k8s-cni-cncf-io\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723552 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-sysconfig\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723618 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-host-slash\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723774 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e9286a64-8422-458b-9bcb-95aa44f00567-ovnkube-script-lib\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723830 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-host-var-lib-cni-bin\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723853 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cnibin\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723862 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e9286a64-8422-458b-9bcb-95aa44f00567-node-log\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.723937 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e568234e-886d-43ff-bd5b-49182e59d2e9-socket-dir\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.724284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.724038 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e04a94e-1507-48de-be8a-939b4a8d0ce7-system-cni-dir\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.724618 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.724396 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52f2e98a-b555-4a0b-af02-01d34a9b0d23-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.726261 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.726238 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-tmp\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.726348 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.726272 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-etc-tuned\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.726348 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.726303 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e9286a64-8422-458b-9bcb-95aa44f00567-ovn-node-metrics-cert\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.726525 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.726504 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/27555d26-14a0-4551-b300-38ab47ce8ebc-agent-certs\") pod \"konnectivity-agent-hbpbt\" (UID: \"27555d26-14a0-4551-b300-38ab47ce8ebc\") " pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.728913 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.728898 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:46.728956 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.728916 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:46.728956 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.728925 2567 projected.go:194] Error preparing data for projected volume kube-api-access-rwd8v for pod openshift-network-diagnostics/network-check-target-h75lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:46.729018 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:46.728976 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v podName:743f6854-f098-4c5d-9fab-40fc05cb3b6e nodeName:}" failed. No retries permitted until 2026-06-02 18:39:47.2289642 +0000 UTC m=+2.041426990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rwd8v" (UniqueName: "kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v") pod "network-check-target-h75lh" (UID: "743f6854-f098-4c5d-9fab-40fc05cb3b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:46.731855 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.731835 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdzvv\" (UniqueName: \"kubernetes.io/projected/f9ac9bd7-6742-408f-9d21-f81f9f384bfa-kube-api-access-pdzvv\") pod \"iptables-alerter-bjqbt\" (UID: \"f9ac9bd7-6742-408f-9d21-f81f9f384bfa\") " pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.732125 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.732102 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgn2d\" (UniqueName: \"kubernetes.io/projected/52f2e98a-b555-4a0b-af02-01d34a9b0d23-kube-api-access-sgn2d\") pod \"multus-additional-cni-plugins-jkqnl\" (UID: \"52f2e98a-b555-4a0b-af02-01d34a9b0d23\") " pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.732951 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.732920 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj2wp\" (UniqueName: \"kubernetes.io/projected/e568234e-886d-43ff-bd5b-49182e59d2e9-kube-api-access-zj2wp\") pod \"aws-ebs-csi-driver-node-vtlfq\" (UID: \"e568234e-886d-43ff-bd5b-49182e59d2e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.733877 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.733847 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzpn\" (UniqueName: \"kubernetes.io/projected/e9286a64-8422-458b-9bcb-95aa44f00567-kube-api-access-vvzpn\") pod \"ovnkube-node-86wdb\" (UID: \"e9286a64-8422-458b-9bcb-95aa44f00567\") " pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.734120 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.734101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sjgw\" (UniqueName: \"kubernetes.io/projected/154022e6-248f-4861-b053-a9994a9e9a30-kube-api-access-8sjgw\") pod \"node-resolver-wpp2r\" (UID: \"154022e6-248f-4861-b053-a9994a9e9a30\") " pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.734263 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.734247 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnrc9\" (UniqueName: \"kubernetes.io/projected/5e04a94e-1507-48de-be8a-939b4a8d0ce7-kube-api-access-gnrc9\") pod \"multus-vnnpk\" (UID: \"5e04a94e-1507-48de-be8a-939b4a8d0ce7\") " pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.734526 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.734502 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrf2m\" (UniqueName: \"kubernetes.io/projected/a5892822-06c6-452e-ad71-7aba446f1618-kube-api-access-zrf2m\") pod \"node-ca-hqr7x\" (UID: \"a5892822-06c6-452e-ad71-7aba446f1618\") " pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.734606 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.734595 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj668\" (UniqueName: \"kubernetes.io/projected/f35e9bc5-2a57-4a43-bd24-b84ce519a48a-kube-api-access-nj668\") pod \"tuned-ktk84\" (UID: \"f35e9bc5-2a57-4a43-bd24-b84ce519a48a\") " pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.734709 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.734693 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wqgm\" (UniqueName: \"kubernetes.io/projected/a8ce9161-c49b-4a7c-af89-1294da53da1d-kube-api-access-5wqgm\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:46.917418 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.917339 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bjqbt" Jun 02 18:39:46.923610 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.923585 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:39:46.923855 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.923831 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ac9bd7_6742_408f_9d21_f81f9f384bfa.slice/crio-dc30729e778d1ff4bb6cfa9de10989dea1ddae04be3f1e8191547d7b20731cba WatchSource:0}: Error finding container dc30729e778d1ff4bb6cfa9de10989dea1ddae04be3f1e8191547d7b20731cba: Status 404 returned error can't find the container with id dc30729e778d1ff4bb6cfa9de10989dea1ddae04be3f1e8191547d7b20731cba Jun 02 18:39:46.929445 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.929422 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9286a64_8422_458b_9bcb_95aa44f00567.slice/crio-1001883abdb7ac166d8311f2b740214a9b38d816c4fe5a34edca589453310593 WatchSource:0}: Error finding container 1001883abdb7ac166d8311f2b740214a9b38d816c4fe5a34edca589453310593: Status 404 returned error can't find the container with id 1001883abdb7ac166d8311f2b740214a9b38d816c4fe5a34edca589453310593 Jun 02 18:39:46.941066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.941049 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wpp2r" Jun 02 18:39:46.946362 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.946342 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" Jun 02 18:39:46.946629 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.946604 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod154022e6_248f_4861_b053_a9994a9e9a30.slice/crio-434347008ea6e2d790d8e80c12ac7cc561a8fc5e04f8c1a506399eb0567caf47 WatchSource:0}: Error finding container 434347008ea6e2d790d8e80c12ac7cc561a8fc5e04f8c1a506399eb0567caf47: Status 404 returned error can't find the container with id 434347008ea6e2d790d8e80c12ac7cc561a8fc5e04f8c1a506399eb0567caf47 Jun 02 18:39:46.951496 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.951466 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f2e98a_b555_4a0b_af02_01d34a9b0d23.slice/crio-a98009fbc6acbc14af1fe633f02e54d5a6320e5bbf227901d182a46115352c3d WatchSource:0}: Error finding container a98009fbc6acbc14af1fe633f02e54d5a6320e5bbf227901d182a46115352c3d: Status 404 returned error can't find the container with id a98009fbc6acbc14af1fe633f02e54d5a6320e5bbf227901d182a46115352c3d Jun 02 18:39:46.952041 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.952027 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hqr7x" Jun 02 18:39:46.957980 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.957963 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:39:46.959407 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.959390 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5892822_06c6_452e_ad71_7aba446f1618.slice/crio-403b1ad52c7612386fce4caa8e2f3b069e2b697f724b8475971fb499ad3ec2f3 WatchSource:0}: Error finding container 403b1ad52c7612386fce4caa8e2f3b069e2b697f724b8475971fb499ad3ec2f3: Status 404 returned error can't find the container with id 403b1ad52c7612386fce4caa8e2f3b069e2b697f724b8475971fb499ad3ec2f3 Jun 02 18:39:46.963683 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.963648 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" Jun 02 18:39:46.964547 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.964528 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27555d26_14a0_4551_b300_38ab47ce8ebc.slice/crio-257c510e85c498a55e995ca2a1daa416423827bbbcd82f61ef15e51ffe08b1c1 WatchSource:0}: Error finding container 257c510e85c498a55e995ca2a1daa416423827bbbcd82f61ef15e51ffe08b1c1: Status 404 returned error can't find the container with id 257c510e85c498a55e995ca2a1daa416423827bbbcd82f61ef15e51ffe08b1c1 Jun 02 18:39:46.968704 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.968583 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vnnpk" Jun 02 18:39:46.970382 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.970356 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode568234e_886d_43ff_bd5b_49182e59d2e9.slice/crio-8fcd342f3c34939ae45b20d8b1ae0a2ddd9c1c041b83673b97c9bcda37d8104f WatchSource:0}: Error finding container 8fcd342f3c34939ae45b20d8b1ae0a2ddd9c1c041b83673b97c9bcda37d8104f: Status 404 returned error can't find the container with id 8fcd342f3c34939ae45b20d8b1ae0a2ddd9c1c041b83673b97c9bcda37d8104f Jun 02 18:39:46.973352 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:46.973282 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ktk84" Jun 02 18:39:46.974662 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.974641 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e04a94e_1507_48de_be8a_939b4a8d0ce7.slice/crio-4f1b83739719758f4f2dab7d9c8d08a26744677d98001139ddecb7563cc867c3 WatchSource:0}: Error finding container 4f1b83739719758f4f2dab7d9c8d08a26744677d98001139ddecb7563cc867c3: Status 404 returned error can't find the container with id 4f1b83739719758f4f2dab7d9c8d08a26744677d98001139ddecb7563cc867c3 Jun 02 18:39:46.978968 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:39:46.978949 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf35e9bc5_2a57_4a43_bd24_b84ce519a48a.slice/crio-243ccf37e81d5519d185651ab34fde680425a4c9f1677b98f44df24883eb73aa WatchSource:0}: Error finding container 243ccf37e81d5519d185651ab34fde680425a4c9f1677b98f44df24883eb73aa: Status 404 returned error can't find the container with id 243ccf37e81d5519d185651ab34fde680425a4c9f1677b98f44df24883eb73aa Jun 02 18:39:47.225898 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.225811 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:47.226037 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:47.225969 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:47.226089 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:47.226041 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:39:48.226023124 +0000 UTC m=+3.038485919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:47.326319 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.326286 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:47.326485 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:47.326435 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:47.326485 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:47.326452 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:47.326485 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:47.326468 2567 projected.go:194] Error preparing data for projected volume kube-api-access-rwd8v for pod openshift-network-diagnostics/network-check-target-h75lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:47.326653 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:47.326519 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v podName:743f6854-f098-4c5d-9fab-40fc05cb3b6e nodeName:}" failed. No retries permitted until 2026-06-02 18:39:48.32650177 +0000 UTC m=+3.138964562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwd8v" (UniqueName: "kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v") pod "network-check-target-h75lh" (UID: "743f6854-f098-4c5d-9fab-40fc05cb3b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:47.362745 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.362717 2567 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:47.655923 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.655884 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:34:46 +0000 UTC" deadline="2028-02-22 11:03:56.320984362 +0000 UTC" Jun 02 18:39:47.655923 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.655920 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15112h24m8.665068019s" Jun 02 18:39:47.726455 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.726322 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerStarted","Data":"a98009fbc6acbc14af1fe633f02e54d5a6320e5bbf227901d182a46115352c3d"} Jun 02 18:39:47.733888 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.733723 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"1001883abdb7ac166d8311f2b740214a9b38d816c4fe5a34edca589453310593"} Jun 02 18:39:47.752784 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.752756 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ktk84" event={"ID":"f35e9bc5-2a57-4a43-bd24-b84ce519a48a","Type":"ContainerStarted","Data":"243ccf37e81d5519d185651ab34fde680425a4c9f1677b98f44df24883eb73aa"} Jun 02 18:39:47.756573 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.756544 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbpbt" event={"ID":"27555d26-14a0-4551-b300-38ab47ce8ebc","Type":"ContainerStarted","Data":"257c510e85c498a55e995ca2a1daa416423827bbbcd82f61ef15e51ffe08b1c1"} Jun 02 18:39:47.762086 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.762061 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wpp2r" event={"ID":"154022e6-248f-4861-b053-a9994a9e9a30","Type":"ContainerStarted","Data":"434347008ea6e2d790d8e80c12ac7cc561a8fc5e04f8c1a506399eb0567caf47"} Jun 02 18:39:47.767504 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.767477 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bjqbt" event={"ID":"f9ac9bd7-6742-408f-9d21-f81f9f384bfa","Type":"ContainerStarted","Data":"dc30729e778d1ff4bb6cfa9de10989dea1ddae04be3f1e8191547d7b20731cba"} Jun 02 18:39:47.788398 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.788368 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vnnpk" event={"ID":"5e04a94e-1507-48de-be8a-939b4a8d0ce7","Type":"ContainerStarted","Data":"4f1b83739719758f4f2dab7d9c8d08a26744677d98001139ddecb7563cc867c3"} Jun 02 18:39:47.806007 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.805980 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" event={"ID":"e568234e-886d-43ff-bd5b-49182e59d2e9","Type":"ContainerStarted","Data":"8fcd342f3c34939ae45b20d8b1ae0a2ddd9c1c041b83673b97c9bcda37d8104f"} Jun 02 18:39:47.815914 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:47.815861 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hqr7x" event={"ID":"a5892822-06c6-452e-ad71-7aba446f1618","Type":"ContainerStarted","Data":"403b1ad52c7612386fce4caa8e2f3b069e2b697f724b8475971fb499ad3ec2f3"} Jun 02 18:39:48.049107 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.049029 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-msv4d"] Jun 02 18:39:48.049472 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.049453 2567 predicate.go:212] "Predicate failed on Pod" pod="kube-system/global-pull-secret-syncer-msv4d" err="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jun 02 18:39:48.049799 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.049475 2567 kubelet.go:2420] "Pod admission denied" podUID="db6f6901-0c66-4c91-b844-4cec306c37ba" pod="kube-system/global-pull-secret-syncer-msv4d" reason="NodeAffinity" message="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jun 02 18:39:48.078347 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.078318 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kube-system/global-pull-secret-syncer-msv4d"] Jun 02 18:39:48.078508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.078429 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-msv4d" Jun 02 18:39:48.083974 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.083948 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kube-system/global-pull-secret-syncer-msv4d"] Jun 02 18:39:48.085059 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.084940 2567 status_manager.go:919] "Failed to update status for pod" pod="kube-system/global-pull-secret-syncer-msv4d" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"db6f6901-0c66-4c91-b844-4cec306c37ba\\\"},\\\"status\\\":{\\\"conditions\\\":[{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-06-02T18:39:48Z\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-06-02T18:39:48Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Initialized\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-06-02T18:39:48Z\\\",\\\"reason\\\":\\\"PodFailed\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-06-02T18:39:48Z\\\",\\\"reason\\\":\\\"PodFailed\\\",\\\"status\\\":\\\"False\\\",\\\"type\\\":\\\"ContainersReady\\\"},{\\\"lastProbeTime\\\":null,\\\"lastTransitionTime\\\":\\\"2026-06-02T18:39:48Z\\\",\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"PodScheduled\\\"}],\\\"containerStatuses\\\":[{\\\"image\\\":\\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a44fd3d47121bb310811eed62aa9dccf0b2220b19d8e6e701b7f487d4f1d445a\\\",\\\"imageID\\\":\\\"\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"global-pull-secret-syncer\\\",\\\"ready\\\":false,\\\"restartCount\\\":0,\\\"started\\\":false,\\\"state\\\":{\\\"waiting\\\":{\\\"reason\\\":\\\"ContainerCreating\\\"}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/lib/kubelet\\\",\\\"name\\\":\\\"kubelet-config\\\"},{\\\"mountPath\\\":\\\"/var/run/dbus\\\",\\\"name\\\":\\\"dbus\\\"},{\\\"mountPath\\\":\\\"/etc/original-pull-secret\\\",\\\"name\\\":\\\"original-pull-secret\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}],\\\"hostIP\\\":\\\"10.0.140.185\\\",\\\"hostIPs\\\":[{\\\"ip\\\":\\\"10.0.140.185\\\"}]}}\" for pod \"kube-system\"/\"global-pull-secret-syncer-msv4d\": pods \"global-pull-secret-syncer-msv4d\" not found" Jun 02 18:39:48.087485 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.087145 2567 status_manager.go:895] "Failed to get status for pod" podUID="db6f6901-0c66-4c91-b844-4cec306c37ba" pod="kube-system/global-pull-secret-syncer-msv4d" err="pods \"global-pull-secret-syncer-msv4d\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:48.113222 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.113199 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nfczp"] Jun 02 18:39:48.113660 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.113606 2567 predicate.go:212] "Predicate failed on Pod" pod="kube-system/global-pull-secret-syncer-nfczp" err="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jun 02 18:39:48.113660 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.113626 2567 kubelet.go:2420] "Pod admission denied" podUID="a03be722-ec26-410c-9db5-62a4a7b76b84" pod="kube-system/global-pull-secret-syncer-nfczp" reason="NodeAffinity" message="Predicate NodeAffinity failed: node(s) didn't match Pod's node affinity/selector" Jun 02 18:39:48.115795 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.115766 2567 status_manager.go:895] "Failed to get status for pod" podUID="db6f6901-0c66-4c91-b844-4cec306c37ba" pod="kube-system/global-pull-secret-syncer-msv4d" err="pods \"global-pull-secret-syncer-msv4d\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:48.248694 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.248656 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:48.248859 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.248848 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:48.248930 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.248919 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.24890002 +0000 UTC m=+5.061362811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:48.349064 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.349031 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:48.349270 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.349238 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:48.349270 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.349261 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:48.349377 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.349275 2567 projected.go:194] Error preparing data for projected volume kube-api-access-rwd8v for pod openshift-network-diagnostics/network-check-target-h75lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:48.349377 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.349337 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v podName:743f6854-f098-4c5d-9fab-40fc05cb3b6e nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.349315652 +0000 UTC m=+5.161778448 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwd8v" (UniqueName: "kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v") pod "network-check-target-h75lh" (UID: "743f6854-f098-4c5d-9fab-40fc05cb3b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:48.656343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.656258 2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 18:34:46 +0000 UTC" deadline="2028-02-12 01:57:57.903961822 +0000 UTC" Jun 02 18:39:48.656343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.656295 2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14863h18m9.247670297s" Jun 02 18:39:48.706841 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.706809 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:48.707010 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.706935 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:39:48.707403 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:48.707382 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:48.707503 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:48.707488 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:39:49.014702 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.014626 2567 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:49.136953 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.136362 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kube-system/global-pull-secret-syncer-nfczp"] Jun 02 18:39:49.136953 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.136484 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nfczp" Jun 02 18:39:49.140316 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.140282 2567 status_manager.go:895] "Failed to get status for pod" podUID="a03be722-ec26-410c-9db5-62a4a7b76b84" pod="kube-system/global-pull-secret-syncer-nfczp" err="pods \"global-pull-secret-syncer-nfczp\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:49.141483 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.141440 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kube-system/global-pull-secret-syncer-nfczp"] Jun 02 18:39:49.142541 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.142413 2567 status_manager.go:895] "Failed to get status for pod" podUID="db6f6901-0c66-4c91-b844-4cec306c37ba" pod="kube-system/global-pull-secret-syncer-msv4d" err="pods \"global-pull-secret-syncer-msv4d\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:49.144990 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.144968 2567 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 18:39:49.145343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.145316 2567 status_manager.go:895] "Failed to get status for pod" podUID="db6f6901-0c66-4c91-b844-4cec306c37ba" pod="kube-system/global-pull-secret-syncer-msv4d" err="pods \"global-pull-secret-syncer-msv4d\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:49.147299 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.147274 2567 status_manager.go:895] "Failed to get status for pod" podUID="a03be722-ec26-410c-9db5-62a4a7b76b84" pod="kube-system/global-pull-secret-syncer-nfczp" err="pods \"global-pull-secret-syncer-nfczp\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:49.156997 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.156318 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-2ltqf"] Jun 02 18:39:49.158320 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.158137 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.158320 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:49.158226 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:39:49.160342 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.160317 2567 status_manager.go:895] "Failed to get status for pod" podUID="db6f6901-0c66-4c91-b844-4cec306c37ba" pod="kube-system/global-pull-secret-syncer-msv4d" err="pods \"global-pull-secret-syncer-msv4d\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:49.176826 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.176799 2567 status_manager.go:895] "Failed to get status for pod" podUID="a03be722-ec26-410c-9db5-62a4a7b76b84" pod="kube-system/global-pull-secret-syncer-nfczp" err="pods \"global-pull-secret-syncer-nfczp\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kube-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:39:49.258657 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.258426 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7a3402c-71c0-4f56-9136-99d51e043c53-kubelet-config\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.258657 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.258539 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.258657 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.258569 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7a3402c-71c0-4f56-9136-99d51e043c53-dbus\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.358965 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.358925 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.359136 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.358980 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7a3402c-71c0-4f56-9136-99d51e043c53-dbus\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.359136 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.359008 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7a3402c-71c0-4f56-9136-99d51e043c53-kubelet-config\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.359285 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.359140 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f7a3402c-71c0-4f56-9136-99d51e043c53-kubelet-config\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.359285 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:49.359257 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:49.359390 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:49.359312 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret podName:f7a3402c-71c0-4f56-9136-99d51e043c53 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:49.859294317 +0000 UTC m=+4.671757111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret") pod "global-pull-secret-syncer-2ltqf" (UID: "f7a3402c-71c0-4f56-9136-99d51e043c53") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:49.359654 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.359632 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f7a3402c-71c0-4f56-9136-99d51e043c53-dbus\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.863976 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:49.863936 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:49.864457 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:49.864077 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:49.864457 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:49.864133 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret podName:f7a3402c-71c0-4f56-9136-99d51e043c53 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:50.864116605 +0000 UTC m=+5.676579399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret") pod "global-pull-secret-syncer-2ltqf" (UID: "f7a3402c-71c0-4f56-9136-99d51e043c53") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:50.268294 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:50.268199 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:50.268458 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.268352 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.268458 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.268416 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:39:54.268397471 +0000 UTC m=+9.080860278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:50.369105 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:50.369068 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:50.369300 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.369245 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:50.369300 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.369269 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:50.369300 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.369283 2567 projected.go:194] Error preparing data for projected volume kube-api-access-rwd8v for pod openshift-network-diagnostics/network-check-target-h75lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.369456 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.369339 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v podName:743f6854-f098-4c5d-9fab-40fc05cb3b6e nodeName:}" failed. No retries permitted until 2026-06-02 18:39:54.369321608 +0000 UTC m=+9.181784404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwd8v" (UniqueName: "kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v") pod "network-check-target-h75lh" (UID: "743f6854-f098-4c5d-9fab-40fc05cb3b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:50.706330 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:50.706299 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:50.706515 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.706435 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:39:50.706792 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:50.706773 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:50.707138 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.706881 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:39:50.707138 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:50.706936 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:50.707138 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.706996 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:39:50.873900 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:50.873414 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:50.873900 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.873558 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:50.873900 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:50.873616 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret podName:f7a3402c-71c0-4f56-9136-99d51e043c53 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:52.873597897 +0000 UTC m=+7.686060687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret") pod "global-pull-secret-syncer-2ltqf" (UID: "f7a3402c-71c0-4f56-9136-99d51e043c53") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:52.706717 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:52.706504 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:52.707172 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:52.706504 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:52.707172 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:52.706813 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:39:52.707172 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:52.706897 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:39:52.707172 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:52.706520 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:52.707172 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:52.706993 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:39:52.889293 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:52.889255 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:52.889455 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:52.889366 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:52.889455 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:52.889425 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret podName:f7a3402c-71c0-4f56-9136-99d51e043c53 nodeName:}" failed. No retries permitted until 2026-06-02 18:39:56.88940999 +0000 UTC m=+11.701872780 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret") pod "global-pull-secret-syncer-2ltqf" (UID: "f7a3402c-71c0-4f56-9136-99d51e043c53") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:54.298032 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:54.297963 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:54.298476 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.298131 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:54.298476 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.298206 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:40:02.298172708 +0000 UTC m=+17.110635503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:39:54.399013 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:54.398983 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:54.399231 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.399157 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:39:54.399231 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.399194 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:39:54.399231 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.399207 2567 projected.go:194] Error preparing data for projected volume kube-api-access-rwd8v for pod openshift-network-diagnostics/network-check-target-h75lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:54.399395 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.399264 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v podName:743f6854-f098-4c5d-9fab-40fc05cb3b6e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:02.399247676 +0000 UTC m=+17.211710468 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwd8v" (UniqueName: "kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v") pod "network-check-target-h75lh" (UID: "743f6854-f098-4c5d-9fab-40fc05cb3b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:39:54.707112 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:54.707076 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:54.707112 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:54.707111 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:54.707436 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:54.707092 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:54.707436 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.707221 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:39:54.707436 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.707354 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:39:54.707578 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:54.707449 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:39:56.707229 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:56.707170 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:56.707229 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:56.707214 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:56.707798 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:56.707170 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:56.707798 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:56.707353 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:39:56.707798 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:56.707397 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:39:56.707798 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:56.707482 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:39:56.922602 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:56.922563 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:56.922800 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:56.922739 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:56.922858 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:56.922818 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret podName:f7a3402c-71c0-4f56-9136-99d51e043c53 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:04.922796729 +0000 UTC m=+19.735259522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret") pod "global-pull-secret-syncer-2ltqf" (UID: "f7a3402c-71c0-4f56-9136-99d51e043c53") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:39:58.706813 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:58.706783 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:39:58.707299 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:58.706790 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:39:58.707299 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:58.706897 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:39:58.707299 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:39:58.706796 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:39:58.707299 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:58.706988 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:39:58.707299 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:39:58.707039 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:00.706951 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:00.706916 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:00.707400 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:00.706916 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:00.707400 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:00.707023 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:00.707400 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:00.706916 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:00.707400 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:00.707088 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:00.707400 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:00.707167 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:02.361811 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:02.361776 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:02.362258 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.361940 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:02.362258 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.362024 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:40:18.362006558 +0000 UTC m=+33.174469347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:02.462197 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:02.462149 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:02.462363 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.462306 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:40:02.462363 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.462327 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:40:02.462363 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.462336 2567 projected.go:194] Error preparing data for projected volume kube-api-access-rwd8v for pod openshift-network-diagnostics/network-check-target-h75lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:02.462483 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.462396 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v podName:743f6854-f098-4c5d-9fab-40fc05cb3b6e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:18.462380281 +0000 UTC m=+33.274843076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwd8v" (UniqueName: "kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v") pod "network-check-target-h75lh" (UID: "743f6854-f098-4c5d-9fab-40fc05cb3b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:02.706221 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:02.706124 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:02.706221 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:02.706128 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:02.706436 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.706268 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:02.706436 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.706326 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:02.706436 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:02.706126 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:02.706436 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:02.706411 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:04.707091 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:04.707046 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:04.707091 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:04.707068 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:04.707091 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:04.707091 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:04.707593 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:04.707203 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:04.707593 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:04.707281 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:04.707593 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:04.707368 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:04.983121 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:04.983019 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:04.983305 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:04.983170 2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 18:40:04.983305 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:04.983253 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret podName:f7a3402c-71c0-4f56-9136-99d51e043c53 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:20.983234747 +0000 UTC m=+35.795697538 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret") pod "global-pull-secret-syncer-2ltqf" (UID: "f7a3402c-71c0-4f56-9136-99d51e043c53") : object "kube-system"/"original-pull-secret" not registered Jun 02 18:40:06.707106 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.706827 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:06.707839 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.706843 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:06.707839 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:06.707195 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:06.707839 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.706827 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:06.707839 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:06.707296 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:06.707839 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:06.707383 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:06.856982 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.856959 2567 generic.go:358] "Generic (PLEG): container finished" podID="ec075e2df0600a3a46f0e48af57f0d12" containerID="31cc4b94413385152450ba5e377bf8429989fff1075b8023d7492b835014f43d" exitCode=0 Jun 02 18:40:06.857084 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.857024 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" event={"ID":"ec075e2df0600a3a46f0e48af57f0d12","Type":"ContainerDied","Data":"31cc4b94413385152450ba5e377bf8429989fff1075b8023d7492b835014f43d"} Jun 02 18:40:06.858421 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.858376 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vnnpk" event={"ID":"5e04a94e-1507-48de-be8a-939b4a8d0ce7","Type":"ContainerStarted","Data":"c30b54d0cefccbc746cb802356fe0b88b4d6ec008e67f219fd0bc2b881431aac"} Jun 02 18:40:06.859769 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.859751 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" event={"ID":"e568234e-886d-43ff-bd5b-49182e59d2e9","Type":"ContainerStarted","Data":"105abc21ed48f09ffb21bacfdeb376178a15bdead62152ade6677ad4a86e13ee"} Jun 02 18:40:06.861055 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.861030 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hqr7x" event={"ID":"a5892822-06c6-452e-ad71-7aba446f1618","Type":"ContainerStarted","Data":"0ecc6f5a6976f373d44176210f00d2404dd8fb4ec02fcc5845454fac9b7ac9fe"} Jun 02 18:40:06.862190 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.862162 2567 generic.go:358] "Generic (PLEG): container finished" podID="52f2e98a-b555-4a0b-af02-01d34a9b0d23" containerID="9c1b37d4402825389c0f101fb2aff3d84db3068d16cc1db1ebc90fb429536e43" exitCode=0 Jun 02 18:40:06.862244 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.862208 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerDied","Data":"9c1b37d4402825389c0f101fb2aff3d84db3068d16cc1db1ebc90fb429536e43"} Jun 02 18:40:06.866459 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.866433 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"9311c56280d94ab328887fd4b2381333e3ec75f59c6cc49d37d40e6a410a67e4"} Jun 02 18:40:06.866459 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.866459 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"6c84bc860265bc6315e408d5e5ad8067523a26c6fd026c1fafd181e680844068"} Jun 02 18:40:06.866595 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.866472 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"e739e2a5c2acb4235f5f40f05f542d4c9a77c4d5726fc0e45df7c08be9afe78d"} Jun 02 18:40:06.866595 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.866484 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"136170e5c6cb2cf4b64c68ffba79046ba6eb345351fd6990cb8b38d9987fd988"} Jun 02 18:40:06.866595 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.866496 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"b08f11e3f295173f6a987d263d037e93f4ee8d019fa545737096c254a02f3b21"} Jun 02 18:40:06.867603 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.867581 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" event={"ID":"5aeaf278a0e5b76b237c975d46dc71d9","Type":"ContainerStarted","Data":"ebdcd2021094f5bc5de49e07aff8187b7f0c8899cefadc61d46ff1416895a1c8"} Jun 02 18:40:06.868662 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.868645 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ktk84" event={"ID":"f35e9bc5-2a57-4a43-bd24-b84ce519a48a","Type":"ContainerStarted","Data":"9955fe498bea0318b3e5621b066d7f931fbe3462903529456035805b3af76e9a"} Jun 02 18:40:06.869767 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.869744 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hbpbt" event={"ID":"27555d26-14a0-4551-b300-38ab47ce8ebc","Type":"ContainerStarted","Data":"606e1fc9bd5cd9c7849d6f687f6476a9667de8f7428e786cf7ad387e936ecfd2"} Jun 02 18:40:06.870870 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.870850 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wpp2r" event={"ID":"154022e6-248f-4861-b053-a9994a9e9a30","Type":"ContainerStarted","Data":"66a922840b1ab9dd032cb4d3e63cde551c816ab24c5b51d8433d206a4d1d4f17"} Jun 02 18:40:06.892612 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.892569 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hqr7x" podStartSLOduration=11.056406158 podStartE2EDuration="21.892557743s" podCreationTimestamp="2026-06-02 18:39:45 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.961250721 +0000 UTC m=+1.773713511" lastFinishedPulling="2026-06-02 18:39:57.797402295 +0000 UTC m=+12.609865096" observedRunningTime="2026-06-02 18:40:06.892376781 +0000 UTC m=+21.704839599" watchObservedRunningTime="2026-06-02 18:40:06.892557743 +0000 UTC m=+21.705020554" Jun 02 18:40:06.922109 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.922062 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-185.ec2.internal" podStartSLOduration=20.922046691 podStartE2EDuration="20.922046691s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:40:06.921680423 +0000 UTC m=+21.734143236" watchObservedRunningTime="2026-06-02 18:40:06.922046691 +0000 UTC m=+21.734509503" Jun 02 18:40:06.922541 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.922504 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hbpbt" podStartSLOduration=2.019423393 podStartE2EDuration="20.922494214s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.967222599 +0000 UTC m=+1.779685389" lastFinishedPulling="2026-06-02 18:40:05.87029341 +0000 UTC m=+20.682756210" observedRunningTime="2026-06-02 18:40:06.905520067 +0000 UTC m=+21.717982878" watchObservedRunningTime="2026-06-02 18:40:06.922494214 +0000 UTC m=+21.734957026" Jun 02 18:40:06.937110 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.937068 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-wpp2r" podStartSLOduration=3.015512256 podStartE2EDuration="21.937058454s" podCreationTimestamp="2026-06-02 18:39:45 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.948743199 +0000 UTC m=+1.761205988" lastFinishedPulling="2026-06-02 18:40:05.870289392 +0000 UTC m=+20.682752186" observedRunningTime="2026-06-02 18:40:06.936869482 +0000 UTC m=+21.749332292" watchObservedRunningTime="2026-06-02 18:40:06.937058454 +0000 UTC m=+21.749521264" Jun 02 18:40:06.975688 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.974420 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-vnnpk" podStartSLOduration=2.009718698 podStartE2EDuration="20.974404924s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.976225152 +0000 UTC m=+1.788687941" lastFinishedPulling="2026-06-02 18:40:05.940911378 +0000 UTC m=+20.753374167" observedRunningTime="2026-06-02 18:40:06.973810622 +0000 UTC m=+21.786273434" watchObservedRunningTime="2026-06-02 18:40:06.974404924 +0000 UTC m=+21.786867736" Jun 02 18:40:06.989856 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:06.989797 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ktk84" podStartSLOduration=2.059468137 podStartE2EDuration="20.989783005s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.980514003 +0000 UTC m=+1.792976791" lastFinishedPulling="2026-06-02 18:40:05.910828864 +0000 UTC m=+20.723291659" observedRunningTime="2026-06-02 18:40:06.989290174 +0000 UTC m=+21.801753007" watchObservedRunningTime="2026-06-02 18:40:06.989783005 +0000 UTC m=+21.802245817" Jun 02 18:40:07.839994 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:07.839969 2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 18:40:07.874022 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:07.873994 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" event={"ID":"ec075e2df0600a3a46f0e48af57f0d12","Type":"ContainerStarted","Data":"438b746107643769d475daae23cdc3cc689d753bd266e55da275f39d24e1574c"} Jun 02 18:40:07.875605 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:07.875584 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" event={"ID":"e568234e-886d-43ff-bd5b-49182e59d2e9","Type":"ContainerStarted","Data":"94d53656ec00852fcb9d43f911facb859fd84ad5e03df109753550d870ffc29a"} Jun 02 18:40:07.878002 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:07.877982 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"ad90e6a75ad2bda232fa5a1fdfa5ee99828aa9e7b8cfc887fc168f5a61a57177"} Jun 02 18:40:07.879273 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:07.879231 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bjqbt" event={"ID":"f9ac9bd7-6742-408f-9d21-f81f9f384bfa","Type":"ContainerStarted","Data":"4d8bb9cf5495968a6fc5b0e867ef1fc23b22b677793450f4346c24569f3851b3"} Jun 02 18:40:07.888866 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:07.888830 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-185.ec2.internal" podStartSLOduration=21.888818109 podStartE2EDuration="21.888818109s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:40:07.888441229 +0000 UTC m=+22.700904041" watchObservedRunningTime="2026-06-02 18:40:07.888818109 +0000 UTC m=+22.701280919" Jun 02 18:40:07.903169 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:07.903116 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bjqbt" podStartSLOduration=3.91903947 podStartE2EDuration="22.903102026s" podCreationTimestamp="2026-06-02 18:39:45 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.92652625 +0000 UTC m=+1.738989042" lastFinishedPulling="2026-06-02 18:40:05.910588797 +0000 UTC m=+20.723051598" observedRunningTime="2026-06-02 18:40:07.902651982 +0000 UTC m=+22.715114793" watchObservedRunningTime="2026-06-02 18:40:07.903102026 +0000 UTC m=+22.715564838" Jun 02 18:40:08.685958 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:08.685851 2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T18:40:07.839989363Z","UUID":"b42d2a88-194a-435f-84fc-42d76fb7fab9","Handler":null,"Name":"","Endpoint":""} Jun 02 18:40:08.687924 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:08.687881 2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 18:40:08.688076 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:08.687947 2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 18:40:08.707128 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:08.707091 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:08.707284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:08.707118 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:08.707284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:08.707197 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:08.707394 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:08.707279 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:08.707394 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:08.707353 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:08.707482 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:08.707438 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:09.230330 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:09.230300 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:40:09.230853 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:09.230828 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:40:09.885497 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:09.885458 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" event={"ID":"e568234e-886d-43ff-bd5b-49182e59d2e9","Type":"ContainerStarted","Data":"21c8cf27d8ae6c5a71cbd3a7f84b0ac48f371bb3ddd83c68506d97921d5de998"} Jun 02 18:40:09.888646 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:09.888617 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"bd453450309e3e6b98b1cf6641e40a0bd339be63e464ce851b51b1ba2789ff25"} Jun 02 18:40:09.902825 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:09.902789 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vtlfq" podStartSLOduration=1.394135611 podStartE2EDuration="23.90277739s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.971979253 +0000 UTC m=+1.784442043" lastFinishedPulling="2026-06-02 18:40:09.480621033 +0000 UTC m=+24.293083822" observedRunningTime="2026-06-02 18:40:09.902729071 +0000 UTC m=+24.715191882" watchObservedRunningTime="2026-06-02 18:40:09.90277739 +0000 UTC m=+24.715240200" Jun 02 18:40:10.706610 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:10.706439 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:10.707049 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:10.706440 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:10.707049 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:10.706675 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:10.707049 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:10.706772 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:10.707049 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:10.706440 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:10.707049 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:10.706884 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:12.706743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:12.706709 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:12.706743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:12.706735 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:12.707137 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:12.706716 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:12.707137 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:12.706823 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:12.707137 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:12.706901 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:12.707137 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:12.706969 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:13.897552 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:13.897361 2567 generic.go:358] "Generic (PLEG): container finished" podID="52f2e98a-b555-4a0b-af02-01d34a9b0d23" containerID="57d9b33bba3180851c3f5bdfbc7c79b1064948b6d0f3718405d6ce20f11cdfec" exitCode=0 Jun 02 18:40:13.898309 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:13.897406 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerDied","Data":"57d9b33bba3180851c3f5bdfbc7c79b1064948b6d0f3718405d6ce20f11cdfec"} Jun 02 18:40:13.901038 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:13.901016 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" event={"ID":"e9286a64-8422-458b-9bcb-95aa44f00567","Type":"ContainerStarted","Data":"0de1e3cc570947542b8cbb41cb2c74549eef9c157d0c3244a40d23fcaa38b270"} Jun 02 18:40:13.901364 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:13.901351 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:40:13.901435 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:13.901373 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:40:13.916105 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:13.916085 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:40:13.946142 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:13.946105 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" podStartSLOduration=9.537901864 podStartE2EDuration="28.946094355s" podCreationTimestamp="2026-06-02 18:39:45 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.930862689 +0000 UTC m=+1.743325477" lastFinishedPulling="2026-06-02 18:40:06.33905518 +0000 UTC m=+21.151517968" observedRunningTime="2026-06-02 18:40:13.945620414 +0000 UTC m=+28.758083225" watchObservedRunningTime="2026-06-02 18:40:13.946094355 +0000 UTC m=+28.758557184" Jun 02 18:40:14.510768 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.510729 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:40:14.510935 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.510892 2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 02 18:40:14.511785 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.511604 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hbpbt" Jun 02 18:40:14.706870 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.706840 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:14.707014 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.706883 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:14.707014 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.706912 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:14.707014 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:14.706999 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:14.707135 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:14.707110 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:14.707224 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:14.707197 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:14.840015 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.839924 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h75lh"] Jun 02 18:40:14.843388 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.843360 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2ltqf"] Jun 02 18:40:14.843971 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.843952 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbm7r"] Jun 02 18:40:14.903043 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.903017 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:14.903432 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.903060 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:14.903432 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.903017 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:14.903432 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:14.903122 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:14.903432 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:14.903169 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:14.903432 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:14.903276 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:14.903824 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.903811 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:40:14.918884 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:14.918858 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:40:15.907708 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:15.907674 2567 generic.go:358] "Generic (PLEG): container finished" podID="52f2e98a-b555-4a0b-af02-01d34a9b0d23" containerID="0c90de4c97abd92e26294df960c66c6fd9bd028c13ab329ac7bac3bb349f3326" exitCode=0 Jun 02 18:40:15.908035 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:15.907755 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerDied","Data":"0c90de4c97abd92e26294df960c66c6fd9bd028c13ab329ac7bac3bb349f3326"} Jun 02 18:40:16.707030 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:16.706891 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:16.707124 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:16.706891 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:16.707124 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:16.707113 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:16.707215 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:16.706896 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:16.707215 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:16.707201 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:16.707320 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:16.707295 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:16.914562 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:16.914469 2567 generic.go:358] "Generic (PLEG): container finished" podID="52f2e98a-b555-4a0b-af02-01d34a9b0d23" containerID="76ecf479c695c54549ce4cd0ed284e6629f8c361fd75c56e3f36aad646694b4b" exitCode=0 Jun 02 18:40:16.914907 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:16.914556 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerDied","Data":"76ecf479c695c54549ce4cd0ed284e6629f8c361fd75c56e3f36aad646694b4b"} Jun 02 18:40:18.389526 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:18.389487 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:18.390140 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.389649 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:18.390140 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.389717 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:40:50.389697941 +0000 UTC m=+65.202160730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 18:40:18.490018 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:18.489978 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:18.490242 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.490110 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 18:40:18.490242 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.490128 2567 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 18:40:18.490242 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.490140 2567 projected.go:194] Error preparing data for projected volume kube-api-access-rwd8v for pod openshift-network-diagnostics/network-check-target-h75lh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:18.490242 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.490220 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v podName:743f6854-f098-4c5d-9fab-40fc05cb3b6e nodeName:}" failed. No retries permitted until 2026-06-02 18:40:50.490190854 +0000 UTC m=+65.302653656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rwd8v" (UniqueName: "kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v") pod "network-check-target-h75lh" (UID: "743f6854-f098-4c5d-9fab-40fc05cb3b6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 18:40:18.706942 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:18.706852 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:18.707149 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:18.706862 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:18.707149 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.706974 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2ltqf" podUID="f7a3402c-71c0-4f56-9136-99d51e043c53" Jun 02 18:40:18.707149 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:18.706873 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:18.707149 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.707038 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbm7r" podUID="a8ce9161-c49b-4a7c-af89-1294da53da1d" Jun 02 18:40:18.707371 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:18.707147 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h75lh" podUID="743f6854-f098-4c5d-9fab-40fc05cb3b6e" Jun 02 18:40:19.068636 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.068570 2567 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-185.ec2.internal" event="NodeReady" Jun 02 18:40:19.068832 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.068696 2567 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 18:40:19.104399 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.104368 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-946d6d6c-n8k69"] Jun 02 18:40:19.124145 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.124123 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-946d6d6c-n8k69"] Jun 02 18:40:19.124145 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.124148 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vj5lg"] Jun 02 18:40:19.124361 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.124288 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.127879 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.127847 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 18:40:19.128134 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.128110 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htf9l\"" Jun 02 18:40:19.128266 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.128231 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 18:40:19.128393 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.128373 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 18:40:19.138517 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.138461 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 18:40:19.140487 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.140462 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bjgwr"] Jun 02 18:40:19.140663 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.140633 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.143310 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.143287 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 18:40:19.143408 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.143325 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h76xf\"" Jun 02 18:40:19.143408 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.143350 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 18:40:19.158699 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.158677 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj5lg"] Jun 02 18:40:19.158807 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.158706 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bjgwr"] Jun 02 18:40:19.158886 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.158843 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:19.161841 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.161795 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 18:40:19.162989 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.162341 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 18:40:19.162989 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.162405 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 18:40:19.162989 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.162824 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdj79\"" Jun 02 18:40:19.195977 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.195816 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.195977 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.195874 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:19.195977 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.195896 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.195977 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.195916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-bound-sa-token\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.195977 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.195953 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-trusted-ca\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196044 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfg2s\" (UniqueName: \"kubernetes.io/projected/b3284f7e-a49f-4653-9f96-c06804b34f09-kube-api-access-dfg2s\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196078 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-registry-certificates\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196121 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-installation-pull-secrets\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196174 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdgft\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-kube-api-access-bdgft\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196218 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3284f7e-a49f-4653-9f96-c06804b34f09-config-volume\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196244 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-image-registry-private-configuration\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196281 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3284f7e-a49f-4653-9f96-c06804b34f09-tmp-dir\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.196335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196325 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msz8k\" (UniqueName: \"kubernetes.io/projected/7019a38a-dfac-4478-8411-b7bca7218343-kube-api-access-msz8k\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:19.196640 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.196348 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75422cdb-a567-401c-8061-f891ec6b908f-ca-trust-extracted\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.297276 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297240 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msz8k\" (UniqueName: \"kubernetes.io/projected/7019a38a-dfac-4478-8411-b7bca7218343-kube-api-access-msz8k\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:19.297276 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297278 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75422cdb-a567-401c-8061-f891ec6b908f-ca-trust-extracted\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.297525 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297299 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.297525 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.297399 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:40:19.297525 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.297417 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:40:19.297525 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.297492 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:19.797469937 +0000 UTC m=+34.609932733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297526 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297556 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297583 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-bound-sa-token\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297622 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-trusted-ca\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.297639 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297665 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dfg2s\" (UniqueName: \"kubernetes.io/projected/b3284f7e-a49f-4653-9f96-c06804b34f09-kube-api-access-dfg2s\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.297697 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:19.797679321 +0000 UTC m=+34.610142124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:40:19.297729 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.297713 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.297772 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:19.797757815 +0000 UTC m=+34.610220623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297814 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-registry-certificates\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297828 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75422cdb-a567-401c-8061-f891ec6b908f-ca-trust-extracted\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297846 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-installation-pull-secrets\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297905 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdgft\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-kube-api-access-bdgft\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297943 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3284f7e-a49f-4653-9f96-c06804b34f09-config-volume\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.297969 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-image-registry-private-configuration\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.298097 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.298013 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3284f7e-a49f-4653-9f96-c06804b34f09-tmp-dir\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.298451 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.298389 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3284f7e-a49f-4653-9f96-c06804b34f09-tmp-dir\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.298451 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.298433 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-registry-certificates\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.298684 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.298665 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-trusted-ca\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.298748 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.298698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3284f7e-a49f-4653-9f96-c06804b34f09-config-volume\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.302442 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.302381 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-installation-pull-secrets\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.302442 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.302373 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-image-registry-private-configuration\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.306407 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.306383 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfg2s\" (UniqueName: \"kubernetes.io/projected/b3284f7e-a49f-4653-9f96-c06804b34f09-kube-api-access-dfg2s\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.306526 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.306475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-bound-sa-token\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.306775 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.306754 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msz8k\" (UniqueName: \"kubernetes.io/projected/7019a38a-dfac-4478-8411-b7bca7218343-kube-api-access-msz8k\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:19.307046 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.307024 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdgft\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-kube-api-access-bdgft\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.801652 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.801621 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.801675 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.801762 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.801775 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.801797 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:19.801808 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.801817 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:20.801799629 +0000 UTC m=+35.614262432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.801901 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.801928 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:20.801912675 +0000 UTC m=+35.614375468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:40:19.802412 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:19.801946 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:20.801936902 +0000 UTC m=+35.614399696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:40:20.706671 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.706639 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:20.706856 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.706685 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:20.706856 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.706639 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:20.711367 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.711341 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6lfr\"" Jun 02 18:40:20.711367 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.711369 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 18:40:20.711521 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.711385 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 18:40:20.711521 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.711341 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 18:40:20.711521 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.711432 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 18:40:20.711521 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.711407 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgbvm\"" Jun 02 18:40:20.810672 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.810631 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.810682 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:20.810789 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:20.810894 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:22.810873729 +0000 UTC m=+37.623336537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:20.810927 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:20.811006 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:20.811018 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:20.811053 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:22.811040819 +0000 UTC m=+37.623503609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:20.810789 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:20.811141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:20.811098 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:22.811086853 +0000 UTC m=+37.623549642 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:40:21.012068 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:21.011983 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:21.014543 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:21.014521 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f7a3402c-71c0-4f56-9136-99d51e043c53-original-pull-secret\") pod \"global-pull-secret-syncer-2ltqf\" (UID: \"f7a3402c-71c0-4f56-9136-99d51e043c53\") " pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:21.031654 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:21.031630 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2ltqf" Jun 02 18:40:22.828173 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:22.828001 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:22.828207 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:22.828230 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:22.828123 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:22.828255 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:22.828328 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:22.828341 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:22.828366 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:26.828343518 +0000 UTC m=+41.640806309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:22.828384 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:26.82837521 +0000 UTC m=+41.640838005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:40:22.828607 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:22.828401 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:26.828392086 +0000 UTC m=+41.640854878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:40:22.924991 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:22.924963 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2ltqf"] Jun 02 18:40:22.928591 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:40:22.928564 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a3402c_71c0_4f56_9136_99d51e043c53.slice/crio-5ed051e564bc3c477db43bf56a6db056b640c9c100c257b6a35ae4ce52112ab0 WatchSource:0}: Error finding container 5ed051e564bc3c477db43bf56a6db056b640c9c100c257b6a35ae4ce52112ab0: Status 404 returned error can't find the container with id 5ed051e564bc3c477db43bf56a6db056b640c9c100c257b6a35ae4ce52112ab0 Jun 02 18:40:23.930690 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:23.930656 2567 generic.go:358] "Generic (PLEG): container finished" podID="52f2e98a-b555-4a0b-af02-01d34a9b0d23" containerID="e91f89473581732ede2d8ad6bf96bd6cf684dd93dec55c41e0c5b525518d3174" exitCode=0 Jun 02 18:40:23.931076 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:23.930740 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerDied","Data":"e91f89473581732ede2d8ad6bf96bd6cf684dd93dec55c41e0c5b525518d3174"} Jun 02 18:40:23.932546 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:23.932505 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2ltqf" event={"ID":"f7a3402c-71c0-4f56-9136-99d51e043c53","Type":"ContainerStarted","Data":"5ed051e564bc3c477db43bf56a6db056b640c9c100c257b6a35ae4ce52112ab0"} Jun 02 18:40:24.937729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:24.937523 2567 generic.go:358] "Generic (PLEG): container finished" podID="52f2e98a-b555-4a0b-af02-01d34a9b0d23" containerID="2fb984f40c1b7dd265ce8c3b58893d37d4d3fe43366a5a33eb6ec986cfd7dfde" exitCode=0 Jun 02 18:40:24.937729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:24.937602 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerDied","Data":"2fb984f40c1b7dd265ce8c3b58893d37d4d3fe43366a5a33eb6ec986cfd7dfde"} Jun 02 18:40:25.943571 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:25.943520 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" event={"ID":"52f2e98a-b555-4a0b-af02-01d34a9b0d23","Type":"ContainerStarted","Data":"a40ce30a91adb8002a9e43a1e86e8a4170c3ebb58dc9bd47237592d3304c1978"} Jun 02 18:40:25.966603 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:25.966541 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jkqnl" podStartSLOduration=4.963937716 podStartE2EDuration="40.96652458s" podCreationTimestamp="2026-06-02 18:39:45 +0000 UTC" firstStartedPulling="2026-06-02 18:39:46.952906916 +0000 UTC m=+1.765369706" lastFinishedPulling="2026-06-02 18:40:22.955493781 +0000 UTC m=+37.767956570" observedRunningTime="2026-06-02 18:40:25.966388817 +0000 UTC m=+40.778851627" watchObservedRunningTime="2026-06-02 18:40:25.96652458 +0000 UTC m=+40.778987394" Jun 02 18:40:26.858347 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:26.858312 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:26.858391 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:26.858425 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:26.858457 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:26.858479 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:26.858521 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:26.858543 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:34.858522504 +0000 UTC m=+49.670985296 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:26.858550 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:26.858559 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:34.858550869 +0000 UTC m=+49.671013658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:40:26.858626 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:26.858596 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:34.858581821 +0000 UTC m=+49.671044619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:40:28.950992 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:28.950954 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2ltqf" event={"ID":"f7a3402c-71c0-4f56-9136-99d51e043c53","Type":"ContainerStarted","Data":"242433f9af6baca900d17c36ad1e4e942cbe040d469d0a7a63932ab590150749"} Jun 02 18:40:34.920412 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:34.920381 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:34.920412 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:34.920417 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:34.920471 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:34.920540 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:34.920598 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:34.920629 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:50.920607987 +0000 UTC m=+65.733070794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:34.920549 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:34.920645 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:34.920658 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:40:50.920641823 +0000 UTC m=+65.733104623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:40:34.920903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:34.920685 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:40:50.920675624 +0000 UTC m=+65.733138424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:40:46.925260 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:46.925232 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-86wdb" Jun 02 18:40:46.954114 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:46.954067 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2ltqf" podStartSLOduration=52.652063898 podStartE2EDuration="57.954054398s" podCreationTimestamp="2026-06-02 18:39:49 +0000 UTC" firstStartedPulling="2026-06-02 18:40:22.933517892 +0000 UTC m=+37.745980681" lastFinishedPulling="2026-06-02 18:40:28.235508377 +0000 UTC m=+43.047971181" observedRunningTime="2026-06-02 18:40:28.965749192 +0000 UTC m=+43.778212004" watchObservedRunningTime="2026-06-02 18:40:46.954054398 +0000 UTC m=+61.766517242" Jun 02 18:40:50.434298 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.434255 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:40:50.437328 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.437310 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 18:40:50.444800 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.444783 2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 18:40:50.444879 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.444833 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs podName:a8ce9161-c49b-4a7c-af89-1294da53da1d nodeName:}" failed. No retries permitted until 2026-06-02 18:41:54.44481834 +0000 UTC m=+129.257281128 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs") pod "network-metrics-daemon-tbm7r" (UID: "a8ce9161-c49b-4a7c-af89-1294da53da1d") : secret "metrics-daemon-secret" not found Jun 02 18:40:50.535576 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.535554 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:50.538493 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.538473 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 18:40:50.548778 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.548754 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 18:40:50.560100 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.560075 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwd8v\" (UniqueName: \"kubernetes.io/projected/743f6854-f098-4c5d-9fab-40fc05cb3b6e-kube-api-access-rwd8v\") pod \"network-check-target-h75lh\" (UID: \"743f6854-f098-4c5d-9fab-40fc05cb3b6e\") " pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:50.721203 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.721105 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6lfr\"" Jun 02 18:40:50.728508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.728492 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:50.862140 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.862108 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h75lh"] Jun 02 18:40:50.865371 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:40:50.865343 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743f6854_f098_4c5d_9fab_40fc05cb3b6e.slice/crio-3e25c6a5f2043c40019c584bd68708437220faf9f4f411e94ec874eefe584666 WatchSource:0}: Error finding container 3e25c6a5f2043c40019c584bd68708437220faf9f4f411e94ec874eefe584666: Status 404 returned error can't find the container with id 3e25c6a5f2043c40019c584bd68708437220faf9f4f411e94ec874eefe584666 Jun 02 18:40:50.937934 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.937906 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:40:50.938074 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.937947 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:40:50.938074 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.937965 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:40:50.938144 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.938069 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:40:50.938144 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.938122 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:22.938109043 +0000 UTC m=+97.750571838 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:40:50.938234 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.938069 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:40:50.938234 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.938070 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:40:50.938234 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.938205 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:40:50.938324 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.938243 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:41:22.93823034 +0000 UTC m=+97.750693134 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:40:50.938324 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:40:50.938264 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:22.938255414 +0000 UTC m=+97.750718205 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:40:50.992732 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:50.992654 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h75lh" event={"ID":"743f6854-f098-4c5d-9fab-40fc05cb3b6e","Type":"ContainerStarted","Data":"3e25c6a5f2043c40019c584bd68708437220faf9f4f411e94ec874eefe584666"} Jun 02 18:40:55.001094 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:55.001011 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h75lh" event={"ID":"743f6854-f098-4c5d-9fab-40fc05cb3b6e","Type":"ContainerStarted","Data":"d0dbc8d69d41289ec59c8607c0fed65beb6bb49898a4cd26bbea1e046ca8daaa"} Jun 02 18:40:55.001460 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:55.001143 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:40:55.017594 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:40:55.017549 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h75lh" podStartSLOduration=65.277259728 podStartE2EDuration="1m9.017535497s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="2026-06-02 18:40:50.86724319 +0000 UTC m=+65.679705979" lastFinishedPulling="2026-06-02 18:40:54.607518954 +0000 UTC m=+69.419981748" observedRunningTime="2026-06-02 18:40:55.016863583 +0000 UTC m=+69.829326395" watchObservedRunningTime="2026-06-02 18:40:55.017535497 +0000 UTC m=+69.829998345" Jun 02 18:41:22.978961 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:22.978810 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:41:22.978961 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:22.978880 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:22.978968 2567 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:22.978988 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:22.979040 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert podName:7019a38a-dfac-4478-8411-b7bca7218343 nodeName:}" failed. No retries permitted until 2026-06-02 18:42:26.979021335 +0000 UTC m=+161.791484124 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert") pod "ingress-canary-bjgwr" (UID: "7019a38a-dfac-4478-8411-b7bca7218343") : secret "canary-serving-cert" not found Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:22.978966 2567 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:22.979069 2567 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-946d6d6c-n8k69: secret "image-registry-tls" not found Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:22.979089 2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:22.979140 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls podName:75422cdb-a567-401c-8061-f891ec6b908f nodeName:}" failed. No retries permitted until 2026-06-02 18:42:26.979123792 +0000 UTC m=+161.791586586 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls") pod "image-registry-946d6d6c-n8k69" (UID: "75422cdb-a567-401c-8061-f891ec6b908f") : secret "image-registry-tls" not found Jun 02 18:41:22.979566 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:22.979153 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls podName:b3284f7e-a49f-4653-9f96-c06804b34f09 nodeName:}" failed. No retries permitted until 2026-06-02 18:42:26.979147082 +0000 UTC m=+161.791609871 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls") pod "dns-default-vj5lg" (UID: "b3284f7e-a49f-4653-9f96-c06804b34f09") : secret "dns-default-metrics-tls" not found Jun 02 18:41:26.005778 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:26.005747 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h75lh" Jun 02 18:41:36.791771 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.791734 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c"] Jun 02 18:41:36.794481 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.794465 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:36.797104 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.797074 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:41:36.797255 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.797076 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 02 18:41:36.798445 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.798422 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 02 18:41:36.798558 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.798471 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qt88p\"" Jun 02 18:41:36.803420 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.803397 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c"] Jun 02 18:41:36.878698 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.878664 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqj4q\" (UniqueName: \"kubernetes.io/projected/19f2bd02-572e-4135-885c-31cde560be88-kube-api-access-xqj4q\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:36.878850 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.878705 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:36.909702 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.909672 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-46f7w"] Jun 02 18:41:36.911444 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.911427 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq"] Jun 02 18:41:36.911607 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.911589 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:36.913296 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.913279 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-87c65c465-xbm49"] Jun 02 18:41:36.913430 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.913416 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:36.914313 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.914292 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 02 18:41:36.914913 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.914614 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 02 18:41:36.915099 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.914985 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:36.915099 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.915073 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bnsh5\"" Jun 02 18:41:36.915276 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.915236 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:41:36.915699 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.915674 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 02 18:41:36.915984 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.915962 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 18:41:36.917630 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.917606 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 18:41:36.918592 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.918571 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kww9z\"" Jun 02 18:41:36.918878 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.918860 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 02 18:41:36.919029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.919012 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 02 18:41:36.919273 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.919256 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 02 18:41:36.919750 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.919266 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 18:41:36.920069 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.919784 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 02 18:41:36.920486 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.920468 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 18:41:36.920714 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.920694 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lqmf2\"" Jun 02 18:41:36.920783 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.920756 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 02 18:41:36.920870 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.920846 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 02 18:41:36.923967 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.923943 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-46f7w"] Jun 02 18:41:36.924575 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.924554 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 02 18:41:36.926693 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.926675 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-87c65c465-xbm49"] Jun 02 18:41:36.938448 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.938423 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq"] Jun 02 18:41:36.979239 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979212 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-config\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:36.979349 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979246 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:36.979349 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979280 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:36.979349 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979342 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6mt\" (UniqueName: \"kubernetes.io/projected/4346b2eb-596b-4b3f-a08a-dd6833c46230-kube-api-access-xd6mt\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:36.979471 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979369 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqj4q\" (UniqueName: \"kubernetes.io/projected/19f2bd02-572e-4135-885c-31cde560be88-kube-api-access-xqj4q\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:36.979471 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979386 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-stats-auth\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:36.979471 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979404 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:36.979471 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979428 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:36.979471 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:36.979462 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 18:41:36.979695 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979502 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcl47\" (UniqueName: \"kubernetes.io/projected/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-kube-api-access-fcl47\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:36.979695 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:36.979571 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls podName:19f2bd02-572e-4135-885c-31cde560be88 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:37.479551397 +0000 UTC m=+112.292014198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jx74c" (UID: "19f2bd02-572e-4135-885c-31cde560be88") : secret "samples-operator-tls" not found Jun 02 18:41:36.979695 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979626 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:36.979832 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979696 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-default-certificate\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:36.979832 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979760 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-trusted-ca\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:36.979832 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k45tl\" (UniqueName: \"kubernetes.io/projected/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-kube-api-access-k45tl\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:36.979983 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.979873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-serving-cert\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:36.987795 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:36.987770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqj4q\" (UniqueName: \"kubernetes.io/projected/19f2bd02-572e-4135-885c-31cde560be88-kube-api-access-xqj4q\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:37.080741 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080657 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-config\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.080741 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080709 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.080940 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080764 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6mt\" (UniqueName: \"kubernetes.io/projected/4346b2eb-596b-4b3f-a08a-dd6833c46230-kube-api-access-xd6mt\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.080940 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080791 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-stats-auth\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.080940 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080818 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:37.080940 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080842 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.080940 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080869 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcl47\" (UniqueName: \"kubernetes.io/projected/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-kube-api-access-fcl47\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.080940 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080894 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:37.080940 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.080929 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:37.580907544 +0000 UTC m=+112.393370332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : configmap references non-existent config key: service-ca.crt Jun 02 18:41:37.081327 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.080961 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-default-certificate\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.081327 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.080986 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 18:41:37.081327 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.081014 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-trusted-ca\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.081327 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.081052 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:37.581034796 +0000 UTC m=+112.393497602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : secret "router-metrics-certs-default" not found Jun 02 18:41:37.081327 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.081078 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k45tl\" (UniqueName: \"kubernetes.io/projected/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-kube-api-access-k45tl\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:37.081327 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.081123 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-serving-cert\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.081327 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.081327 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:37.081680 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.081393 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls podName:f9ef6220-80c6-4230-9e2c-66b89b8eed9f nodeName:}" failed. No retries permitted until 2026-06-02 18:41:37.581376624 +0000 UTC m=+112.393839422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mcjsq" (UID: "f9ef6220-80c6-4230-9e2c-66b89b8eed9f") : secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:37.081680 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.081496 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-config\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.081680 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.081612 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:37.081914 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.081893 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-trusted-ca\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.083560 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.083532 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-serving-cert\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.083910 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.083890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-default-certificate\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.083955 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.083890 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-stats-auth\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.089850 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.089827 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcl47\" (UniqueName: \"kubernetes.io/projected/f7ac207f-754d-48e3-bebb-b16f0c4f16e3-kube-api-access-fcl47\") pod \"console-operator-86d7c6cc77-46f7w\" (UID: \"f7ac207f-754d-48e3-bebb-b16f0c4f16e3\") " pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.090596 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.090575 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k45tl\" (UniqueName: \"kubernetes.io/projected/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-kube-api-access-k45tl\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:37.090752 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.090735 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6mt\" (UniqueName: \"kubernetes.io/projected/4346b2eb-596b-4b3f-a08a-dd6833c46230-kube-api-access-xd6mt\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.225561 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.225536 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:37.343648 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.343583 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-46f7w"] Jun 02 18:41:37.347173 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:41:37.347148 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ac207f_754d_48e3_bebb_b16f0c4f16e3.slice/crio-3e1d74f0cc033dd8baa97af4ba47b20580ca11298668b61e8df418947eadebfb WatchSource:0}: Error finding container 3e1d74f0cc033dd8baa97af4ba47b20580ca11298668b61e8df418947eadebfb: Status 404 returned error can't find the container with id 3e1d74f0cc033dd8baa97af4ba47b20580ca11298668b61e8df418947eadebfb Jun 02 18:41:37.485566 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.485534 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:37.485692 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.485674 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 18:41:37.485741 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.485732 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls podName:19f2bd02-572e-4135-885c-31cde560be88 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:38.485718225 +0000 UTC m=+113.298181014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jx74c" (UID: "19f2bd02-572e-4135-885c-31cde560be88") : secret "samples-operator-tls" not found Jun 02 18:41:37.586682 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.586641 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.586837 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.586704 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:37.586837 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:37.586725 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:37.586837 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.586804 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:38.586787662 +0000 UTC m=+113.399250454 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : configmap references non-existent config key: service-ca.crt Jun 02 18:41:37.586942 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.586846 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 18:41:37.586942 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.586888 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:38.586877564 +0000 UTC m=+113.399340353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : secret "router-metrics-certs-default" not found Jun 02 18:41:37.586942 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.586847 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:37.586942 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:37.586917 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls podName:f9ef6220-80c6-4230-9e2c-66b89b8eed9f nodeName:}" failed. No retries permitted until 2026-06-02 18:41:38.586909482 +0000 UTC m=+113.399372271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mcjsq" (UID: "f9ef6220-80c6-4230-9e2c-66b89b8eed9f") : secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:38.081332 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:38.081300 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" event={"ID":"f7ac207f-754d-48e3-bebb-b16f0c4f16e3","Type":"ContainerStarted","Data":"3e1d74f0cc033dd8baa97af4ba47b20580ca11298668b61e8df418947eadebfb"} Jun 02 18:41:38.494650 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:38.494614 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:38.494839 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:38.494793 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 18:41:38.494909 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:38.494873 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls podName:19f2bd02-572e-4135-885c-31cde560be88 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:40.494851936 +0000 UTC m=+115.307314729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jx74c" (UID: "19f2bd02-572e-4135-885c-31cde560be88") : secret "samples-operator-tls" not found Jun 02 18:41:38.595960 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:38.595921 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:38.596137 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:38.595993 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:38.596137 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:38.596014 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:38.596137 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:38.596055 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:40.59603623 +0000 UTC m=+115.408499018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : configmap references non-existent config key: service-ca.crt Jun 02 18:41:38.596137 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:38.596102 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 18:41:38.596386 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:38.596146 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:40.596130634 +0000 UTC m=+115.408593424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : secret "router-metrics-certs-default" not found Jun 02 18:41:38.596386 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:38.596176 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:38.596386 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:38.596243 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls podName:f9ef6220-80c6-4230-9e2c-66b89b8eed9f nodeName:}" failed. No retries permitted until 2026-06-02 18:41:40.596230206 +0000 UTC m=+115.408693011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mcjsq" (UID: "f9ef6220-80c6-4230-9e2c-66b89b8eed9f") : secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:40.086872 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.086840 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/0.log" Jun 02 18:41:40.087304 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.086882 2567 generic.go:358] "Generic (PLEG): container finished" podID="f7ac207f-754d-48e3-bebb-b16f0c4f16e3" containerID="0009462fd91f8a5e55e625c5643f00c90a204ce84b075a05647909dc3ac25171" exitCode=255 Jun 02 18:41:40.087304 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.086914 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" event={"ID":"f7ac207f-754d-48e3-bebb-b16f0c4f16e3","Type":"ContainerDied","Data":"0009462fd91f8a5e55e625c5643f00c90a204ce84b075a05647909dc3ac25171"} Jun 02 18:41:40.087304 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.087201 2567 scope.go:117] "RemoveContainer" containerID="0009462fd91f8a5e55e625c5643f00c90a204ce84b075a05647909dc3ac25171" Jun 02 18:41:40.512023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.511967 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:40.512248 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:40.512125 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 18:41:40.512248 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:40.512231 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls podName:19f2bd02-572e-4135-885c-31cde560be88 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:44.512212428 +0000 UTC m=+119.324675221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jx74c" (UID: "19f2bd02-572e-4135-885c-31cde560be88") : secret "samples-operator-tls" not found Jun 02 18:41:40.612851 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.612808 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:40.613045 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.612873 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:40.613045 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:40.612892 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:40.613045 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:40.612979 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 18:41:40.613045 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:40.613000 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:44.612978499 +0000 UTC m=+119.425441289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : configmap references non-existent config key: service-ca.crt Jun 02 18:41:40.613045 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:40.613018 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:40.613045 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:40.613027 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:44.613019109 +0000 UTC m=+119.425481899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : secret "router-metrics-certs-default" not found Jun 02 18:41:40.613316 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:40.613071 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls podName:f9ef6220-80c6-4230-9e2c-66b89b8eed9f nodeName:}" failed. No retries permitted until 2026-06-02 18:41:44.613058511 +0000 UTC m=+119.425521304 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mcjsq" (UID: "f9ef6220-80c6-4230-9e2c-66b89b8eed9f") : secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:41.089725 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:41.089700 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:41:41.090120 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:41.090079 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/0.log" Jun 02 18:41:41.090172 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:41.090121 2567 generic.go:358] "Generic (PLEG): container finished" podID="f7ac207f-754d-48e3-bebb-b16f0c4f16e3" containerID="bfd3ca0cfa7f025816d2e2761c78b680218db247e869f6711ff694a04f1dd05f" exitCode=255 Jun 02 18:41:41.090172 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:41.090153 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" event={"ID":"f7ac207f-754d-48e3-bebb-b16f0c4f16e3","Type":"ContainerDied","Data":"bfd3ca0cfa7f025816d2e2761c78b680218db247e869f6711ff694a04f1dd05f"} Jun 02 18:41:41.090349 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:41.090220 2567 scope.go:117] "RemoveContainer" containerID="0009462fd91f8a5e55e625c5643f00c90a204ce84b075a05647909dc3ac25171" Jun 02 18:41:41.090501 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:41.090487 2567 scope.go:117] "RemoveContainer" containerID="bfd3ca0cfa7f025816d2e2761c78b680218db247e869f6711ff694a04f1dd05f" Jun 02 18:41:41.090684 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:41.090665 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-46f7w_openshift-console-operator(f7ac207f-754d-48e3-bebb-b16f0c4f16e3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" podUID="f7ac207f-754d-48e3-bebb-b16f0c4f16e3" Jun 02 18:41:42.092800 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.092772 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:41:42.093287 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.093142 2567 scope.go:117] "RemoveContainer" containerID="bfd3ca0cfa7f025816d2e2761c78b680218db247e869f6711ff694a04f1dd05f" Jun 02 18:41:42.093373 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:42.093355 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-46f7w_openshift-console-operator(f7ac207f-754d-48e3-bebb-b16f0c4f16e3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" podUID="f7ac207f-754d-48e3-bebb-b16f0c4f16e3" Jun 02 18:41:42.225336 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.225298 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs"] Jun 02 18:41:42.229043 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.229024 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" Jun 02 18:41:42.232088 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.232053 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-d6srk\"" Jun 02 18:41:42.232244 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.232093 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 02 18:41:42.232244 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.232094 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 02 18:41:42.237496 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.237474 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs"] Jun 02 18:41:42.327340 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.327306 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqx6f\" (UniqueName: \"kubernetes.io/projected/262fca87-d441-4d5a-abe0-dc91d3ad252d-kube-api-access-bqx6f\") pod \"migrator-96c6f749-g4wxs\" (UID: \"262fca87-d441-4d5a-abe0-dc91d3ad252d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" Jun 02 18:41:42.427936 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.427902 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqx6f\" (UniqueName: \"kubernetes.io/projected/262fca87-d441-4d5a-abe0-dc91d3ad252d-kube-api-access-bqx6f\") pod \"migrator-96c6f749-g4wxs\" (UID: \"262fca87-d441-4d5a-abe0-dc91d3ad252d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" Jun 02 18:41:42.438416 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.438389 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqx6f\" (UniqueName: \"kubernetes.io/projected/262fca87-d441-4d5a-abe0-dc91d3ad252d-kube-api-access-bqx6f\") pod \"migrator-96c6f749-g4wxs\" (UID: \"262fca87-d441-4d5a-abe0-dc91d3ad252d\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" Jun 02 18:41:42.537669 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.537645 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" Jun 02 18:41:42.651327 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:42.651297 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs"] Jun 02 18:41:42.654296 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:41:42.654263 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod262fca87_d441_4d5a_abe0_dc91d3ad252d.slice/crio-40f8f598d6d9de5f1492cdd9c3347ef480598233820236c83b5d689ba7fb35a6 WatchSource:0}: Error finding container 40f8f598d6d9de5f1492cdd9c3347ef480598233820236c83b5d689ba7fb35a6: Status 404 returned error can't find the container with id 40f8f598d6d9de5f1492cdd9c3347ef480598233820236c83b5d689ba7fb35a6 Jun 02 18:41:43.096175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:43.096133 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" event={"ID":"262fca87-d441-4d5a-abe0-dc91d3ad252d","Type":"ContainerStarted","Data":"40f8f598d6d9de5f1492cdd9c3347ef480598233820236c83b5d689ba7fb35a6"} Jun 02 18:41:43.989163 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:43.989130 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wpp2r_154022e6-248f-4861-b053-a9994a9e9a30/dns-node-resolver/0.log" Jun 02 18:41:44.545448 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:44.545414 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:44.545825 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:44.545528 2567 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 02 18:41:44.545825 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:44.545581 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls podName:19f2bd02-572e-4135-885c-31cde560be88 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:52.545565015 +0000 UTC m=+127.358027807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jx74c" (UID: "19f2bd02-572e-4135-885c-31cde560be88") : secret "samples-operator-tls" not found Jun 02 18:41:44.645877 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:44.645844 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:44.646034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:44.645898 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:44.646034 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:44.645917 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:44.646034 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:44.646004 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:52.645984117 +0000 UTC m=+127.458446920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : configmap references non-existent config key: service-ca.crt Jun 02 18:41:44.646034 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:44.646032 2567 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 02 18:41:44.646212 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:44.646043 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:44.646212 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:44.646075 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs podName:4346b2eb-596b-4b3f-a08a-dd6833c46230 nodeName:}" failed. No retries permitted until 2026-06-02 18:41:52.646063488 +0000 UTC m=+127.458526277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs") pod "router-default-87c65c465-xbm49" (UID: "4346b2eb-596b-4b3f-a08a-dd6833c46230") : secret "router-metrics-certs-default" not found Jun 02 18:41:44.646212 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:44.646087 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls podName:f9ef6220-80c6-4230-9e2c-66b89b8eed9f nodeName:}" failed. No retries permitted until 2026-06-02 18:41:52.646081501 +0000 UTC m=+127.458544290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mcjsq" (UID: "f9ef6220-80c6-4230-9e2c-66b89b8eed9f") : secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:44.788985 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:44.788963 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hqr7x_a5892822-06c6-452e-ad71-7aba446f1618/node-ca/0.log" Jun 02 18:41:45.102269 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:45.102236 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" event={"ID":"262fca87-d441-4d5a-abe0-dc91d3ad252d","Type":"ContainerStarted","Data":"e84aaa83f31346f692700c108e3b740fbae66d11d62b60a42300a954b08f57e3"} Jun 02 18:41:45.102269 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:45.102273 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" event={"ID":"262fca87-d441-4d5a-abe0-dc91d3ad252d","Type":"ContainerStarted","Data":"783c925499c0b3f2afa2c071c7434e5ba36f771c45cfd843ae0420acbeec92e2"} Jun 02 18:41:45.124444 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:45.124397 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-g4wxs" podStartSLOduration=1.7299031660000002 podStartE2EDuration="3.124379923s" podCreationTimestamp="2026-06-02 18:41:42 +0000 UTC" firstStartedPulling="2026-06-02 18:41:42.656153799 +0000 UTC m=+117.468616591" lastFinishedPulling="2026-06-02 18:41:44.050630554 +0000 UTC m=+118.863093348" observedRunningTime="2026-06-02 18:41:45.122636122 +0000 UTC m=+119.935098944" watchObservedRunningTime="2026-06-02 18:41:45.124379923 +0000 UTC m=+119.936842768" Jun 02 18:41:47.225705 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:47.225667 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:47.226088 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:47.225802 2567 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:41:47.226088 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:47.226071 2567 scope.go:117] "RemoveContainer" containerID="bfd3ca0cfa7f025816d2e2761c78b680218db247e869f6711ff694a04f1dd05f" Jun 02 18:41:47.226281 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:47.226263 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-46f7w_openshift-console-operator(f7ac207f-754d-48e3-bebb-b16f0c4f16e3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" podUID="f7ac207f-754d-48e3-bebb-b16f0c4f16e3" Jun 02 18:41:48.108254 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:48.108226 2567 scope.go:117] "RemoveContainer" containerID="bfd3ca0cfa7f025816d2e2761c78b680218db247e869f6711ff694a04f1dd05f" Jun 02 18:41:48.108417 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:48.108381 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-46f7w_openshift-console-operator(f7ac207f-754d-48e3-bebb-b16f0c4f16e3)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" podUID="f7ac207f-754d-48e3-bebb-b16f0c4f16e3" Jun 02 18:41:52.612355 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.612319 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:52.614627 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.614606 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/19f2bd02-572e-4135-885c-31cde560be88-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jx74c\" (UID: \"19f2bd02-572e-4135-885c-31cde560be88\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:52.705915 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.705890 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qt88p\"" Jun 02 18:41:52.713273 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.713256 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" Jun 02 18:41:52.713422 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.713407 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:52.713470 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.713451 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:41:52.713504 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.713476 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:52.713593 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:52.713573 2567 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:52.713657 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:41:52.713645 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls podName:f9ef6220-80c6-4230-9e2c-66b89b8eed9f nodeName:}" failed. No retries permitted until 2026-06-02 18:42:08.713626114 +0000 UTC m=+143.526088904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-mcjsq" (UID: "f9ef6220-80c6-4230-9e2c-66b89b8eed9f") : secret "cluster-monitoring-operator-tls" not found Jun 02 18:41:52.714057 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.714040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4346b2eb-596b-4b3f-a08a-dd6833c46230-service-ca-bundle\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:52.716144 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.716127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4346b2eb-596b-4b3f-a08a-dd6833c46230-metrics-certs\") pod \"router-default-87c65c465-xbm49\" (UID: \"4346b2eb-596b-4b3f-a08a-dd6833c46230\") " pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:52.830344 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.830313 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c"] Jun 02 18:41:52.837921 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.837898 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kww9z\"" Jun 02 18:41:52.846254 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.846239 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:52.965996 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:52.965807 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-87c65c465-xbm49"] Jun 02 18:41:52.968424 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:41:52.968389 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4346b2eb_596b_4b3f_a08a_dd6833c46230.slice/crio-763f8e8dccc10b07a277757d148c0f60323666827b8932ebeecb4f8090644e56 WatchSource:0}: Error finding container 763f8e8dccc10b07a277757d148c0f60323666827b8932ebeecb4f8090644e56: Status 404 returned error can't find the container with id 763f8e8dccc10b07a277757d148c0f60323666827b8932ebeecb4f8090644e56 Jun 02 18:41:53.119624 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:53.119588 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-87c65c465-xbm49" event={"ID":"4346b2eb-596b-4b3f-a08a-dd6833c46230","Type":"ContainerStarted","Data":"f63c73c384a13f667a113cdff5c6e6e88ff39fd16b35d3a887f4a8541f2863f5"} Jun 02 18:41:53.119624 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:53.119626 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-87c65c465-xbm49" event={"ID":"4346b2eb-596b-4b3f-a08a-dd6833c46230","Type":"ContainerStarted","Data":"763f8e8dccc10b07a277757d148c0f60323666827b8932ebeecb4f8090644e56"} Jun 02 18:41:53.120590 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:53.120563 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" event={"ID":"19f2bd02-572e-4135-885c-31cde560be88","Type":"ContainerStarted","Data":"924381c4703bb0ed29138aa87206c0d8ac86b5f5ee44e755a3340b61f5a42fcb"} Jun 02 18:41:53.142247 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:53.140104 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-87c65c465-xbm49" podStartSLOduration=17.140080061 podStartE2EDuration="17.140080061s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:41:53.138857822 +0000 UTC m=+127.951320639" watchObservedRunningTime="2026-06-02 18:41:53.140080061 +0000 UTC m=+127.952542873" Jun 02 18:41:53.846923 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:53.846890 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:53.849835 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:53.849813 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:54.123693 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:54.123614 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:54.124870 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:54.124847 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-87c65c465-xbm49" Jun 02 18:41:54.527595 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:54.527517 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:41:54.529794 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:54.529772 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8ce9161-c49b-4a7c-af89-1294da53da1d-metrics-certs\") pod \"network-metrics-daemon-tbm7r\" (UID: \"a8ce9161-c49b-4a7c-af89-1294da53da1d\") " pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:41:54.629356 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:54.629326 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jgbvm\"" Jun 02 18:41:54.636766 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:54.636741 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbm7r" Jun 02 18:41:55.127203 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:55.127161 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" event={"ID":"19f2bd02-572e-4135-885c-31cde560be88","Type":"ContainerStarted","Data":"f94bbd3813a77fa7b25e5063150240882ce1906cb20fd00d7ff377845761b2cc"} Jun 02 18:41:55.130747 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:55.130688 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbm7r"] Jun 02 18:41:55.134807 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:41:55.134785 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ce9161_c49b_4a7c_af89_1294da53da1d.slice/crio-3b0b9d7672f5ac161d206507e963534ccc06f4c0912be8bc79103b6ece8463d4 WatchSource:0}: Error finding container 3b0b9d7672f5ac161d206507e963534ccc06f4c0912be8bc79103b6ece8463d4: Status 404 returned error can't find the container with id 3b0b9d7672f5ac161d206507e963534ccc06f4c0912be8bc79103b6ece8463d4 Jun 02 18:41:56.131108 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:56.130981 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" event={"ID":"19f2bd02-572e-4135-885c-31cde560be88","Type":"ContainerStarted","Data":"b2e245cb7af46f265a4cdac93bb7a8a97e15d43b4eb0247834c52ca9ad5fcd2d"} Jun 02 18:41:56.131973 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:56.131948 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbm7r" event={"ID":"a8ce9161-c49b-4a7c-af89-1294da53da1d","Type":"ContainerStarted","Data":"3b0b9d7672f5ac161d206507e963534ccc06f4c0912be8bc79103b6ece8463d4"} Jun 02 18:41:56.146905 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:56.146859 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jx74c" podStartSLOduration=17.9644169 podStartE2EDuration="20.146842768s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="2026-06-02 18:41:52.874128692 +0000 UTC m=+127.686591486" lastFinishedPulling="2026-06-02 18:41:55.056554551 +0000 UTC m=+129.869017354" observedRunningTime="2026-06-02 18:41:56.14613112 +0000 UTC m=+130.958593945" watchObservedRunningTime="2026-06-02 18:41:56.146842768 +0000 UTC m=+130.959305580" Jun 02 18:41:57.136012 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:57.135975 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbm7r" event={"ID":"a8ce9161-c49b-4a7c-af89-1294da53da1d","Type":"ContainerStarted","Data":"e6e81a62e2dd79d54a06efaf6a5db687897ac2b8997e661103525e023693a59b"} Jun 02 18:41:57.136012 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:57.136013 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbm7r" event={"ID":"a8ce9161-c49b-4a7c-af89-1294da53da1d","Type":"ContainerStarted","Data":"5562d629cf0c70f1f73249f6ff191173a725ffab2d4f24c7566b45be6291545a"} Jun 02 18:41:57.154478 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:41:57.154430 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tbm7r" podStartSLOduration=130.160801423 podStartE2EDuration="2m11.154416528s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="2026-06-02 18:41:55.136893845 +0000 UTC m=+129.949356633" lastFinishedPulling="2026-06-02 18:41:56.130508932 +0000 UTC m=+130.942971738" observedRunningTime="2026-06-02 18:41:57.153901509 +0000 UTC m=+131.966364336" watchObservedRunningTime="2026-06-02 18:41:57.154416528 +0000 UTC m=+131.966879339" Jun 02 18:42:01.706674 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:01.706645 2567 scope.go:117] "RemoveContainer" containerID="bfd3ca0cfa7f025816d2e2761c78b680218db247e869f6711ff694a04f1dd05f" Jun 02 18:42:02.153560 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:02.153533 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:42:02.153732 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:02.153599 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" event={"ID":"f7ac207f-754d-48e3-bebb-b16f0c4f16e3","Type":"ContainerStarted","Data":"ed8ad84d009f670a65dc80afea785ada7a82adff1d1aec06dba40fd0aeec6b78"} Jun 02 18:42:02.153923 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:02.153902 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:42:02.172107 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:02.172064 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" podStartSLOduration=24.258125585 podStartE2EDuration="26.172053431s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="2026-06-02 18:41:37.348749344 +0000 UTC m=+112.161212134" lastFinishedPulling="2026-06-02 18:41:39.262677188 +0000 UTC m=+114.075139980" observedRunningTime="2026-06-02 18:42:02.170662566 +0000 UTC m=+136.983125389" watchObservedRunningTime="2026-06-02 18:42:02.172053431 +0000 UTC m=+136.984516243" Jun 02 18:42:02.468951 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:02.468875 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-46f7w" Jun 02 18:42:07.526258 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.526227 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz"] Jun 02 18:42:07.528893 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.528873 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.532265 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.532245 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 02 18:42:07.532346 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.532269 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 02 18:42:07.533712 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.533693 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-tjk67\"" Jun 02 18:42:07.537873 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.537849 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz"] Jun 02 18:42:07.621835 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.621796 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-c65b8dc4b-tg654"] Jun 02 18:42:07.624815 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.624793 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-tg654" Jun 02 18:42:07.627789 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.627770 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7bbe34e-7452-40fb-aca6-5303f3cdfeb5-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mj6cz\" (UID: \"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.627892 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.627841 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7bbe34e-7452-40fb-aca6-5303f3cdfeb5-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-mj6cz\" (UID: \"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.628655 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.628634 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7h6vb\"" Jun 02 18:42:07.628755 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.628633 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 02 18:42:07.628755 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.628633 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 02 18:42:07.636543 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.636520 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-tg654"] Jun 02 18:42:07.642455 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.642430 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bqz9r"] Jun 02 18:42:07.645874 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.645852 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.649627 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.649407 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 18:42:07.649837 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.649818 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 18:42:07.649948 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.649930 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wpbjj\"" Jun 02 18:42:07.650036 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.649981 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 18:42:07.651464 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.651445 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 18:42:07.664882 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.664858 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqz9r"] Jun 02 18:42:07.728861 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.728838 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7bbe34e-7452-40fb-aca6-5303f3cdfeb5-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-mj6cz\" (UID: \"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.728971 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.728888 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f128bee5-a1e3-4d8d-a833-a713d0dca597-crio-socket\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.729014 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.728997 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7bbe34e-7452-40fb-aca6-5303f3cdfeb5-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mj6cz\" (UID: \"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.729078 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.729064 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfjq4\" (UniqueName: \"kubernetes.io/projected/f128bee5-a1e3-4d8d-a833-a713d0dca597-kube-api-access-hfjq4\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.729112 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.729093 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llwcq\" (UniqueName: \"kubernetes.io/projected/df900abc-1db7-48a6-9c1a-db4c247f6158-kube-api-access-llwcq\") pod \"downloads-c65b8dc4b-tg654\" (UID: \"df900abc-1db7-48a6-9c1a-db4c247f6158\") " pod="openshift-console/downloads-c65b8dc4b-tg654" Jun 02 18:42:07.729161 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.729109 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f128bee5-a1e3-4d8d-a833-a713d0dca597-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.729161 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.729133 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f128bee5-a1e3-4d8d-a833-a713d0dca597-data-volume\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.729161 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.729152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f128bee5-a1e3-4d8d-a833-a713d0dca597-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.729567 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.729546 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e7bbe34e-7452-40fb-aca6-5303f3cdfeb5-nginx-conf\") pod \"networking-console-plugin-76c9bb5fdf-mj6cz\" (UID: \"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.731257 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.731240 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e7bbe34e-7452-40fb-aca6-5303f3cdfeb5-networking-console-plugin-cert\") pod \"networking-console-plugin-76c9bb5fdf-mj6cz\" (UID: \"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5\") " pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.830070 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830004 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjq4\" (UniqueName: \"kubernetes.io/projected/f128bee5-a1e3-4d8d-a833-a713d0dca597-kube-api-access-hfjq4\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.830070 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830039 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-llwcq\" (UniqueName: \"kubernetes.io/projected/df900abc-1db7-48a6-9c1a-db4c247f6158-kube-api-access-llwcq\") pod \"downloads-c65b8dc4b-tg654\" (UID: \"df900abc-1db7-48a6-9c1a-db4c247f6158\") " pod="openshift-console/downloads-c65b8dc4b-tg654" Jun 02 18:42:07.830070 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830065 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f128bee5-a1e3-4d8d-a833-a713d0dca597-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.830307 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830098 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f128bee5-a1e3-4d8d-a833-a713d0dca597-data-volume\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.830307 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830123 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f128bee5-a1e3-4d8d-a833-a713d0dca597-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.830307 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830222 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f128bee5-a1e3-4d8d-a833-a713d0dca597-crio-socket\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.830307 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830290 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f128bee5-a1e3-4d8d-a833-a713d0dca597-crio-socket\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.830533 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f128bee5-a1e3-4d8d-a833-a713d0dca597-data-volume\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.830910 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.830892 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f128bee5-a1e3-4d8d-a833-a713d0dca597-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.832352 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.832327 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f128bee5-a1e3-4d8d-a833-a713d0dca597-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.838246 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.838229 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" Jun 02 18:42:07.842929 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.842911 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfjq4\" (UniqueName: \"kubernetes.io/projected/f128bee5-a1e3-4d8d-a833-a713d0dca597-kube-api-access-hfjq4\") pod \"insights-runtime-extractor-bqz9r\" (UID: \"f128bee5-a1e3-4d8d-a833-a713d0dca597\") " pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:07.847233 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.847210 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llwcq\" (UniqueName: \"kubernetes.io/projected/df900abc-1db7-48a6-9c1a-db4c247f6158-kube-api-access-llwcq\") pod \"downloads-c65b8dc4b-tg654\" (UID: \"df900abc-1db7-48a6-9c1a-db4c247f6158\") " pod="openshift-console/downloads-c65b8dc4b-tg654" Jun 02 18:42:07.934558 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.934529 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-c65b8dc4b-tg654" Jun 02 18:42:07.955151 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.955129 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz"] Jun 02 18:42:07.956865 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:07.956843 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bbe34e_7452_40fb_aca6_5303f3cdfeb5.slice/crio-7bad34c38f6cd1a63a769a1d640d91672484c61c19cb32e5aadcbd847ef01baf WatchSource:0}: Error finding container 7bad34c38f6cd1a63a769a1d640d91672484c61c19cb32e5aadcbd847ef01baf: Status 404 returned error can't find the container with id 7bad34c38f6cd1a63a769a1d640d91672484c61c19cb32e5aadcbd847ef01baf Jun 02 18:42:07.956963 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:07.956951 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bqz9r" Jun 02 18:42:08.081806 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.081781 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-c65b8dc4b-tg654"] Jun 02 18:42:08.084120 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:08.084090 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf900abc_1db7_48a6_9c1a_db4c247f6158.slice/crio-51aff34b261f0734a644957c64084a8d70753a69075bffdb1884b94b23ef1ee5 WatchSource:0}: Error finding container 51aff34b261f0734a644957c64084a8d70753a69075bffdb1884b94b23ef1ee5: Status 404 returned error can't find the container with id 51aff34b261f0734a644957c64084a8d70753a69075bffdb1884b94b23ef1ee5 Jun 02 18:42:08.098837 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.098801 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bqz9r"] Jun 02 18:42:08.101734 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:08.101700 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf128bee5_a1e3_4d8d_a833_a713d0dca597.slice/crio-a1bfe23a4f797db578c26d8eddd64d7934fc443b0d84b7dcfc39b2fbc4528ce0 WatchSource:0}: Error finding container a1bfe23a4f797db578c26d8eddd64d7934fc443b0d84b7dcfc39b2fbc4528ce0: Status 404 returned error can't find the container with id a1bfe23a4f797db578c26d8eddd64d7934fc443b0d84b7dcfc39b2fbc4528ce0 Jun 02 18:42:08.173115 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.173089 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqz9r" event={"ID":"f128bee5-a1e3-4d8d-a833-a713d0dca597","Type":"ContainerStarted","Data":"14f79e5eec56d413cb30a94c5eee44015d15e80cbaf9c571481a8fdaeb2b9193"} Jun 02 18:42:08.173250 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.173126 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqz9r" event={"ID":"f128bee5-a1e3-4d8d-a833-a713d0dca597","Type":"ContainerStarted","Data":"a1bfe23a4f797db578c26d8eddd64d7934fc443b0d84b7dcfc39b2fbc4528ce0"} Jun 02 18:42:08.174285 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.174249 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-tg654" event={"ID":"df900abc-1db7-48a6-9c1a-db4c247f6158","Type":"ContainerStarted","Data":"51aff34b261f0734a644957c64084a8d70753a69075bffdb1884b94b23ef1ee5"} Jun 02 18:42:08.175604 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.175570 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" event={"ID":"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5","Type":"ContainerStarted","Data":"7bad34c38f6cd1a63a769a1d640d91672484c61c19cb32e5aadcbd847ef01baf"} Jun 02 18:42:08.737525 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.737485 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:42:08.740590 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:08.740553 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/f9ef6220-80c6-4230-9e2c-66b89b8eed9f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-mcjsq\" (UID: \"f9ef6220-80c6-4230-9e2c-66b89b8eed9f\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:42:09.033665 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:09.033586 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lqmf2\"" Jun 02 18:42:09.041370 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:09.041333 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" Jun 02 18:42:09.181245 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:09.181204 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqz9r" event={"ID":"f128bee5-a1e3-4d8d-a833-a713d0dca597","Type":"ContainerStarted","Data":"f00cbdab729fbafa66560a023c3c2c5ab16e86250f545e9770f36da682127f39"} Jun 02 18:42:09.423639 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:09.423606 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq"] Jun 02 18:42:09.426875 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:09.426846 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ef6220_80c6_4230_9e2c_66b89b8eed9f.slice/crio-403c54d90e03b745afb91d0d386f91f5c4626a07b96ddd92bff0727344784621 WatchSource:0}: Error finding container 403c54d90e03b745afb91d0d386f91f5c4626a07b96ddd92bff0727344784621: Status 404 returned error can't find the container with id 403c54d90e03b745afb91d0d386f91f5c4626a07b96ddd92bff0727344784621 Jun 02 18:42:10.185988 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:10.185953 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" event={"ID":"e7bbe34e-7452-40fb-aca6-5303f3cdfeb5","Type":"ContainerStarted","Data":"78da7318ff655ece75be05421e6df1f6afb572d1f5e973ad1d532d956e452ecc"} Jun 02 18:42:10.187982 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:10.187943 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" event={"ID":"f9ef6220-80c6-4230-9e2c-66b89b8eed9f","Type":"ContainerStarted","Data":"403c54d90e03b745afb91d0d386f91f5c4626a07b96ddd92bff0727344784621"} Jun 02 18:42:10.201372 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:10.200963 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-76c9bb5fdf-mj6cz" podStartSLOduration=1.8324792030000001 podStartE2EDuration="3.200945777s" podCreationTimestamp="2026-06-02 18:42:07 +0000 UTC" firstStartedPulling="2026-06-02 18:42:07.958610184 +0000 UTC m=+142.771072974" lastFinishedPulling="2026-06-02 18:42:09.32707676 +0000 UTC m=+144.139539548" observedRunningTime="2026-06-02 18:42:10.200588085 +0000 UTC m=+145.013050910" watchObservedRunningTime="2026-06-02 18:42:10.200945777 +0000 UTC m=+145.013408589" Jun 02 18:42:11.193545 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:11.193503 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bqz9r" event={"ID":"f128bee5-a1e3-4d8d-a833-a713d0dca597","Type":"ContainerStarted","Data":"7b27011912a42d15a5bfefc33689519a8e0d78638208186031c92ff5d400bbe0"} Jun 02 18:42:11.213430 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:11.213368 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bqz9r" podStartSLOduration=1.5997847790000002 podStartE2EDuration="4.213349778s" podCreationTimestamp="2026-06-02 18:42:07 +0000 UTC" firstStartedPulling="2026-06-02 18:42:08.150702518 +0000 UTC m=+142.963165308" lastFinishedPulling="2026-06-02 18:42:10.764267499 +0000 UTC m=+145.576730307" observedRunningTime="2026-06-02 18:42:11.210538208 +0000 UTC m=+146.023001036" watchObservedRunningTime="2026-06-02 18:42:11.213349778 +0000 UTC m=+146.025812591" Jun 02 18:42:12.198242 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.198208 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" event={"ID":"f9ef6220-80c6-4230-9e2c-66b89b8eed9f","Type":"ContainerStarted","Data":"b2df8bae91d95d6fecc51ebe5cf31caa8886b615951eb26d36cc96b6d154e435"} Jun 02 18:42:12.204515 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.204489 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh"] Jun 02 18:42:12.207514 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.207490 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" Jun 02 18:42:12.210208 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.210136 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 02 18:42:12.210329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.210263 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f8lnk\"" Jun 02 18:42:12.213313 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.213290 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh"] Jun 02 18:42:12.218872 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.218825 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-mcjsq" podStartSLOduration=33.951618479 podStartE2EDuration="36.218810937s" podCreationTimestamp="2026-06-02 18:41:36 +0000 UTC" firstStartedPulling="2026-06-02 18:42:09.42941628 +0000 UTC m=+144.241879074" lastFinishedPulling="2026-06-02 18:42:11.696608725 +0000 UTC m=+146.509071532" observedRunningTime="2026-06-02 18:42:12.218008614 +0000 UTC m=+147.030471426" watchObservedRunningTime="2026-06-02 18:42:12.218810937 +0000 UTC m=+147.031273749" Jun 02 18:42:12.371460 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.371428 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c68aff05-0ad8-48a7-b2b3-1a3376078586-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-fl4nh\" (UID: \"c68aff05-0ad8-48a7-b2b3-1a3376078586\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" Jun 02 18:42:12.472687 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.472602 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c68aff05-0ad8-48a7-b2b3-1a3376078586-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-fl4nh\" (UID: \"c68aff05-0ad8-48a7-b2b3-1a3376078586\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" Jun 02 18:42:12.475488 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.475461 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c68aff05-0ad8-48a7-b2b3-1a3376078586-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-fl4nh\" (UID: \"c68aff05-0ad8-48a7-b2b3-1a3376078586\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" Jun 02 18:42:12.521489 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.521462 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" Jun 02 18:42:12.672410 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:12.672377 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh"] Jun 02 18:42:12.674993 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:12.674962 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68aff05_0ad8_48a7_b2b3_1a3376078586.slice/crio-943bc38357786aa22099aeb3bc72ef19d12dbbe8d65733780501da1e466c00fd WatchSource:0}: Error finding container 943bc38357786aa22099aeb3bc72ef19d12dbbe8d65733780501da1e466c00fd: Status 404 returned error can't find the container with id 943bc38357786aa22099aeb3bc72ef19d12dbbe8d65733780501da1e466c00fd Jun 02 18:42:13.202697 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:13.202648 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" event={"ID":"c68aff05-0ad8-48a7-b2b3-1a3376078586","Type":"ContainerStarted","Data":"943bc38357786aa22099aeb3bc72ef19d12dbbe8d65733780501da1e466c00fd"} Jun 02 18:42:14.206752 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:14.206712 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" event={"ID":"c68aff05-0ad8-48a7-b2b3-1a3376078586","Type":"ContainerStarted","Data":"2f0121d572269b50e7f4e4d908e392e3eb6bf8d730b28c1dbd74f3d8da236b6e"} Jun 02 18:42:14.207198 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:14.207066 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" Jun 02 18:42:14.212600 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:14.212566 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" Jun 02 18:42:14.223390 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:14.223057 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-fl4nh" podStartSLOduration=1.100672168 podStartE2EDuration="2.22304291s" podCreationTimestamp="2026-06-02 18:42:12 +0000 UTC" firstStartedPulling="2026-06-02 18:42:12.677379907 +0000 UTC m=+147.489842699" lastFinishedPulling="2026-06-02 18:42:13.799750637 +0000 UTC m=+148.612213441" observedRunningTime="2026-06-02 18:42:14.222560846 +0000 UTC m=+149.035023657" watchObservedRunningTime="2026-06-02 18:42:14.22304291 +0000 UTC m=+149.035505723" Jun 02 18:42:15.264980 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.264949 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm"] Jun 02 18:42:15.268416 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.268395 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.271382 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.271213 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rwbzf\"" Jun 02 18:42:15.271382 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.271251 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 02 18:42:15.272860 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.272836 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 02 18:42:15.272956 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.272895 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 18:42:15.277279 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.277258 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm"] Jun 02 18:42:15.398290 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.398252 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b967646b-646e-40b0-99e9-9d7c42487661-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.398467 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.398313 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b967646b-646e-40b0-99e9-9d7c42487661-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.398467 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.398456 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b967646b-646e-40b0-99e9-9d7c42487661-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.398581 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.398481 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bthq\" (UniqueName: \"kubernetes.io/projected/b967646b-646e-40b0-99e9-9d7c42487661-kube-api-access-7bthq\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.499257 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.499225 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b967646b-646e-40b0-99e9-9d7c42487661-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.499257 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.499266 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bthq\" (UniqueName: \"kubernetes.io/projected/b967646b-646e-40b0-99e9-9d7c42487661-kube-api-access-7bthq\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.499508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.499391 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b967646b-646e-40b0-99e9-9d7c42487661-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.499508 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.499429 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b967646b-646e-40b0-99e9-9d7c42487661-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.500042 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.500017 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b967646b-646e-40b0-99e9-9d7c42487661-metrics-client-ca\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.502065 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.502040 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b967646b-646e-40b0-99e9-9d7c42487661-prometheus-operator-tls\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.502370 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.502348 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b967646b-646e-40b0-99e9-9d7c42487661-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.512626 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.512601 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bthq\" (UniqueName: \"kubernetes.io/projected/b967646b-646e-40b0-99e9-9d7c42487661-kube-api-access-7bthq\") pod \"prometheus-operator-658bcd8bdf-qswwm\" (UID: \"b967646b-646e-40b0-99e9-9d7c42487661\") " pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.580003 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.579938 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" Jun 02 18:42:15.713423 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:15.713364 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm"] Jun 02 18:42:15.716006 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:15.715978 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb967646b_646e_40b0_99e9_9d7c42487661.slice/crio-6b1812f6e2722ac60372f7920f0545ceba336a8a94fd7bc4a90943033416f0d4 WatchSource:0}: Error finding container 6b1812f6e2722ac60372f7920f0545ceba336a8a94fd7bc4a90943033416f0d4: Status 404 returned error can't find the container with id 6b1812f6e2722ac60372f7920f0545ceba336a8a94fd7bc4a90943033416f0d4 Jun 02 18:42:16.215107 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:16.215068 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" event={"ID":"b967646b-646e-40b0-99e9-9d7c42487661","Type":"ContainerStarted","Data":"6b1812f6e2722ac60372f7920f0545ceba336a8a94fd7bc4a90943033416f0d4"} Jun 02 18:42:17.219763 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:17.219731 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" event={"ID":"b967646b-646e-40b0-99e9-9d7c42487661","Type":"ContainerStarted","Data":"b9f400d33f99f294d477132abbdf48a6bb2f8c081ae6770f3477febcdae76e1a"} Jun 02 18:42:18.224799 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:18.224754 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" event={"ID":"b967646b-646e-40b0-99e9-9d7c42487661","Type":"ContainerStarted","Data":"a20d626094d08a417c9df0b8587b1754f0b616ccf8a32207c2303dd47b983c0a"} Jun 02 18:42:18.242751 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:18.242687 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-658bcd8bdf-qswwm" podStartSLOduration=1.893003443 podStartE2EDuration="3.24267342s" podCreationTimestamp="2026-06-02 18:42:15 +0000 UTC" firstStartedPulling="2026-06-02 18:42:15.718011027 +0000 UTC m=+150.530473816" lastFinishedPulling="2026-06-02 18:42:17.067681 +0000 UTC m=+151.880143793" observedRunningTime="2026-06-02 18:42:18.240253023 +0000 UTC m=+153.052715840" watchObservedRunningTime="2026-06-02 18:42:18.24267342 +0000 UTC m=+153.055136232" Jun 02 18:42:20.590975 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.590939 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-sxzhx"] Jun 02 18:42:20.597076 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.597051 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.599948 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.599926 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 02 18:42:20.600136 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.599947 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 02 18:42:20.600250 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.600164 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5g78d\"" Jun 02 18:42:20.602399 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.602379 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-sxzhx"] Jun 02 18:42:20.622463 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.622438 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-86cfd"] Jun 02 18:42:20.626412 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.626391 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.629538 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.629507 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 18:42:20.629869 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.629844 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-68kzm\"" Jun 02 18:42:20.629975 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.629904 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 18:42:20.632977 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.632925 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 18:42:20.642957 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.642934 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-wtmp\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643059 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.642979 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-tls\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643059 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643051 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1aac776-6b64-4a37-95ae-b226aa08c352-metrics-client-ca\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643155 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643085 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0469ee3a-543f-4a5f-b52f-c85f1a42579d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.643155 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643124 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-textfile\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643155 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643152 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw64p\" (UniqueName: \"kubernetes.io/projected/a1aac776-6b64-4a37-95ae-b226aa08c352-kube-api-access-qw64p\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643202 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv2pk\" (UniqueName: \"kubernetes.io/projected/0469ee3a-543f-4a5f-b52f-c85f1a42579d-kube-api-access-rv2pk\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.643343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643277 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.643343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643328 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.643529 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643380 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-root\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643529 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643408 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-sys\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.643529 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.643433 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-accelerators-collector-config\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744421 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744379 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qw64p\" (UniqueName: \"kubernetes.io/projected/a1aac776-6b64-4a37-95ae-b226aa08c352-kube-api-access-qw64p\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744611 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744441 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744611 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744470 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv2pk\" (UniqueName: \"kubernetes.io/projected/0469ee3a-543f-4a5f-b52f-c85f1a42579d-kube-api-access-rv2pk\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.744611 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744507 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.744611 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744539 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.744611 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744582 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-root\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744611 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744607 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-sys\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744633 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-accelerators-collector-config\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744695 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-wtmp\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744739 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-tls\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:42:20.744747 2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744770 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1aac776-6b64-4a37-95ae-b226aa08c352-metrics-client-ca\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744797 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0469ee3a-543f-4a5f-b52f-c85f1a42579d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:42:20.744826 2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-tls podName:0469ee3a-543f-4a5f-b52f-c85f1a42579d nodeName:}" failed. No retries permitted until 2026-06-02 18:42:21.24480461 +0000 UTC m=+156.057267403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-sxzhx" (UID: "0469ee3a-543f-4a5f-b52f-c85f1a42579d") : secret "openshift-state-metrics-tls" not found Jun 02 18:42:20.744931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.744878 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-textfile\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.745361 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.745168 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-textfile\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.745361 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.745191 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-wtmp\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.745464 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.745408 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-accelerators-collector-config\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.745519 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.745475 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-root\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.745519 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.745512 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0469ee3a-543f-4a5f-b52f-c85f1a42579d-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.745625 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.745518 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a1aac776-6b64-4a37-95ae-b226aa08c352-sys\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.745750 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.745698 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1aac776-6b64-4a37-95ae-b226aa08c352-metrics-client-ca\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.747663 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.747630 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.747932 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.747910 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a1aac776-6b64-4a37-95ae-b226aa08c352-node-exporter-tls\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.747932 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.747924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.754219 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.754160 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv2pk\" (UniqueName: \"kubernetes.io/projected/0469ee3a-543f-4a5f-b52f-c85f1a42579d-kube-api-access-rv2pk\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:20.756885 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.756860 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw64p\" (UniqueName: \"kubernetes.io/projected/a1aac776-6b64-4a37-95ae-b226aa08c352-kube-api-access-qw64p\") pod \"node-exporter-86cfd\" (UID: \"a1aac776-6b64-4a37-95ae-b226aa08c352\") " pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:20.937521 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:20.937482 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86cfd" Jun 02 18:42:21.251019 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:21.250930 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:21.253623 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:21.253594 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0469ee3a-543f-4a5f-b52f-c85f1a42579d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-sxzhx\" (UID: \"0469ee3a-543f-4a5f-b52f-c85f1a42579d\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:21.508311 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:21.508235 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" Jun 02 18:42:22.137957 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:42:22.137895 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" podUID="75422cdb-a567-401c-8061-f891ec6b908f" Jun 02 18:42:22.151127 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:42:22.151092 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-vj5lg" podUID="b3284f7e-a49f-4653-9f96-c06804b34f09" Jun 02 18:42:22.169372 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:42:22.169332 2567 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-bjgwr" podUID="7019a38a-dfac-4478-8411-b7bca7218343" Jun 02 18:42:22.236750 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:22.236720 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj5lg" Jun 02 18:42:24.329998 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:24.329867 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1aac776_6b64_4a37_95ae_b226aa08c352.slice/crio-759c7507619d601db0dc9d475aab36bf588e3ba59f9f15481c3440ec3a7a01e2 WatchSource:0}: Error finding container 759c7507619d601db0dc9d475aab36bf588e3ba59f9f15481c3440ec3a7a01e2: Status 404 returned error can't find the container with id 759c7507619d601db0dc9d475aab36bf588e3ba59f9f15481c3440ec3a7a01e2 Jun 02 18:42:24.450174 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:24.450069 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-sxzhx"] Jun 02 18:42:24.452259 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:24.452232 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0469ee3a_543f_4a5f_b52f_c85f1a42579d.slice/crio-e16c35d45b83024735da0815ad311d34b79272e703f34c62e73f9d49f7f62c74 WatchSource:0}: Error finding container e16c35d45b83024735da0815ad311d34b79272e703f34c62e73f9d49f7f62c74: Status 404 returned error can't find the container with id e16c35d45b83024735da0815ad311d34b79272e703f34c62e73f9d49f7f62c74 Jun 02 18:42:25.247738 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.247636 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" event={"ID":"0469ee3a-543f-4a5f-b52f-c85f1a42579d","Type":"ContainerStarted","Data":"600c67ab15636866eb141c13fec42dcd05c2888eb762df1f786a13a0a715a294"} Jun 02 18:42:25.247738 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.247685 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" event={"ID":"0469ee3a-543f-4a5f-b52f-c85f1a42579d","Type":"ContainerStarted","Data":"7b603db78332e67694319418ff8778ca9580286bc7075290187d182fffaa637d"} Jun 02 18:42:25.247738 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.247701 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" event={"ID":"0469ee3a-543f-4a5f-b52f-c85f1a42579d","Type":"ContainerStarted","Data":"e16c35d45b83024735da0815ad311d34b79272e703f34c62e73f9d49f7f62c74"} Jun 02 18:42:25.249340 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.249298 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86cfd" event={"ID":"a1aac776-6b64-4a37-95ae-b226aa08c352","Type":"ContainerStarted","Data":"759c7507619d601db0dc9d475aab36bf588e3ba59f9f15481c3440ec3a7a01e2"} Jun 02 18:42:25.251585 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.251549 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-c65b8dc4b-tg654" event={"ID":"df900abc-1db7-48a6-9c1a-db4c247f6158","Type":"ContainerStarted","Data":"d30b44d200ec9616028e8f26b7ac6eaa2ebaa98cbb58da1b41b358992e7f473d"} Jun 02 18:42:25.251997 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.251974 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-c65b8dc4b-tg654" Jun 02 18:42:25.268407 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.268366 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-c65b8dc4b-tg654" Jun 02 18:42:25.273753 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:25.273711 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-c65b8dc4b-tg654" podStartSLOduration=1.945142343 podStartE2EDuration="18.273699455s" podCreationTimestamp="2026-06-02 18:42:07 +0000 UTC" firstStartedPulling="2026-06-02 18:42:08.085914822 +0000 UTC m=+142.898377611" lastFinishedPulling="2026-06-02 18:42:24.414471933 +0000 UTC m=+159.226934723" observedRunningTime="2026-06-02 18:42:25.27188613 +0000 UTC m=+160.084348944" watchObservedRunningTime="2026-06-02 18:42:25.273699455 +0000 UTC m=+160.086162265" Jun 02 18:42:26.257768 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.257720 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" event={"ID":"0469ee3a-543f-4a5f-b52f-c85f1a42579d","Type":"ContainerStarted","Data":"9f77f43fdbf91674e232bd6717a342f2f19a129264083bb92837924da66543dc"} Jun 02 18:42:26.259930 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.259895 2567 generic.go:358] "Generic (PLEG): container finished" podID="a1aac776-6b64-4a37-95ae-b226aa08c352" containerID="4ae5774ea0ac3fe8dc6e97be02b6b42176c3442377c54e22e83315440c5e17f6" exitCode=0 Jun 02 18:42:26.260064 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.259988 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86cfd" event={"ID":"a1aac776-6b64-4a37-95ae-b226aa08c352","Type":"ContainerDied","Data":"4ae5774ea0ac3fe8dc6e97be02b6b42176c3442377c54e22e83315440c5e17f6"} Jun 02 18:42:26.275241 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.275171 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-sxzhx" podStartSLOduration=4.725450525 podStartE2EDuration="6.275159511s" podCreationTimestamp="2026-06-02 18:42:20 +0000 UTC" firstStartedPulling="2026-06-02 18:42:24.56878494 +0000 UTC m=+159.381247733" lastFinishedPulling="2026-06-02 18:42:26.118493915 +0000 UTC m=+160.930956719" observedRunningTime="2026-06-02 18:42:26.274833083 +0000 UTC m=+161.087295931" watchObservedRunningTime="2026-06-02 18:42:26.275159511 +0000 UTC m=+161.087622322" Jun 02 18:42:26.807835 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.807740 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 18:42:26.844945 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.844906 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 18:42:26.845114 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.845099 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.847970 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.847922 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 02 18:42:26.848123 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.848103 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 02 18:42:26.849430 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.848962 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 02 18:42:26.849430 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.849279 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-56ptl\"" Jun 02 18:42:26.850709 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.850667 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 02 18:42:26.851110 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.850827 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 02 18:42:26.851110 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.850889 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 02 18:42:26.851110 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.850832 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 02 18:42:26.851110 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.850947 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 02 18:42:26.851110 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.851055 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3poc1n4jnc74l\"" Jun 02 18:42:26.851110 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.851061 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 02 18:42:26.851463 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.851208 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 02 18:42:26.851463 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.851238 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 02 18:42:26.851902 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.851835 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 02 18:42:26.853530 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.853507 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 02 18:42:26.901816 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.901766 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.901816 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.901819 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.901847 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.901871 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.901921 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8661c33-5647-4ca6-982a-4a9456178f19-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.901964 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.901993 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902053 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-config\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902105 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902128 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrdbz\" (UniqueName: \"kubernetes.io/projected/f8661c33-5647-4ca6-982a-4a9456178f19-kube-api-access-zrdbz\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902164 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902218 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902257 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8661c33-5647-4ca6-982a-4a9456178f19-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902273 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902293 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902314 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902334 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:26.902414 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:26.902358 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003120 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003084 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003130 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zrdbz\" (UniqueName: \"kubernetes.io/projected/f8661c33-5647-4ca6-982a-4a9456178f19-kube-api-access-zrdbz\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003171 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003222 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003246 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:42:27.003329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003270 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8661c33-5647-4ca6-982a-4a9456178f19-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003294 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003320 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003347 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003376 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003405 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003449 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003470 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003496 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003522 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003557 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003565 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8661c33-5647-4ca6-982a-4a9456178f19-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003653 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003680 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.003720 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003714 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.004286 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003742 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:42:27.004286 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.003797 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-config\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.005067 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.004883 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.006213 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.005791 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.006770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.006330 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f8661c33-5647-4ca6-982a-4a9456178f19-config-out\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.006770 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.006564 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.009257 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.008897 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.010479 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.010455 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.011985 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.011692 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"image-registry-946d6d6c-n8k69\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:42:27.011985 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.011751 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-config\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.012419 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.012395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.013062 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.013036 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f8661c33-5647-4ca6-982a-4a9456178f19-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.015582 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.015554 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.017260 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.016459 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.017260 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.016924 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.017260 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.017130 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-web-config\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.017588 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.017529 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.017588 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.017560 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f8661c33-5647-4ca6-982a-4a9456178f19-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.017714 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.017639 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3284f7e-a49f-4653-9f96-c06804b34f09-metrics-tls\") pod \"dns-default-vj5lg\" (UID: \"b3284f7e-a49f-4653-9f96-c06804b34f09\") " pod="openshift-dns/dns-default-vj5lg" Jun 02 18:42:27.017714 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.017643 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f8661c33-5647-4ca6-982a-4a9456178f19-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.018124 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.018101 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7019a38a-dfac-4478-8411-b7bca7218343-cert\") pod \"ingress-canary-bjgwr\" (UID: \"7019a38a-dfac-4478-8411-b7bca7218343\") " pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:42:27.018469 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.018450 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrdbz\" (UniqueName: \"kubernetes.io/projected/f8661c33-5647-4ca6-982a-4a9456178f19-kube-api-access-zrdbz\") pod \"prometheus-k8s-0\" (UID: \"f8661c33-5647-4ca6-982a-4a9456178f19\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.040242 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.040216 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h76xf\"" Jun 02 18:42:27.047771 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.047739 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vj5lg" Jun 02 18:42:27.160983 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.159799 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:27.222423 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.221281 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vj5lg"] Jun 02 18:42:27.266398 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.266352 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86cfd" event={"ID":"a1aac776-6b64-4a37-95ae-b226aa08c352","Type":"ContainerStarted","Data":"c0d904c77972eac2fbff1ff112ac502c8c0a2bfb2f28f1e849b3a480ba9b535d"} Jun 02 18:42:27.266398 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.266400 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86cfd" event={"ID":"a1aac776-6b64-4a37-95ae-b226aa08c352","Type":"ContainerStarted","Data":"52ffb44b72f6a84df5acdef1462486ed3b44bfc8e064101e61332f2c59544fcd"} Jun 02 18:42:27.272827 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.272012 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj5lg" event={"ID":"b3284f7e-a49f-4653-9f96-c06804b34f09","Type":"ContainerStarted","Data":"ad18149c6048a96a4e6783a85392e7578b309b9dc6fd5ef6fcef9bc3c58bec89"} Jun 02 18:42:27.347524 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.347466 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-86cfd" podStartSLOduration=6.31574075 podStartE2EDuration="7.347418921s" podCreationTimestamp="2026-06-02 18:42:20 +0000 UTC" firstStartedPulling="2026-06-02 18:42:24.331588097 +0000 UTC m=+159.144050888" lastFinishedPulling="2026-06-02 18:42:25.36326623 +0000 UTC m=+160.175729059" observedRunningTime="2026-06-02 18:42:27.288421654 +0000 UTC m=+162.100884486" watchObservedRunningTime="2026-06-02 18:42:27.347418921 +0000 UTC m=+162.159881733" Jun 02 18:42:27.348518 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:27.348485 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 02 18:42:27.351466 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:27.351438 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8661c33_5647_4ca6_982a_4a9456178f19.slice/crio-3d3583ecfdb44cd26868e32dd68f45b6622b9a11923d6a3ddfe94b27364a6daf WatchSource:0}: Error finding container 3d3583ecfdb44cd26868e32dd68f45b6622b9a11923d6a3ddfe94b27364a6daf: Status 404 returned error can't find the container with id 3d3583ecfdb44cd26868e32dd68f45b6622b9a11923d6a3ddfe94b27364a6daf Jun 02 18:42:28.278995 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:28.278964 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerStarted","Data":"3d3583ecfdb44cd26868e32dd68f45b6622b9a11923d6a3ddfe94b27364a6daf"} Jun 02 18:42:30.287134 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:30.287039 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj5lg" event={"ID":"b3284f7e-a49f-4653-9f96-c06804b34f09","Type":"ContainerStarted","Data":"5bd1f364c08c25de36da745abf82d9139fee3313e20fdfba767d9281de65b3bb"} Jun 02 18:42:30.287134 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:30.287086 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vj5lg" event={"ID":"b3284f7e-a49f-4653-9f96-c06804b34f09","Type":"ContainerStarted","Data":"4c1c2d6713f9f5c51b63d7300a6ab01d267309d0a450915fd7fa86f4283f0443"} Jun 02 18:42:30.287656 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:30.287415 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vj5lg" Jun 02 18:42:30.288838 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:30.288809 2567 generic.go:358] "Generic (PLEG): container finished" podID="f8661c33-5647-4ca6-982a-4a9456178f19" containerID="d724e84aa86f6f92148576673447477ba74b03f19ffb715a5c930cd9022b9446" exitCode=0 Jun 02 18:42:30.288970 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:30.288886 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerDied","Data":"d724e84aa86f6f92148576673447477ba74b03f19ffb715a5c930cd9022b9446"} Jun 02 18:42:30.305152 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:30.305095 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-vj5lg" podStartSLOduration=128.851012152 podStartE2EDuration="2m11.305078234s" podCreationTimestamp="2026-06-02 18:40:19 +0000 UTC" firstStartedPulling="2026-06-02 18:42:27.230494701 +0000 UTC m=+162.042957498" lastFinishedPulling="2026-06-02 18:42:29.684560786 +0000 UTC m=+164.497023580" observedRunningTime="2026-06-02 18:42:30.303498919 +0000 UTC m=+165.115961757" watchObservedRunningTime="2026-06-02 18:42:30.305078234 +0000 UTC m=+165.117541045" Jun 02 18:42:34.318336 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:34.318291 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerStarted","Data":"afb6f21c5c9742586179445ca3324ef51214d85ea3766d4201366b1d3c1d941a"} Jun 02 18:42:34.318336 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:34.318328 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerStarted","Data":"cc247bb1c750eb7b20b528ca332b99a6201b735c8b3370f5862539f98a66dda2"} Jun 02 18:42:36.706575 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:36.706550 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:42:36.709250 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:36.709228 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vdj79\"" Jun 02 18:42:36.717494 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:36.717471 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bjgwr" Jun 02 18:42:36.868930 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:36.868871 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bjgwr"] Jun 02 18:42:36.872337 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:36.872301 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7019a38a_dfac_4478_8411_b7bca7218343.slice/crio-ab6d8cf9228b8cd7d642241cc2fc3da005fcdd4adc79ad711ab89c27f3386f10 WatchSource:0}: Error finding container ab6d8cf9228b8cd7d642241cc2fc3da005fcdd4adc79ad711ab89c27f3386f10: Status 404 returned error can't find the container with id ab6d8cf9228b8cd7d642241cc2fc3da005fcdd4adc79ad711ab89c27f3386f10 Jun 02 18:42:37.327022 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.326940 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bjgwr" event={"ID":"7019a38a-dfac-4478-8411-b7bca7218343","Type":"ContainerStarted","Data":"ab6d8cf9228b8cd7d642241cc2fc3da005fcdd4adc79ad711ab89c27f3386f10"} Jun 02 18:42:37.329686 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.329657 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerStarted","Data":"8e00ab22bea30fdd66776ff838b9ea3d540b98b22c5f96f909a8340dc3d352b4"} Jun 02 18:42:37.329788 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.329692 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerStarted","Data":"238913b686802ddd21cedfc8cb3b49bfe5aee862c386eb45e02525e6d4a15f35"} Jun 02 18:42:37.329788 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.329705 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerStarted","Data":"5ddfbddce0bbd13076f24936eef46c36f5dcc40e3b67b9ef7f5e9b3393edd50d"} Jun 02 18:42:37.329788 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.329718 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f8661c33-5647-4ca6-982a-4a9456178f19","Type":"ContainerStarted","Data":"e054a32c0c12fe32d7c9475fd55e9b45e9f4c192b8195bb54a1272aebfff2c21"} Jun 02 18:42:37.355809 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.355724 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.012115928 podStartE2EDuration="11.355704947s" podCreationTimestamp="2026-06-02 18:42:26 +0000 UTC" firstStartedPulling="2026-06-02 18:42:27.354230315 +0000 UTC m=+162.166693107" lastFinishedPulling="2026-06-02 18:42:36.697819322 +0000 UTC m=+171.510282126" observedRunningTime="2026-06-02 18:42:37.354299994 +0000 UTC m=+172.166762809" watchObservedRunningTime="2026-06-02 18:42:37.355704947 +0000 UTC m=+172.168167756" Jun 02 18:42:37.706971 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.706932 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:42:37.710011 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.709985 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-htf9l\"" Jun 02 18:42:37.717413 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.717383 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:42:37.863577 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:37.863548 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-946d6d6c-n8k69"] Jun 02 18:42:37.866364 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:42:37.866332 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75422cdb_a567_401c_8061_f891ec6b908f.slice/crio-54c92288f53ac2a4d28cb198191539cd747d0a81a1a32901cac4a6f416a36872 WatchSource:0}: Error finding container 54c92288f53ac2a4d28cb198191539cd747d0a81a1a32901cac4a6f416a36872: Status 404 returned error can't find the container with id 54c92288f53ac2a4d28cb198191539cd747d0a81a1a32901cac4a6f416a36872 Jun 02 18:42:38.335313 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:38.335153 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" event={"ID":"75422cdb-a567-401c-8061-f891ec6b908f","Type":"ContainerStarted","Data":"58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5"} Jun 02 18:42:38.335547 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:38.335235 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" event={"ID":"75422cdb-a567-401c-8061-f891ec6b908f","Type":"ContainerStarted","Data":"54c92288f53ac2a4d28cb198191539cd747d0a81a1a32901cac4a6f416a36872"} Jun 02 18:42:38.335739 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:38.335715 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:42:38.354696 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:38.354518 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" podStartSLOduration=172.354499634 podStartE2EDuration="2m52.354499634s" podCreationTimestamp="2026-06-02 18:39:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:42:38.353778448 +0000 UTC m=+173.166241289" watchObservedRunningTime="2026-06-02 18:42:38.354499634 +0000 UTC m=+173.166962450" Jun 02 18:42:39.339343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:39.339251 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bjgwr" event={"ID":"7019a38a-dfac-4478-8411-b7bca7218343","Type":"ContainerStarted","Data":"4659a6d129967e1f66c81abfeaf57f7dfb673f63bb0d9c9042fc7fec925884f3"} Jun 02 18:42:39.355046 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:39.354993 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bjgwr" podStartSLOduration=138.281814952 podStartE2EDuration="2m20.354977875s" podCreationTimestamp="2026-06-02 18:40:19 +0000 UTC" firstStartedPulling="2026-06-02 18:42:36.874131062 +0000 UTC m=+171.686593855" lastFinishedPulling="2026-06-02 18:42:38.947293985 +0000 UTC m=+173.759756778" observedRunningTime="2026-06-02 18:42:39.354346047 +0000 UTC m=+174.166808859" watchObservedRunningTime="2026-06-02 18:42:39.354977875 +0000 UTC m=+174.167440686" Jun 02 18:42:40.294903 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:40.294868 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vj5lg" Jun 02 18:42:42.160949 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:42.160916 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:42:58.006683 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:58.006643 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-946d6d6c-n8k69"] Jun 02 18:42:58.012691 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:42:58.012662 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:43:02.545840 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:02.545807 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-jx74c_19f2bd02-572e-4135-885c-31cde560be88/cluster-samples-operator/0.log" Jun 02 18:43:02.551638 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:02.551613 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-755bbf9bfb-jx74c_19f2bd02-572e-4135-885c-31cde560be88/cluster-samples-operator-watch/0.log" Jun 02 18:43:23.029741 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:23.029675 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" podUID="75422cdb-a567-401c-8061-f891ec6b908f" containerName="registry" containerID="cri-o://58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5" gracePeriod=30 Jun 02 18:43:24.270269 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.270244 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:43:24.310675 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310643 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-image-registry-private-configuration\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.310820 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310702 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75422cdb-a567-401c-8061-f891ec6b908f-ca-trust-extracted\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.310820 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310734 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-registry-certificates\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.310820 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310760 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-installation-pull-secrets\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.310820 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310796 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdgft\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-kube-api-access-bdgft\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.311038 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310823 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-trusted-ca\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.311038 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310853 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.311038 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.310877 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-bound-sa-token\") pod \"75422cdb-a567-401c-8061-f891ec6b908f\" (UID: \"75422cdb-a567-401c-8061-f891ec6b908f\") " Jun 02 18:43:24.311897 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.311858 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:43:24.312018 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.311994 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 18:43:24.313241 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.313170 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:43:24.313546 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.313505 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:43:24.313730 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.313703 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:43:24.314136 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.314112 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-kube-api-access-bdgft" (OuterVolumeSpecName: "kube-api-access-bdgft") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "kube-api-access-bdgft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:43:24.315305 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.315282 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 18:43:24.321286 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.321235 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75422cdb-a567-401c-8061-f891ec6b908f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "75422cdb-a567-401c-8061-f891ec6b908f" (UID: "75422cdb-a567-401c-8061-f891ec6b908f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:43:24.411672 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411647 2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-image-registry-private-configuration\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.411743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411675 2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75422cdb-a567-401c-8061-f891ec6b908f-ca-trust-extracted\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.411743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411686 2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-registry-certificates\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.411743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411696 2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75422cdb-a567-401c-8061-f891ec6b908f-installation-pull-secrets\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.411743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411705 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdgft\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-kube-api-access-bdgft\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.411743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411714 2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75422cdb-a567-401c-8061-f891ec6b908f-trusted-ca\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.411743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411722 2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-registry-tls\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.411743 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.411730 2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75422cdb-a567-401c-8061-f891ec6b908f-bound-sa-token\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:43:24.476281 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.476253 2567 generic.go:358] "Generic (PLEG): container finished" podID="75422cdb-a567-401c-8061-f891ec6b908f" containerID="58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5" exitCode=0 Jun 02 18:43:24.476404 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.476317 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" Jun 02 18:43:24.476404 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.476342 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" event={"ID":"75422cdb-a567-401c-8061-f891ec6b908f","Type":"ContainerDied","Data":"58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5"} Jun 02 18:43:24.476404 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.476378 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-946d6d6c-n8k69" event={"ID":"75422cdb-a567-401c-8061-f891ec6b908f","Type":"ContainerDied","Data":"54c92288f53ac2a4d28cb198191539cd747d0a81a1a32901cac4a6f416a36872"} Jun 02 18:43:24.476404 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.476392 2567 scope.go:117] "RemoveContainer" containerID="58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5" Jun 02 18:43:24.484345 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.484325 2567 scope.go:117] "RemoveContainer" containerID="58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5" Jun 02 18:43:24.484616 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:43:24.484594 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5\": container with ID starting with 58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5 not found: ID does not exist" containerID="58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5" Jun 02 18:43:24.484663 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.484624 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5"} err="failed to get container status \"58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5\": rpc error: code = NotFound desc = could not find container \"58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5\": container with ID starting with 58ce92c3ef60220223227cbe6b8abbb21eb9af7766945c3fa33729c8fef61bf5 not found: ID does not exist" Jun 02 18:43:24.497887 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.497866 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-946d6d6c-n8k69"] Jun 02 18:43:24.504369 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:24.504346 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-946d6d6c-n8k69"] Jun 02 18:43:25.710799 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:25.710766 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75422cdb-a567-401c-8061-f891ec6b908f" path="/var/lib/kubelet/pods/75422cdb-a567-401c-8061-f891ec6b908f/volumes" Jun 02 18:43:27.160901 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:27.160853 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:43:27.176374 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:27.176348 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:43:27.501799 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:43:27.501722 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 02 18:44:45.623921 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:44:45.623893 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:44:45.624472 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:44:45.623945 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:44:45.636626 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:44:45.636599 2567 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 18:45:45.199679 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.199646 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv"] Jun 02 18:45:45.200296 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.199967 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75422cdb-a567-401c-8061-f891ec6b908f" containerName="registry" Jun 02 18:45:45.200296 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.199977 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="75422cdb-a567-401c-8061-f891ec6b908f" containerName="registry" Jun 02 18:45:45.200296 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.200028 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="75422cdb-a567-401c-8061-f891ec6b908f" containerName="registry" Jun 02 18:45:45.201911 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.201896 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.206164 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.206141 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 18:45:45.206442 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.206426 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 18:45:45.206496 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.206426 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 18:45:45.206585 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.206565 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-795jw\"" Jun 02 18:45:45.206675 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.206658 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 18:45:45.228542 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.228520 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv"] Jun 02 18:45:45.304853 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.304823 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ae0ec40-cd62-405d-be63-83b6ebd38ead-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.304853 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.304854 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm9n5\" (UniqueName: \"kubernetes.io/projected/9ae0ec40-cd62-405d-be63-83b6ebd38ead-kube-api-access-sm9n5\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.305079 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.304879 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ae0ec40-cd62-405d-be63-83b6ebd38ead-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.305079 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.304900 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ae0ec40-cd62-405d-be63-83b6ebd38ead-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.305079 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.304946 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ae0ec40-cd62-405d-be63-83b6ebd38ead-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.406151 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.406113 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ae0ec40-cd62-405d-be63-83b6ebd38ead-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.406340 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.406158 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sm9n5\" (UniqueName: \"kubernetes.io/projected/9ae0ec40-cd62-405d-be63-83b6ebd38ead-kube-api-access-sm9n5\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.406340 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.406213 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ae0ec40-cd62-405d-be63-83b6ebd38ead-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.406340 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.406238 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ae0ec40-cd62-405d-be63-83b6ebd38ead-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.406340 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.406264 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ae0ec40-cd62-405d-be63-83b6ebd38ead-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.406646 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.406625 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ae0ec40-cd62-405d-be63-83b6ebd38ead-manifests\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.408497 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.408469 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ae0ec40-cd62-405d-be63-83b6ebd38ead-tmp\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.408590 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.408527 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ae0ec40-cd62-405d-be63-83b6ebd38ead-webhook-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.408590 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.408574 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ae0ec40-cd62-405d-be63-83b6ebd38ead-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.419433 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.419412 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm9n5\" (UniqueName: \"kubernetes.io/projected/9ae0ec40-cd62-405d-be63-83b6ebd38ead-kube-api-access-sm9n5\") pod \"opendatahub-operator-controller-manager-dddc7c6cc-mgdmv\" (UID: \"9ae0ec40-cd62-405d-be63-83b6ebd38ead\") " pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.512608 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.512541 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:45.641933 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.641880 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv"] Jun 02 18:45:45.645074 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:45:45.645045 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae0ec40_cd62_405d_be63_83b6ebd38ead.slice/crio-09011c1ad6c990e251cd207df93b0357fb31f2a842067bfbe7578961872be652 WatchSource:0}: Error finding container 09011c1ad6c990e251cd207df93b0357fb31f2a842067bfbe7578961872be652: Status 404 returned error can't find the container with id 09011c1ad6c990e251cd207df93b0357fb31f2a842067bfbe7578961872be652 Jun 02 18:45:45.646751 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.646728 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:45:45.874388 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:45.874360 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" event={"ID":"9ae0ec40-cd62-405d-be63-83b6ebd38ead","Type":"ContainerStarted","Data":"09011c1ad6c990e251cd207df93b0357fb31f2a842067bfbe7578961872be652"} Jun 02 18:45:48.886436 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:48.886401 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" event={"ID":"9ae0ec40-cd62-405d-be63-83b6ebd38ead","Type":"ContainerStarted","Data":"b723c104857fcf14e69f78883b2a42af1ceefedabb094bc1dc245e3c7a62c241"} Jun 02 18:45:49.890731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:49.890692 2567 generic.go:358] "Generic (PLEG): container finished" podID="9ae0ec40-cd62-405d-be63-83b6ebd38ead" containerID="b723c104857fcf14e69f78883b2a42af1ceefedabb094bc1dc245e3c7a62c241" exitCode=0 Jun 02 18:45:49.891168 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:49.890743 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" event={"ID":"9ae0ec40-cd62-405d-be63-83b6ebd38ead","Type":"ContainerDied","Data":"b723c104857fcf14e69f78883b2a42af1ceefedabb094bc1dc245e3c7a62c241"} Jun 02 18:45:50.895329 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:50.895295 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" event={"ID":"9ae0ec40-cd62-405d-be63-83b6ebd38ead","Type":"ContainerStarted","Data":"666ba95be8c2da25ac32b8f415be57fce6dc19d6be5be429213e3ba2769fa0da"} Jun 02 18:45:50.895710 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:50.895418 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:45:50.922456 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:45:50.922402 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" podStartSLOduration=1.375235305 podStartE2EDuration="5.922387323s" podCreationTimestamp="2026-06-02 18:45:45 +0000 UTC" firstStartedPulling="2026-06-02 18:45:45.646891917 +0000 UTC m=+360.459354706" lastFinishedPulling="2026-06-02 18:45:50.194043931 +0000 UTC m=+365.006506724" observedRunningTime="2026-06-02 18:45:50.919017811 +0000 UTC m=+365.731480622" watchObservedRunningTime="2026-06-02 18:45:50.922387323 +0000 UTC m=+365.734850136" Jun 02 18:46:01.900578 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:01.900543 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dddc7c6cc-mgdmv" Jun 02 18:46:03.720795 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.720762 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj"] Jun 02 18:46:03.731808 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.731776 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.738772 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.738735 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 02 18:46:03.739913 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.739885 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 02 18:46:03.739913 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.739894 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 02 18:46:03.740090 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.739912 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 02 18:46:03.740090 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.739962 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r6zjj\"" Jun 02 18:46:03.740090 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.739885 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 02 18:46:03.745622 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.745597 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj"] Jun 02 18:46:03.855191 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.855146 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d44e37d-8d58-4e6b-adb6-fa45fb209474-manager-config\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.855344 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.855256 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d44e37d-8d58-4e6b-adb6-fa45fb209474-metrics-cert\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.855344 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.855312 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27w9k\" (UniqueName: \"kubernetes.io/projected/5d44e37d-8d58-4e6b-adb6-fa45fb209474-kube-api-access-27w9k\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.855432 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.855371 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d44e37d-8d58-4e6b-adb6-fa45fb209474-cert\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.955954 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.955918 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-27w9k\" (UniqueName: \"kubernetes.io/projected/5d44e37d-8d58-4e6b-adb6-fa45fb209474-kube-api-access-27w9k\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.956105 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.955983 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d44e37d-8d58-4e6b-adb6-fa45fb209474-cert\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.956105 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.956011 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d44e37d-8d58-4e6b-adb6-fa45fb209474-manager-config\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.956105 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.956048 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d44e37d-8d58-4e6b-adb6-fa45fb209474-metrics-cert\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.956661 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.956628 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5d44e37d-8d58-4e6b-adb6-fa45fb209474-manager-config\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.958603 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.958582 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5d44e37d-8d58-4e6b-adb6-fa45fb209474-metrics-cert\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.958706 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.958673 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d44e37d-8d58-4e6b-adb6-fa45fb209474-cert\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:03.988576 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:03.988519 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27w9k\" (UniqueName: \"kubernetes.io/projected/5d44e37d-8d58-4e6b-adb6-fa45fb209474-kube-api-access-27w9k\") pod \"lws-controller-manager-655df48c9-s2tdj\" (UID: \"5d44e37d-8d58-4e6b-adb6-fa45fb209474\") " pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:04.042363 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.042335 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:04.216236 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.216203 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj"] Jun 02 18:46:04.221087 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:46:04.221032 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d44e37d_8d58_4e6b_adb6_fa45fb209474.slice/crio-16c4fae1dbf401edbc4d1e7f5e5993afb5b0233e4c67e386d79267732bce6c4a WatchSource:0}: Error finding container 16c4fae1dbf401edbc4d1e7f5e5993afb5b0233e4c67e386d79267732bce6c4a: Status 404 returned error can't find the container with id 16c4fae1dbf401edbc4d1e7f5e5993afb5b0233e4c67e386d79267732bce6c4a Jun 02 18:46:04.651773 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.651738 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp"] Jun 02 18:46:04.655242 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.655216 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.659551 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.659387 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 18:46:04.659551 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.659409 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7jjcv\"" Jun 02 18:46:04.659551 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.659450 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 18:46:04.666301 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.666280 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp"] Jun 02 18:46:04.763264 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.763231 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54kw\" (UniqueName: \"kubernetes.io/projected/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-kube-api-access-c54kw\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.763264 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.763268 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-tls-certs\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.763703 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.763291 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-tmp\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.863833 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.863791 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c54kw\" (UniqueName: \"kubernetes.io/projected/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-kube-api-access-c54kw\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.864026 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.863851 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-tls-certs\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.864026 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.863894 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-tmp\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.866746 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.866719 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-tmp\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.866980 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.866961 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-tls-certs\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.873023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.873003 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54kw\" (UniqueName: \"kubernetes.io/projected/01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b-kube-api-access-c54kw\") pod \"kube-auth-proxy-7d6c8b7568-v2cgp\" (UID: \"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b\") " pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:04.937570 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.937472 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" event={"ID":"5d44e37d-8d58-4e6b-adb6-fa45fb209474","Type":"ContainerStarted","Data":"16c4fae1dbf401edbc4d1e7f5e5993afb5b0233e4c67e386d79267732bce6c4a"} Jun 02 18:46:04.966793 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:04.966759 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" Jun 02 18:46:05.127343 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:05.127303 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp"] Jun 02 18:46:05.130912 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:46:05.130875 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b31ef0_9d06_46e3_a14c_ff6fa2a07f5b.slice/crio-645c6c0cc88689e6306884447cb17bc2baf3b5e51a3b3b92de85cf4ef67cd22d WatchSource:0}: Error finding container 645c6c0cc88689e6306884447cb17bc2baf3b5e51a3b3b92de85cf4ef67cd22d: Status 404 returned error can't find the container with id 645c6c0cc88689e6306884447cb17bc2baf3b5e51a3b3b92de85cf4ef67cd22d Jun 02 18:46:05.943085 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:05.943045 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" event={"ID":"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b","Type":"ContainerStarted","Data":"645c6c0cc88689e6306884447cb17bc2baf3b5e51a3b3b92de85cf4ef67cd22d"} Jun 02 18:46:08.964207 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:08.964069 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" event={"ID":"5d44e37d-8d58-4e6b-adb6-fa45fb209474","Type":"ContainerStarted","Data":"7cabaa9dc54013cdb7660a3ec7b299c0fcd1d1c01235a9adefbdca25e73d49dc"} Jun 02 18:46:08.964207 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:08.964148 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:46:08.965489 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:08.965458 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" event={"ID":"01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b","Type":"ContainerStarted","Data":"488a9ec10bc5ca520c019c6ac1e38ab0f24cd558a4cce850c2858b814ab9a73c"} Jun 02 18:46:08.981331 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:08.981292 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" podStartSLOduration=1.493833833 podStartE2EDuration="5.98128154s" podCreationTimestamp="2026-06-02 18:46:03 +0000 UTC" firstStartedPulling="2026-06-02 18:46:04.223681311 +0000 UTC m=+379.036144100" lastFinishedPulling="2026-06-02 18:46:08.711129015 +0000 UTC m=+383.523591807" observedRunningTime="2026-06-02 18:46:08.980401007 +0000 UTC m=+383.792863831" watchObservedRunningTime="2026-06-02 18:46:08.98128154 +0000 UTC m=+383.793744351" Jun 02 18:46:08.997066 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:08.997020 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d6c8b7568-v2cgp" podStartSLOduration=1.370464769 podStartE2EDuration="4.997006845s" podCreationTimestamp="2026-06-02 18:46:04 +0000 UTC" firstStartedPulling="2026-06-02 18:46:05.133534692 +0000 UTC m=+379.945997494" lastFinishedPulling="2026-06-02 18:46:08.760076762 +0000 UTC m=+383.572539570" observedRunningTime="2026-06-02 18:46:08.995816074 +0000 UTC m=+383.808278887" watchObservedRunningTime="2026-06-02 18:46:08.997006845 +0000 UTC m=+383.809469696" Jun 02 18:46:19.973492 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:46:19.973457 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-655df48c9-s2tdj" Jun 02 18:47:43.437951 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.437908 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f"] Jun 02 18:47:43.441734 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.441716 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:47:43.444876 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.444853 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 18:47:43.444968 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.444899 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 18:47:43.446060 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.446039 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hpzxk\"" Jun 02 18:47:43.453094 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.453070 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f"] Jun 02 18:47:43.487515 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.487493 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95srf\" (UniqueName: \"kubernetes.io/projected/2bec37ae-60c1-4960-bdf1-86c4d218fe7a-kube-api-access-95srf\") pod \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" (UID: \"2bec37ae-60c1-4960-bdf1-86c4d218fe7a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:47:43.588036 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.588005 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95srf\" (UniqueName: \"kubernetes.io/projected/2bec37ae-60c1-4960-bdf1-86c4d218fe7a-kube-api-access-95srf\") pod \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" (UID: \"2bec37ae-60c1-4960-bdf1-86c4d218fe7a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:47:43.603980 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.603957 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95srf\" (UniqueName: \"kubernetes.io/projected/2bec37ae-60c1-4960-bdf1-86c4d218fe7a-kube-api-access-95srf\") pod \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" (UID: \"2bec37ae-60c1-4960-bdf1-86c4d218fe7a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:47:43.752165 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.752088 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:47:43.884404 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:43.884384 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f"] Jun 02 18:47:43.886659 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:47:43.886632 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bec37ae_60c1_4960_bdf1_86c4d218fe7a.slice/crio-296a24ec38d58a4e8b6ca750c9b4370088d8beb9f43f8b9ab25dd5c0a7ffbe8b WatchSource:0}: Error finding container 296a24ec38d58a4e8b6ca750c9b4370088d8beb9f43f8b9ab25dd5c0a7ffbe8b: Status 404 returned error can't find the container with id 296a24ec38d58a4e8b6ca750c9b4370088d8beb9f43f8b9ab25dd5c0a7ffbe8b Jun 02 18:47:44.276121 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:44.276080 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" event={"ID":"2bec37ae-60c1-4960-bdf1-86c4d218fe7a","Type":"ContainerStarted","Data":"296a24ec38d58a4e8b6ca750c9b4370088d8beb9f43f8b9ab25dd5c0a7ffbe8b"} Jun 02 18:47:46.284634 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:46.284551 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" event={"ID":"2bec37ae-60c1-4960-bdf1-86c4d218fe7a","Type":"ContainerStarted","Data":"3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d"} Jun 02 18:47:46.284985 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:46.284690 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:47:46.311705 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:46.311644 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" podStartSLOduration=1.166326001 podStartE2EDuration="3.311626449s" podCreationTimestamp="2026-06-02 18:47:43 +0000 UTC" firstStartedPulling="2026-06-02 18:47:43.888478881 +0000 UTC m=+478.700941670" lastFinishedPulling="2026-06-02 18:47:46.033779316 +0000 UTC m=+480.846242118" observedRunningTime="2026-06-02 18:47:46.308110407 +0000 UTC m=+481.120573231" watchObservedRunningTime="2026-06-02 18:47:46.311626449 +0000 UTC m=+481.124089265" Jun 02 18:47:57.289835 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:47:57.289804 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:48:06.345990 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.345947 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q"] Jun 02 18:48:06.349361 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.349335 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.352169 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.352150 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xsfc7\"" Jun 02 18:48:06.361422 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.361400 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q"] Jun 02 18:48:06.365085 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.365063 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f"] Jun 02 18:48:06.365285 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.365265 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" containerName="manager" containerID="cri-o://3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d" gracePeriod=2 Jun 02 18:48:06.374317 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.374292 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f"] Jun 02 18:48:06.383552 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.383519 2567 status_manager.go:895] "Failed to get status for pod" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:48:06.395670 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.395646 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw"] Jun 02 18:48:06.396057 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.396043 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" containerName="manager" Jun 02 18:48:06.396109 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.396061 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" containerName="manager" Jun 02 18:48:06.396157 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.396118 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" containerName="manager" Jun 02 18:48:06.398917 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.398893 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" Jun 02 18:48:06.419824 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.419801 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw"] Jun 02 18:48:06.437383 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.437357 2567 status_manager.go:895] "Failed to get status for pod" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:48:06.475838 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.475813 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b99ce2b1-d5b9-463e-b3c0-d27526329495-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b8h5q\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.475929 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.475855 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f2vx\" (UniqueName: \"kubernetes.io/projected/55536d5e-aebf-46f7-a3a7-61cb45192a3d-kube-api-access-2f2vx\") pod \"limitador-operator-controller-manager-85c4996f8c-xr6pw\" (UID: \"55536d5e-aebf-46f7-a3a7-61cb45192a3d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" Jun 02 18:48:06.475929 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.475916 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7pxh\" (UniqueName: \"kubernetes.io/projected/b99ce2b1-d5b9-463e-b3c0-d27526329495-kube-api-access-w7pxh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b8h5q\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.577381 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.577356 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2f2vx\" (UniqueName: \"kubernetes.io/projected/55536d5e-aebf-46f7-a3a7-61cb45192a3d-kube-api-access-2f2vx\") pod \"limitador-operator-controller-manager-85c4996f8c-xr6pw\" (UID: \"55536d5e-aebf-46f7-a3a7-61cb45192a3d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" Jun 02 18:48:06.577448 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.577393 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w7pxh\" (UniqueName: \"kubernetes.io/projected/b99ce2b1-d5b9-463e-b3c0-d27526329495-kube-api-access-w7pxh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b8h5q\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.577511 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.577495 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b99ce2b1-d5b9-463e-b3c0-d27526329495-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b8h5q\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.577858 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.577838 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b99ce2b1-d5b9-463e-b3c0-d27526329495-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b8h5q\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.591404 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.591377 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f2vx\" (UniqueName: \"kubernetes.io/projected/55536d5e-aebf-46f7-a3a7-61cb45192a3d-kube-api-access-2f2vx\") pod \"limitador-operator-controller-manager-85c4996f8c-xr6pw\" (UID: \"55536d5e-aebf-46f7-a3a7-61cb45192a3d\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" Jun 02 18:48:06.591518 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.591505 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7pxh\" (UniqueName: \"kubernetes.io/projected/b99ce2b1-d5b9-463e-b3c0-d27526329495-kube-api-access-w7pxh\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b8h5q\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.593620 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.593603 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:48:06.596209 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.596146 2567 status_manager.go:895] "Failed to get status for pod" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:48:06.663236 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.663211 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:06.678057 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.678035 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95srf\" (UniqueName: \"kubernetes.io/projected/2bec37ae-60c1-4960-bdf1-86c4d218fe7a-kube-api-access-95srf\") pod \"2bec37ae-60c1-4960-bdf1-86c4d218fe7a\" (UID: \"2bec37ae-60c1-4960-bdf1-86c4d218fe7a\") " Jun 02 18:48:06.679990 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.679968 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bec37ae-60c1-4960-bdf1-86c4d218fe7a-kube-api-access-95srf" (OuterVolumeSpecName: "kube-api-access-95srf") pod "2bec37ae-60c1-4960-bdf1-86c4d218fe7a" (UID: "2bec37ae-60c1-4960-bdf1-86c4d218fe7a"). InnerVolumeSpecName "kube-api-access-95srf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:48:06.738572 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.738541 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" Jun 02 18:48:06.784365 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.779287 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95srf\" (UniqueName: \"kubernetes.io/projected/2bec37ae-60c1-4960-bdf1-86c4d218fe7a-kube-api-access-95srf\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:48:06.794256 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.794227 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q"] Jun 02 18:48:06.798259 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:48:06.798172 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99ce2b1_d5b9_463e_b3c0_d27526329495.slice/crio-22cd20cf4b707ed980b1d0ddcd3bf499fc720663a1508b8f0ff33bd7b33a6d25 WatchSource:0}: Error finding container 22cd20cf4b707ed980b1d0ddcd3bf499fc720663a1508b8f0ff33bd7b33a6d25: Status 404 returned error can't find the container with id 22cd20cf4b707ed980b1d0ddcd3bf499fc720663a1508b8f0ff33bd7b33a6d25 Jun 02 18:48:06.868985 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:06.868852 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw"] Jun 02 18:48:06.871286 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:48:06.871254 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55536d5e_aebf_46f7_a3a7_61cb45192a3d.slice/crio-90df43ea0a4e67174e31732470e7054c13a06c4cbf1b3c073fe2a1335662baad WatchSource:0}: Error finding container 90df43ea0a4e67174e31732470e7054c13a06c4cbf1b3c073fe2a1335662baad: Status 404 returned error can't find the container with id 90df43ea0a4e67174e31732470e7054c13a06c4cbf1b3c073fe2a1335662baad Jun 02 18:48:07.355159 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.355110 2567 generic.go:358] "Generic (PLEG): container finished" podID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" containerID="3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d" exitCode=0 Jun 02 18:48:07.355680 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.355201 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" Jun 02 18:48:07.355680 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.355225 2567 scope.go:117] "RemoveContainer" containerID="3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d" Jun 02 18:48:07.357114 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.357090 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" event={"ID":"55536d5e-aebf-46f7-a3a7-61cb45192a3d","Type":"ContainerStarted","Data":"0567a0bda60f93127257111cf2b79b5c4213d6c751934c4054fd5917fe7df26b"} Jun 02 18:48:07.357250 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.357126 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" event={"ID":"55536d5e-aebf-46f7-a3a7-61cb45192a3d","Type":"ContainerStarted","Data":"90df43ea0a4e67174e31732470e7054c13a06c4cbf1b3c073fe2a1335662baad"} Jun 02 18:48:07.357250 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.357239 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" Jun 02 18:48:07.358533 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.358480 2567 status_manager.go:895] "Failed to get status for pod" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:48:07.359326 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.359292 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" event={"ID":"b99ce2b1-d5b9-463e-b3c0-d27526329495","Type":"ContainerStarted","Data":"22cd20cf4b707ed980b1d0ddcd3bf499fc720663a1508b8f0ff33bd7b33a6d25"} Jun 02 18:48:07.379261 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.379214 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" podStartSLOduration=1.3792016409999999 podStartE2EDuration="1.379201641s" podCreationTimestamp="2026-06-02 18:48:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:48:07.377555806 +0000 UTC m=+502.190018617" watchObservedRunningTime="2026-06-02 18:48:07.379201641 +0000 UTC m=+502.191664445" Jun 02 18:48:07.380292 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.380262 2567 status_manager.go:895] "Failed to get status for pod" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:48:07.382526 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.382492 2567 status_manager.go:895] "Failed to get status for pod" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-6jr5f" err="pods \"limitador-operator-controller-manager-85c4996f8c-6jr5f\" is forbidden: User \"system:node:ip-10-0-140-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-185.ec2.internal' and this object" Jun 02 18:48:07.407904 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.407734 2567 scope.go:117] "RemoveContainer" containerID="3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d" Jun 02 18:48:07.408141 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:48:07.408117 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d\": container with ID starting with 3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d not found: ID does not exist" containerID="3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d" Jun 02 18:48:07.408232 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.408156 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d"} err="failed to get container status \"3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d\": rpc error: code = NotFound desc = could not find container \"3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d\": container with ID starting with 3851e95ea62b97f953dc46b65fbd1b37054ba0a06a3f58ce77db43fec919387d not found: ID does not exist" Jun 02 18:48:07.712485 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:07.712400 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bec37ae-60c1-4960-bdf1-86c4d218fe7a" path="/var/lib/kubelet/pods/2bec37ae-60c1-4960-bdf1-86c4d218fe7a/volumes" Jun 02 18:48:11.374764 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:11.374727 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" event={"ID":"b99ce2b1-d5b9-463e-b3c0-d27526329495","Type":"ContainerStarted","Data":"cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b"} Jun 02 18:48:11.375291 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:11.374875 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:11.398023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:11.397972 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" podStartSLOduration=1.456245622 podStartE2EDuration="5.39795619s" podCreationTimestamp="2026-06-02 18:48:06 +0000 UTC" firstStartedPulling="2026-06-02 18:48:06.799983698 +0000 UTC m=+501.612446508" lastFinishedPulling="2026-06-02 18:48:10.741694284 +0000 UTC m=+505.554157076" observedRunningTime="2026-06-02 18:48:11.395154362 +0000 UTC m=+506.207617172" watchObservedRunningTime="2026-06-02 18:48:11.39795619 +0000 UTC m=+506.210419002" Jun 02 18:48:18.365835 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:18.365803 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xr6pw" Jun 02 18:48:18.805013 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:18.804916 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q"] Jun 02 18:48:18.805308 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:18.805262 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" podUID="b99ce2b1-d5b9-463e-b3c0-d27526329495" containerName="manager" containerID="cri-o://cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b" gracePeriod=10 Jun 02 18:48:18.807036 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:18.807011 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:19.063966 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.063912 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:19.112268 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.112239 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m"] Jun 02 18:48:19.112568 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.112557 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b99ce2b1-d5b9-463e-b3c0-d27526329495" containerName="manager" Jun 02 18:48:19.112656 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.112570 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b99ce2b1-d5b9-463e-b3c0-d27526329495" containerName="manager" Jun 02 18:48:19.112656 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.112633 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="b99ce2b1-d5b9-463e-b3c0-d27526329495" containerName="manager" Jun 02 18:48:19.115680 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.115662 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.125676 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.125650 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m"] Jun 02 18:48:19.183084 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.183056 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7pxh\" (UniqueName: \"kubernetes.io/projected/b99ce2b1-d5b9-463e-b3c0-d27526329495-kube-api-access-w7pxh\") pod \"b99ce2b1-d5b9-463e-b3c0-d27526329495\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " Jun 02 18:48:19.183258 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.183127 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b99ce2b1-d5b9-463e-b3c0-d27526329495-extensions-socket-volume\") pod \"b99ce2b1-d5b9-463e-b3c0-d27526329495\" (UID: \"b99ce2b1-d5b9-463e-b3c0-d27526329495\") " Jun 02 18:48:19.183585 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.183562 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b99ce2b1-d5b9-463e-b3c0-d27526329495-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b99ce2b1-d5b9-463e-b3c0-d27526329495" (UID: "b99ce2b1-d5b9-463e-b3c0-d27526329495"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 18:48:19.185098 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.185075 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b99ce2b1-d5b9-463e-b3c0-d27526329495-kube-api-access-w7pxh" (OuterVolumeSpecName: "kube-api-access-w7pxh") pod "b99ce2b1-d5b9-463e-b3c0-d27526329495" (UID: "b99ce2b1-d5b9-463e-b3c0-d27526329495"). InnerVolumeSpecName "kube-api-access-w7pxh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:48:19.284468 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.284432 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/352d895d-d05d-40fc-aa7f-4d7dee012672-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kkl4m\" (UID: \"352d895d-d05d-40fc-aa7f-4d7dee012672\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.284627 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.284487 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mrrz\" (UniqueName: \"kubernetes.io/projected/352d895d-d05d-40fc-aa7f-4d7dee012672-kube-api-access-6mrrz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kkl4m\" (UID: \"352d895d-d05d-40fc-aa7f-4d7dee012672\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.284627 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.284570 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7pxh\" (UniqueName: \"kubernetes.io/projected/b99ce2b1-d5b9-463e-b3c0-d27526329495-kube-api-access-w7pxh\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:48:19.284627 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.284582 2567 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b99ce2b1-d5b9-463e-b3c0-d27526329495-extensions-socket-volume\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:48:19.384950 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.384920 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6mrrz\" (UniqueName: \"kubernetes.io/projected/352d895d-d05d-40fc-aa7f-4d7dee012672-kube-api-access-6mrrz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kkl4m\" (UID: \"352d895d-d05d-40fc-aa7f-4d7dee012672\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.385354 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.385059 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/352d895d-d05d-40fc-aa7f-4d7dee012672-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kkl4m\" (UID: \"352d895d-d05d-40fc-aa7f-4d7dee012672\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.385415 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.385395 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/352d895d-d05d-40fc-aa7f-4d7dee012672-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kkl4m\" (UID: \"352d895d-d05d-40fc-aa7f-4d7dee012672\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.397128 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.397106 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mrrz\" (UniqueName: \"kubernetes.io/projected/352d895d-d05d-40fc-aa7f-4d7dee012672-kube-api-access-6mrrz\") pod \"kuadrant-operator-controller-manager-55c7f4c975-kkl4m\" (UID: \"352d895d-d05d-40fc-aa7f-4d7dee012672\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.405423 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.405398 2567 generic.go:358] "Generic (PLEG): container finished" podID="b99ce2b1-d5b9-463e-b3c0-d27526329495" containerID="cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b" exitCode=0 Jun 02 18:48:19.405535 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.405456 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" Jun 02 18:48:19.405535 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.405475 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" event={"ID":"b99ce2b1-d5b9-463e-b3c0-d27526329495","Type":"ContainerDied","Data":"cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b"} Jun 02 18:48:19.405535 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.405511 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q" event={"ID":"b99ce2b1-d5b9-463e-b3c0-d27526329495","Type":"ContainerDied","Data":"22cd20cf4b707ed980b1d0ddcd3bf499fc720663a1508b8f0ff33bd7b33a6d25"} Jun 02 18:48:19.405535 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.405527 2567 scope.go:117] "RemoveContainer" containerID="cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b" Jun 02 18:48:19.413696 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.413679 2567 scope.go:117] "RemoveContainer" containerID="cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b" Jun 02 18:48:19.414057 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:48:19.414030 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b\": container with ID starting with cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b not found: ID does not exist" containerID="cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b" Jun 02 18:48:19.414126 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.414061 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b"} err="failed to get container status \"cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b\": rpc error: code = NotFound desc = could not find container \"cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b\": container with ID starting with cecc2c1ea381241938103ac7c89cb538f143f6e8d95b56fb9bc5849f1fe3de5b not found: ID does not exist" Jun 02 18:48:19.425905 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.425885 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:19.429229 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.429199 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q"] Jun 02 18:48:19.435043 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.435021 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b8h5q"] Jun 02 18:48:19.549908 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.549882 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m"] Jun 02 18:48:19.552059 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:48:19.552031 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352d895d_d05d_40fc_aa7f_4d7dee012672.slice/crio-4c177ce3bd9ce612f7560afb295c76c69bb7ef92fdedd7b9d2b453193b8b4488 WatchSource:0}: Error finding container 4c177ce3bd9ce612f7560afb295c76c69bb7ef92fdedd7b9d2b453193b8b4488: Status 404 returned error can't find the container with id 4c177ce3bd9ce612f7560afb295c76c69bb7ef92fdedd7b9d2b453193b8b4488 Jun 02 18:48:19.711998 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:19.711922 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b99ce2b1-d5b9-463e-b3c0-d27526329495" path="/var/lib/kubelet/pods/b99ce2b1-d5b9-463e-b3c0-d27526329495/volumes" Jun 02 18:48:20.410841 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:20.410807 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" event={"ID":"352d895d-d05d-40fc-aa7f-4d7dee012672","Type":"ContainerStarted","Data":"370e5ba32f9e7192c34958ad2c13407ee8d15c2adeda31870db02ae3e7e23385"} Jun 02 18:48:20.410841 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:20.410844 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" event={"ID":"352d895d-d05d-40fc-aa7f-4d7dee012672","Type":"ContainerStarted","Data":"4c177ce3bd9ce612f7560afb295c76c69bb7ef92fdedd7b9d2b453193b8b4488"} Jun 02 18:48:20.411300 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:20.410868 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:20.460303 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:20.460248 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" podStartSLOduration=1.46023423 podStartE2EDuration="1.46023423s" podCreationTimestamp="2026-06-02 18:48:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:48:20.457823762 +0000 UTC m=+515.270286574" watchObservedRunningTime="2026-06-02 18:48:20.46023423 +0000 UTC m=+515.272697040" Jun 02 18:48:31.416698 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:31.416618 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-kkl4m" Jun 02 18:48:53.979132 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:53.979075 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-cvmdn"] Jun 02 18:48:53.982658 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:53.982638 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" Jun 02 18:48:53.985585 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:53.985564 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-98kwc\"" Jun 02 18:48:53.997702 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:53.997677 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-cvmdn"] Jun 02 18:48:54.059331 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:54.059301 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9g42\" (UniqueName: \"kubernetes.io/projected/0628bca8-aa64-41cc-9921-235c2f93de87-kube-api-access-r9g42\") pod \"authorino-f99f4b5cd-cvmdn\" (UID: \"0628bca8-aa64-41cc-9921-235c2f93de87\") " pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" Jun 02 18:48:54.160674 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:54.160636 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9g42\" (UniqueName: \"kubernetes.io/projected/0628bca8-aa64-41cc-9921-235c2f93de87-kube-api-access-r9g42\") pod \"authorino-f99f4b5cd-cvmdn\" (UID: \"0628bca8-aa64-41cc-9921-235c2f93de87\") " pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" Jun 02 18:48:54.171440 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:54.171417 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9g42\" (UniqueName: \"kubernetes.io/projected/0628bca8-aa64-41cc-9921-235c2f93de87-kube-api-access-r9g42\") pod \"authorino-f99f4b5cd-cvmdn\" (UID: \"0628bca8-aa64-41cc-9921-235c2f93de87\") " pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" Jun 02 18:48:54.311336 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:54.311252 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" Jun 02 18:48:54.449105 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:48:54.449075 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0628bca8_aa64_41cc_9921_235c2f93de87.slice/crio-6a7d57b995be842c9df84dbcd96e45662d86ccb674e23e45fdfd76f6a42ec3f6 WatchSource:0}: Error finding container 6a7d57b995be842c9df84dbcd96e45662d86ccb674e23e45fdfd76f6a42ec3f6: Status 404 returned error can't find the container with id 6a7d57b995be842c9df84dbcd96e45662d86ccb674e23e45fdfd76f6a42ec3f6 Jun 02 18:48:54.449418 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:54.449393 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-cvmdn"] Jun 02 18:48:54.522700 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:54.522671 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" event={"ID":"0628bca8-aa64-41cc-9921-235c2f93de87","Type":"ContainerStarted","Data":"6a7d57b995be842c9df84dbcd96e45662d86ccb674e23e45fdfd76f6a42ec3f6"} Jun 02 18:48:58.538064 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:58.538022 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" event={"ID":"0628bca8-aa64-41cc-9921-235c2f93de87","Type":"ContainerStarted","Data":"3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b"} Jun 02 18:48:58.556683 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:58.556639 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" podStartSLOduration=2.508743426 podStartE2EDuration="5.55662479s" podCreationTimestamp="2026-06-02 18:48:53 +0000 UTC" firstStartedPulling="2026-06-02 18:48:54.450538841 +0000 UTC m=+549.263001631" lastFinishedPulling="2026-06-02 18:48:57.498420193 +0000 UTC m=+552.310882995" observedRunningTime="2026-06-02 18:48:58.555858345 +0000 UTC m=+553.368321156" watchObservedRunningTime="2026-06-02 18:48:58.55662479 +0000 UTC m=+553.369087600" Jun 02 18:48:58.981121 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:48:58.981081 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-cvmdn"] Jun 02 18:49:00.544267 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:00.544227 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" podUID="0628bca8-aa64-41cc-9921-235c2f93de87" containerName="authorino" containerID="cri-o://3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b" gracePeriod=30 Jun 02 18:49:00.783504 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:00.783479 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" Jun 02 18:49:00.816807 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:00.816715 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9g42\" (UniqueName: \"kubernetes.io/projected/0628bca8-aa64-41cc-9921-235c2f93de87-kube-api-access-r9g42\") pod \"0628bca8-aa64-41cc-9921-235c2f93de87\" (UID: \"0628bca8-aa64-41cc-9921-235c2f93de87\") " Jun 02 18:49:00.818760 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:00.818738 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0628bca8-aa64-41cc-9921-235c2f93de87-kube-api-access-r9g42" (OuterVolumeSpecName: "kube-api-access-r9g42") pod "0628bca8-aa64-41cc-9921-235c2f93de87" (UID: "0628bca8-aa64-41cc-9921-235c2f93de87"). InnerVolumeSpecName "kube-api-access-r9g42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:49:00.917469 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:00.917432 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9g42\" (UniqueName: \"kubernetes.io/projected/0628bca8-aa64-41cc-9921-235c2f93de87-kube-api-access-r9g42\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:49:01.548679 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.548639 2567 generic.go:358] "Generic (PLEG): container finished" podID="0628bca8-aa64-41cc-9921-235c2f93de87" containerID="3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b" exitCode=0 Jun 02 18:49:01.549150 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.548688 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" Jun 02 18:49:01.549150 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.548691 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" event={"ID":"0628bca8-aa64-41cc-9921-235c2f93de87","Type":"ContainerDied","Data":"3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b"} Jun 02 18:49:01.549150 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.548726 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-cvmdn" event={"ID":"0628bca8-aa64-41cc-9921-235c2f93de87","Type":"ContainerDied","Data":"6a7d57b995be842c9df84dbcd96e45662d86ccb674e23e45fdfd76f6a42ec3f6"} Jun 02 18:49:01.549150 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.548744 2567 scope.go:117] "RemoveContainer" containerID="3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b" Jun 02 18:49:01.557633 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.557612 2567 scope.go:117] "RemoveContainer" containerID="3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b" Jun 02 18:49:01.557903 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:49:01.557883 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b\": container with ID starting with 3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b not found: ID does not exist" containerID="3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b" Jun 02 18:49:01.557956 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.557911 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b"} err="failed to get container status \"3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b\": rpc error: code = NotFound desc = could not find container \"3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b\": container with ID starting with 3b20b96e1534b7015bd71ecdf64fdd974f8bb6f4b7904f405040c0bcee30604b not found: ID does not exist" Jun 02 18:49:01.579818 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.579791 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-cvmdn"] Jun 02 18:49:01.587455 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.587433 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-cvmdn"] Jun 02 18:49:01.710956 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:01.710912 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0628bca8-aa64-41cc-9921-235c2f93de87" path="/var/lib/kubelet/pods/0628bca8-aa64-41cc-9921-235c2f93de87/volumes" Jun 02 18:49:45.650516 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:45.650489 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:49:45.651023 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:45.650902 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:49:57.371126 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.371045 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:49:57.371601 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.371569 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0628bca8-aa64-41cc-9921-235c2f93de87" containerName="authorino" Jun 02 18:49:57.371601 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.371592 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0628bca8-aa64-41cc-9921-235c2f93de87" containerName="authorino" Jun 02 18:49:57.371733 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.371719 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="0628bca8-aa64-41cc-9921-235c2f93de87" containerName="authorino" Jun 02 18:49:57.375152 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.375133 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 18:49:57.379224 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.379202 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 18:49:57.379337 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.379317 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 18:49:57.379594 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.379578 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v4pqn\"" Jun 02 18:49:57.380618 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.380600 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 18:49:57.467061 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.467033 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:49:57.474922 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.474898 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmfv4\" (UniqueName: \"kubernetes.io/projected/9c091b8d-9732-441b-b5eb-f4a76acb5ddc-kube-api-access-kmfv4\") pod \"maas-keycloak-0\" (UID: \"9c091b8d-9732-441b-b5eb-f4a76acb5ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:49:57.576386 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.576347 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kmfv4\" (UniqueName: \"kubernetes.io/projected/9c091b8d-9732-441b-b5eb-f4a76acb5ddc-kube-api-access-kmfv4\") pod \"maas-keycloak-0\" (UID: \"9c091b8d-9732-441b-b5eb-f4a76acb5ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:49:57.596814 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.596779 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmfv4\" (UniqueName: \"kubernetes.io/projected/9c091b8d-9732-441b-b5eb-f4a76acb5ddc-kube-api-access-kmfv4\") pod \"maas-keycloak-0\" (UID: \"9c091b8d-9732-441b-b5eb-f4a76acb5ddc\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:49:57.684768 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.684707 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 18:49:57.829590 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:57.829559 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:49:57.833672 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:49:57.833644 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c091b8d_9732_441b_b5eb_f4a76acb5ddc.slice/crio-e3259f5a51969c55db42dc2aa0681feedfab99cc98ad527798611166e6c1df78 WatchSource:0}: Error finding container e3259f5a51969c55db42dc2aa0681feedfab99cc98ad527798611166e6c1df78: Status 404 returned error can't find the container with id e3259f5a51969c55db42dc2aa0681feedfab99cc98ad527798611166e6c1df78 Jun 02 18:49:58.739446 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:49:58.739402 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9c091b8d-9732-441b-b5eb-f4a76acb5ddc","Type":"ContainerStarted","Data":"e3259f5a51969c55db42dc2aa0681feedfab99cc98ad527798611166e6c1df78"} Jun 02 18:50:03.759884 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:03.759780 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9c091b8d-9732-441b-b5eb-f4a76acb5ddc","Type":"ContainerStarted","Data":"b9d0be94f8bfa5e1cbb211aab20e9c375b2db8ce9eff01c53f250f0fd1dab229"} Jun 02 18:50:03.781798 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:03.781741 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.242601056 podStartE2EDuration="6.781723704s" podCreationTimestamp="2026-06-02 18:49:57 +0000 UTC" firstStartedPulling="2026-06-02 18:49:57.834884018 +0000 UTC m=+612.647346806" lastFinishedPulling="2026-06-02 18:50:03.374006665 +0000 UTC m=+618.186469454" observedRunningTime="2026-06-02 18:50:03.780708391 +0000 UTC m=+618.593171255" watchObservedRunningTime="2026-06-02 18:50:03.781723704 +0000 UTC m=+618.594186517" Jun 02 18:50:04.685219 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:04.685156 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 18:50:04.687081 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:04.687031 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:05.686138 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:05.686082 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:06.685496 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:06.685448 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:07.685501 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:07.685445 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 18:50:07.685989 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:07.685804 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:08.686020 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:08.685972 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:09.685380 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:09.685331 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:10.686285 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:10.686214 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:11.685448 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:11.685395 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:12.685830 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:12.685790 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:13.685713 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:13.685665 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:14.685529 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:14.685486 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:15.685365 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:15.685324 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 02 18:50:16.789962 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:16.789910 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 18:50:16.808870 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:16.808821 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:50:26.797158 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:26.797124 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 18:50:33.127559 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.127519 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d7d67f8c9-qfcnn"] Jun 02 18:50:33.130994 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.130973 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:33.134832 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.134811 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cspr6\"" Jun 02 18:50:33.135332 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.135312 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 02 18:50:33.147126 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.147102 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d7d67f8c9-qfcnn"] Jun 02 18:50:33.204241 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.204204 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzls\" (UniqueName: \"kubernetes.io/projected/238b9033-2ecb-450c-9b23-936e7e05e3f9-kube-api-access-8nzls\") pod \"maas-controller-7d7d67f8c9-qfcnn\" (UID: \"238b9033-2ecb-450c-9b23-936e7e05e3f9\") " pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:33.297050 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.297018 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6686679c54-vjhhv"] Jun 02 18:50:33.300308 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.300290 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6686679c54-vjhhv" Jun 02 18:50:33.304722 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.304698 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzls\" (UniqueName: \"kubernetes.io/projected/238b9033-2ecb-450c-9b23-936e7e05e3f9-kube-api-access-8nzls\") pod \"maas-controller-7d7d67f8c9-qfcnn\" (UID: \"238b9033-2ecb-450c-9b23-936e7e05e3f9\") " pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:33.313813 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.313789 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6686679c54-vjhhv"] Jun 02 18:50:33.317451 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.317424 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzls\" (UniqueName: \"kubernetes.io/projected/238b9033-2ecb-450c-9b23-936e7e05e3f9-kube-api-access-8nzls\") pod \"maas-controller-7d7d67f8c9-qfcnn\" (UID: \"238b9033-2ecb-450c-9b23-936e7e05e3f9\") " pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:33.406140 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.406061 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr4dl\" (UniqueName: \"kubernetes.io/projected/8cc671c1-888e-463f-9721-98189ee7183c-kube-api-access-wr4dl\") pod \"maas-controller-6686679c54-vjhhv\" (UID: \"8cc671c1-888e-463f-9721-98189ee7183c\") " pod="opendatahub/maas-controller-6686679c54-vjhhv" Jun 02 18:50:33.442525 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.442500 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:33.506695 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.506666 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wr4dl\" (UniqueName: \"kubernetes.io/projected/8cc671c1-888e-463f-9721-98189ee7183c-kube-api-access-wr4dl\") pod \"maas-controller-6686679c54-vjhhv\" (UID: \"8cc671c1-888e-463f-9721-98189ee7183c\") " pod="opendatahub/maas-controller-6686679c54-vjhhv" Jun 02 18:50:33.515799 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.515770 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr4dl\" (UniqueName: \"kubernetes.io/projected/8cc671c1-888e-463f-9721-98189ee7183c-kube-api-access-wr4dl\") pod \"maas-controller-6686679c54-vjhhv\" (UID: \"8cc671c1-888e-463f-9721-98189ee7183c\") " pod="opendatahub/maas-controller-6686679c54-vjhhv" Jun 02 18:50:33.566759 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.566734 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d7d67f8c9-qfcnn"] Jun 02 18:50:33.569086 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:50:33.569057 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238b9033_2ecb_450c_9b23_936e7e05e3f9.slice/crio-91e4af20f9fbf59998902dbeaf6977af0ff309cd30f20516b8297eb6e234e765 WatchSource:0}: Error finding container 91e4af20f9fbf59998902dbeaf6977af0ff309cd30f20516b8297eb6e234e765: Status 404 returned error can't find the container with id 91e4af20f9fbf59998902dbeaf6977af0ff309cd30f20516b8297eb6e234e765 Jun 02 18:50:33.610230 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.610202 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6686679c54-vjhhv" Jun 02 18:50:33.745172 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.745004 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6686679c54-vjhhv"] Jun 02 18:50:33.747895 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:50:33.747862 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc671c1_888e_463f_9721_98189ee7183c.slice/crio-f2c197140a6e3a51d1d42e9f911da39c57173666fd51f6eccc573c700088327d WatchSource:0}: Error finding container f2c197140a6e3a51d1d42e9f911da39c57173666fd51f6eccc573c700088327d: Status 404 returned error can't find the container with id f2c197140a6e3a51d1d42e9f911da39c57173666fd51f6eccc573c700088327d Jun 02 18:50:33.873436 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.873403 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6686679c54-vjhhv" event={"ID":"8cc671c1-888e-463f-9721-98189ee7183c","Type":"ContainerStarted","Data":"f2c197140a6e3a51d1d42e9f911da39c57173666fd51f6eccc573c700088327d"} Jun 02 18:50:33.874456 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:33.874432 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" event={"ID":"238b9033-2ecb-450c-9b23-936e7e05e3f9","Type":"ContainerStarted","Data":"91e4af20f9fbf59998902dbeaf6977af0ff309cd30f20516b8297eb6e234e765"} Jun 02 18:50:36.888593 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:36.888544 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6686679c54-vjhhv" event={"ID":"8cc671c1-888e-463f-9721-98189ee7183c","Type":"ContainerStarted","Data":"0b62803c1c888f7df6219379b475f846b57c902be6164d424faa7b2370a230bb"} Jun 02 18:50:36.889000 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:36.888635 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6686679c54-vjhhv" Jun 02 18:50:36.889878 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:36.889854 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" event={"ID":"238b9033-2ecb-450c-9b23-936e7e05e3f9","Type":"ContainerStarted","Data":"a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552"} Jun 02 18:50:36.889980 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:36.889968 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:36.922856 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:36.922801 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6686679c54-vjhhv" podStartSLOduration=1.505091643 podStartE2EDuration="3.922784447s" podCreationTimestamp="2026-06-02 18:50:33 +0000 UTC" firstStartedPulling="2026-06-02 18:50:33.749311104 +0000 UTC m=+648.561773894" lastFinishedPulling="2026-06-02 18:50:36.167003892 +0000 UTC m=+650.979466698" observedRunningTime="2026-06-02 18:50:36.922458189 +0000 UTC m=+651.734921003" watchObservedRunningTime="2026-06-02 18:50:36.922784447 +0000 UTC m=+651.735247269" Jun 02 18:50:36.957483 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:36.957428 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" podStartSLOduration=1.370306448 podStartE2EDuration="3.957412079s" podCreationTimestamp="2026-06-02 18:50:33 +0000 UTC" firstStartedPulling="2026-06-02 18:50:33.570355156 +0000 UTC m=+648.382817946" lastFinishedPulling="2026-06-02 18:50:36.157460772 +0000 UTC m=+650.969923577" observedRunningTime="2026-06-02 18:50:36.947000264 +0000 UTC m=+651.759463074" watchObservedRunningTime="2026-06-02 18:50:36.957412079 +0000 UTC m=+651.769874884" Jun 02 18:50:47.898540 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:47.898508 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:47.899017 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:47.898911 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6686679c54-vjhhv" Jun 02 18:50:47.959549 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:47.959508 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d7d67f8c9-qfcnn"] Jun 02 18:50:47.959729 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:47.959713 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" podUID="238b9033-2ecb-450c-9b23-936e7e05e3f9" containerName="manager" containerID="cri-o://a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552" gracePeriod=30 Jun 02 18:50:48.198224 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.198203 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:48.325789 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.325753 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nzls\" (UniqueName: \"kubernetes.io/projected/238b9033-2ecb-450c-9b23-936e7e05e3f9-kube-api-access-8nzls\") pod \"238b9033-2ecb-450c-9b23-936e7e05e3f9\" (UID: \"238b9033-2ecb-450c-9b23-936e7e05e3f9\") " Jun 02 18:50:48.327832 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.327801 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/238b9033-2ecb-450c-9b23-936e7e05e3f9-kube-api-access-8nzls" (OuterVolumeSpecName: "kube-api-access-8nzls") pod "238b9033-2ecb-450c-9b23-936e7e05e3f9" (UID: "238b9033-2ecb-450c-9b23-936e7e05e3f9"). InnerVolumeSpecName "kube-api-access-8nzls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:50:48.427154 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.427113 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nzls\" (UniqueName: \"kubernetes.io/projected/238b9033-2ecb-450c-9b23-936e7e05e3f9-kube-api-access-8nzls\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:50:48.931886 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.931848 2567 generic.go:358] "Generic (PLEG): container finished" podID="238b9033-2ecb-450c-9b23-936e7e05e3f9" containerID="a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552" exitCode=0 Jun 02 18:50:48.932375 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.931914 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" Jun 02 18:50:48.932375 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.931937 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" event={"ID":"238b9033-2ecb-450c-9b23-936e7e05e3f9","Type":"ContainerDied","Data":"a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552"} Jun 02 18:50:48.932375 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.931983 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d7d67f8c9-qfcnn" event={"ID":"238b9033-2ecb-450c-9b23-936e7e05e3f9","Type":"ContainerDied","Data":"91e4af20f9fbf59998902dbeaf6977af0ff309cd30f20516b8297eb6e234e765"} Jun 02 18:50:48.932375 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.932004 2567 scope.go:117] "RemoveContainer" containerID="a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552" Jun 02 18:50:48.942464 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.942441 2567 scope.go:117] "RemoveContainer" containerID="a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552" Jun 02 18:50:48.942746 ip-10-0-140-185 kubenswrapper[2567]: E0602 18:50:48.942724 2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552\": container with ID starting with a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552 not found: ID does not exist" containerID="a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552" Jun 02 18:50:48.942797 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.942756 2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552"} err="failed to get container status \"a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552\": rpc error: code = NotFound desc = could not find container \"a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552\": container with ID starting with a28db21c9a9c982d3cd864ecea8ff05fab94f72f75c0e2ff2cc4f2b0a24ad552 not found: ID does not exist" Jun 02 18:50:48.956578 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.956551 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d7d67f8c9-qfcnn"] Jun 02 18:50:48.960943 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:48.960921 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d7d67f8c9-qfcnn"] Jun 02 18:50:49.711916 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:50:49.711882 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="238b9033-2ecb-450c-9b23-936e7e05e3f9" path="/var/lib/kubelet/pods/238b9033-2ecb-450c-9b23-936e7e05e3f9/volumes" Jun 02 18:51:09.539690 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.539648 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7855c9d57f-wf7vf"] Jun 02 18:51:09.540090 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.540077 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="238b9033-2ecb-450c-9b23-936e7e05e3f9" containerName="manager" Jun 02 18:51:09.540090 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.540091 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="238b9033-2ecb-450c-9b23-936e7e05e3f9" containerName="manager" Jun 02 18:51:09.540174 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.540161 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="238b9033-2ecb-450c-9b23-936e7e05e3f9" containerName="manager" Jun 02 18:51:09.546327 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.546305 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:09.550566 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.550543 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 02 18:51:09.550566 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.550559 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-gwttc\"" Jun 02 18:51:09.558467 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.558448 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7855c9d57f-wf7vf"] Jun 02 18:51:09.706557 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.706526 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1640c4e2-f590-4f75-bd0d-abbcdf4f3553-maas-api-tls\") pod \"maas-api-7855c9d57f-wf7vf\" (UID: \"1640c4e2-f590-4f75-bd0d-abbcdf4f3553\") " pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:09.706713 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.706581 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff6mz\" (UniqueName: \"kubernetes.io/projected/1640c4e2-f590-4f75-bd0d-abbcdf4f3553-kube-api-access-ff6mz\") pod \"maas-api-7855c9d57f-wf7vf\" (UID: \"1640c4e2-f590-4f75-bd0d-abbcdf4f3553\") " pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:09.807073 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.806992 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1640c4e2-f590-4f75-bd0d-abbcdf4f3553-maas-api-tls\") pod \"maas-api-7855c9d57f-wf7vf\" (UID: \"1640c4e2-f590-4f75-bd0d-abbcdf4f3553\") " pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:09.807073 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.807054 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ff6mz\" (UniqueName: \"kubernetes.io/projected/1640c4e2-f590-4f75-bd0d-abbcdf4f3553-kube-api-access-ff6mz\") pod \"maas-api-7855c9d57f-wf7vf\" (UID: \"1640c4e2-f590-4f75-bd0d-abbcdf4f3553\") " pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:09.809416 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.809386 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1640c4e2-f590-4f75-bd0d-abbcdf4f3553-maas-api-tls\") pod \"maas-api-7855c9d57f-wf7vf\" (UID: \"1640c4e2-f590-4f75-bd0d-abbcdf4f3553\") " pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:09.824731 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.824710 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff6mz\" (UniqueName: \"kubernetes.io/projected/1640c4e2-f590-4f75-bd0d-abbcdf4f3553-kube-api-access-ff6mz\") pod \"maas-api-7855c9d57f-wf7vf\" (UID: \"1640c4e2-f590-4f75-bd0d-abbcdf4f3553\") " pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:09.857793 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:09.857767 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:10.023981 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:10.023943 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7855c9d57f-wf7vf"] Jun 02 18:51:10.024730 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:51:10.024703 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1640c4e2_f590_4f75_bd0d_abbcdf4f3553.slice/crio-6b92526b8055e70c0fc60d260b2777928b9cd64ee9945aca77d60c827c716198 WatchSource:0}: Error finding container 6b92526b8055e70c0fc60d260b2777928b9cd64ee9945aca77d60c827c716198: Status 404 returned error can't find the container with id 6b92526b8055e70c0fc60d260b2777928b9cd64ee9945aca77d60c827c716198 Jun 02 18:51:10.025892 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:10.025866 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:51:11.005133 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:11.005096 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7855c9d57f-wf7vf" event={"ID":"1640c4e2-f590-4f75-bd0d-abbcdf4f3553","Type":"ContainerStarted","Data":"6b92526b8055e70c0fc60d260b2777928b9cd64ee9945aca77d60c827c716198"} Jun 02 18:51:12.010278 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:12.010244 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7855c9d57f-wf7vf" event={"ID":"1640c4e2-f590-4f75-bd0d-abbcdf4f3553","Type":"ContainerStarted","Data":"d079f79cccdcc51d3d089b3ffcad1955cce70f99570a2aecadc5d9597b947d73"} Jun 02 18:51:12.010604 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:12.010358 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:12.030592 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:12.030547 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7855c9d57f-wf7vf" podStartSLOduration=1.143797895 podStartE2EDuration="3.030530483s" podCreationTimestamp="2026-06-02 18:51:09 +0000 UTC" firstStartedPulling="2026-06-02 18:51:10.026020715 +0000 UTC m=+684.838483504" lastFinishedPulling="2026-06-02 18:51:11.912753294 +0000 UTC m=+686.725216092" observedRunningTime="2026-06-02 18:51:12.028256312 +0000 UTC m=+686.840719124" watchObservedRunningTime="2026-06-02 18:51:12.030530483 +0000 UTC m=+686.842993296" Jun 02 18:51:18.020013 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:18.019982 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7855c9d57f-wf7vf" Jun 02 18:51:20.432602 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:20.432570 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:51:20.433115 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:20.432801 2567 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" containerID="cri-o://b9d0be94f8bfa5e1cbb211aab20e9c375b2db8ce9eff01c53f250f0fd1dab229" gracePeriod=30 Jun 02 18:51:22.045482 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:22.045450 2567 generic.go:358] "Generic (PLEG): container finished" podID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerID="b9d0be94f8bfa5e1cbb211aab20e9c375b2db8ce9eff01c53f250f0fd1dab229" exitCode=143 Jun 02 18:51:22.045846 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:22.045520 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9c091b8d-9732-441b-b5eb-f4a76acb5ddc","Type":"ContainerDied","Data":"b9d0be94f8bfa5e1cbb211aab20e9c375b2db8ce9eff01c53f250f0fd1dab229"} Jun 02 18:51:22.071434 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:22.071404 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:22.120030 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:22.119995 2567 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmfv4\" (UniqueName: \"kubernetes.io/projected/9c091b8d-9732-441b-b5eb-f4a76acb5ddc-kube-api-access-kmfv4\") pod \"9c091b8d-9732-441b-b5eb-f4a76acb5ddc\" (UID: \"9c091b8d-9732-441b-b5eb-f4a76acb5ddc\") " Jun 02 18:51:22.122258 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:22.122232 2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c091b8d-9732-441b-b5eb-f4a76acb5ddc-kube-api-access-kmfv4" (OuterVolumeSpecName: "kube-api-access-kmfv4") pod "9c091b8d-9732-441b-b5eb-f4a76acb5ddc" (UID: "9c091b8d-9732-441b-b5eb-f4a76acb5ddc"). InnerVolumeSpecName "kube-api-access-kmfv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 18:51:22.220733 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:22.220699 2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmfv4\" (UniqueName: \"kubernetes.io/projected/9c091b8d-9732-441b-b5eb-f4a76acb5ddc-kube-api-access-kmfv4\") on node \"ip-10-0-140-185.ec2.internal\" DevicePath \"\"" Jun 02 18:51:23.050940 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.050906 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9c091b8d-9732-441b-b5eb-f4a76acb5ddc","Type":"ContainerDied","Data":"e3259f5a51969c55db42dc2aa0681feedfab99cc98ad527798611166e6c1df78"} Jun 02 18:51:23.051341 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.050950 2567 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.051341 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.050957 2567 scope.go:117] "RemoveContainer" containerID="b9d0be94f8bfa5e1cbb211aab20e9c375b2db8ce9eff01c53f250f0fd1dab229" Jun 02 18:51:23.076946 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.076915 2567 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:51:23.086513 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.086489 2567 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:51:23.115837 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.115802 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:51:23.116223 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.116207 2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" Jun 02 18:51:23.116307 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.116225 2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" Jun 02 18:51:23.116307 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.116300 2567 memory_manager.go:356] "RemoveStaleState removing state" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" containerName="keycloak" Jun 02 18:51:23.120434 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.120417 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.123913 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.123895 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 18:51:23.124151 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.124136 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 18:51:23.124702 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.124687 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-v4pqn\"" Jun 02 18:51:23.124798 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.124779 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 02 18:51:23.125358 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.125338 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 02 18:51:23.125836 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.125815 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/bfe3d853-4162-47ed-a4d2-8c7042b0997d-test-realms\") pod \"maas-keycloak-0\" (UID: \"bfe3d853-4162-47ed-a4d2-8c7042b0997d\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.125944 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.125867 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dncht\" (UniqueName: \"kubernetes.io/projected/bfe3d853-4162-47ed-a4d2-8c7042b0997d-kube-api-access-dncht\") pod \"maas-keycloak-0\" (UID: \"bfe3d853-4162-47ed-a4d2-8c7042b0997d\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.130841 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.130820 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:51:23.226817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.226788 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/bfe3d853-4162-47ed-a4d2-8c7042b0997d-test-realms\") pod \"maas-keycloak-0\" (UID: \"bfe3d853-4162-47ed-a4d2-8c7042b0997d\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.226976 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.226837 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dncht\" (UniqueName: \"kubernetes.io/projected/bfe3d853-4162-47ed-a4d2-8c7042b0997d-kube-api-access-dncht\") pod \"maas-keycloak-0\" (UID: \"bfe3d853-4162-47ed-a4d2-8c7042b0997d\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.227591 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.227566 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/bfe3d853-4162-47ed-a4d2-8c7042b0997d-test-realms\") pod \"maas-keycloak-0\" (UID: \"bfe3d853-4162-47ed-a4d2-8c7042b0997d\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.238433 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.238411 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dncht\" (UniqueName: \"kubernetes.io/projected/bfe3d853-4162-47ed-a4d2-8c7042b0997d-kube-api-access-dncht\") pod \"maas-keycloak-0\" (UID: \"bfe3d853-4162-47ed-a4d2-8c7042b0997d\") " pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.430115 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.430079 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:23.564571 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.564547 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 02 18:51:23.566591 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:51:23.566564 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe3d853_4162_47ed_a4d2_8c7042b0997d.slice/crio-f90684b29e1c11968580452d3dc856382849b030b4b62ef12a030c4b5480ead5 WatchSource:0}: Error finding container f90684b29e1c11968580452d3dc856382849b030b4b62ef12a030c4b5480ead5: Status 404 returned error can't find the container with id f90684b29e1c11968580452d3dc856382849b030b4b62ef12a030c4b5480ead5 Jun 02 18:51:23.711030 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:23.710950 2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c091b8d-9732-441b-b5eb-f4a76acb5ddc" path="/var/lib/kubelet/pods/9c091b8d-9732-441b-b5eb-f4a76acb5ddc/volumes" Jun 02 18:51:24.058658 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:24.058624 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bfe3d853-4162-47ed-a4d2-8c7042b0997d","Type":"ContainerStarted","Data":"7425bcc747dceb47cc739fcd659e85534c2c381b0dd110da85b5568b55dd5713"} Jun 02 18:51:24.058658 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:24.058660 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bfe3d853-4162-47ed-a4d2-8c7042b0997d","Type":"ContainerStarted","Data":"f90684b29e1c11968580452d3dc856382849b030b4b62ef12a030c4b5480ead5"} Jun 02 18:51:24.092601 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:24.092546 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.73912767 podStartE2EDuration="1.09253061s" podCreationTimestamp="2026-06-02 18:51:23 +0000 UTC" firstStartedPulling="2026-06-02 18:51:23.567942011 +0000 UTC m=+698.380404800" lastFinishedPulling="2026-06-02 18:51:23.921344944 +0000 UTC m=+698.733807740" observedRunningTime="2026-06-02 18:51:24.089635108 +0000 UTC m=+698.902097920" watchObservedRunningTime="2026-06-02 18:51:24.09253061 +0000 UTC m=+698.904993421" Jun 02 18:51:24.431252 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:24.431208 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:24.432909 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:24.432862 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:25.431355 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:25.431307 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:26.431140 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:26.431084 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:27.431065 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:27.430996 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:28.430848 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:28.430801 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:29.430812 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:29.430753 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:30.431029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:30.430970 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:31.431434 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:31.431372 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:32.431643 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:32.431569 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:33.430269 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:33.430225 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:33.430522 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:33.430488 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:34.431040 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:34.430989 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:35.431517 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:35.431463 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:36.431176 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:36.431128 2567 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.33:9000/health/started\": dial tcp 10.132.0.33:9000: connect: connection refused" Jun 02 18:51:37.562652 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:37.562613 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 02 18:51:37.582622 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:37.582577 2567 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bfe3d853-4162-47ed-a4d2-8c7042b0997d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 02 18:51:47.570391 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:51:47.570353 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 02 18:52:43.640839 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.640806 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2"] Jun 02 18:52:43.644491 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.644469 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.647359 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.647338 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 18:52:43.648742 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.648723 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 18:52:43.648833 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.648803 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qgnlc\"" Jun 02 18:52:43.648892 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.648829 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 02 18:52:43.654546 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.654524 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2"] Jun 02 18:52:43.716036 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.716014 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427134cf-ee96-4e88-8190-2b0d115bfbcb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.716159 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.716050 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.716159 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.716075 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.716159 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.716115 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.716335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.716237 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.716335 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.716276 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sxr2\" (UniqueName: \"kubernetes.io/projected/427134cf-ee96-4e88-8190-2b0d115bfbcb-kube-api-access-5sxr2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817369 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817339 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817502 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817384 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5sxr2\" (UniqueName: \"kubernetes.io/projected/427134cf-ee96-4e88-8190-2b0d115bfbcb-kube-api-access-5sxr2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817502 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817409 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427134cf-ee96-4e88-8190-2b0d115bfbcb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817502 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817433 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817653 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817589 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817653 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817633 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817772 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817752 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.817920 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.817904 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.818017 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.818000 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.819686 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.819666 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/427134cf-ee96-4e88-8190-2b0d115bfbcb-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.819931 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.819914 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/427134cf-ee96-4e88-8190-2b0d115bfbcb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.835411 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.835390 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sxr2\" (UniqueName: \"kubernetes.io/projected/427134cf-ee96-4e88-8190-2b0d115bfbcb-kube-api-access-5sxr2\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2\" (UID: \"427134cf-ee96-4e88-8190-2b0d115bfbcb\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:43.956702 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:43.956604 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:44.086308 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:44.086276 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2"] Jun 02 18:52:44.088820 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:52:44.088787 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427134cf_ee96_4e88_8190_2b0d115bfbcb.slice/crio-3f8a8990d28d2f0a9e1feabd29908e8f2615177cf0f38ce83927fdd02d70367b WatchSource:0}: Error finding container 3f8a8990d28d2f0a9e1feabd29908e8f2615177cf0f38ce83927fdd02d70367b: Status 404 returned error can't find the container with id 3f8a8990d28d2f0a9e1feabd29908e8f2615177cf0f38ce83927fdd02d70367b Jun 02 18:52:44.360239 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:44.360209 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" event={"ID":"427134cf-ee96-4e88-8190-2b0d115bfbcb","Type":"ContainerStarted","Data":"3f8a8990d28d2f0a9e1feabd29908e8f2615177cf0f38ce83927fdd02d70367b"} Jun 02 18:52:48.379091 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:48.379050 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" event={"ID":"427134cf-ee96-4e88-8190-2b0d115bfbcb","Type":"ContainerStarted","Data":"b9a13cbbb0f495140d34fd40a360aa587d77144df921dd24c3ef70ba3b4f3725"} Jun 02 18:52:49.383510 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:49.383474 2567 generic.go:358] "Generic (PLEG): container finished" podID="427134cf-ee96-4e88-8190-2b0d115bfbcb" containerID="b9a13cbbb0f495140d34fd40a360aa587d77144df921dd24c3ef70ba3b4f3725" exitCode=0 Jun 02 18:52:49.383893 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:49.383544 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" event={"ID":"427134cf-ee96-4e88-8190-2b0d115bfbcb","Type":"ContainerDied","Data":"b9a13cbbb0f495140d34fd40a360aa587d77144df921dd24c3ef70ba3b4f3725"} Jun 02 18:52:51.392380 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:51.392345 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" event={"ID":"427134cf-ee96-4e88-8190-2b0d115bfbcb","Type":"ContainerStarted","Data":"cbf811df642b64e292ec4bb803683f4b09fbf8b730ed33789677e1c9ba30bf23"} Jun 02 18:52:51.416682 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:51.416636 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" podStartSLOduration=2.021567672 podStartE2EDuration="8.416621281s" podCreationTimestamp="2026-06-02 18:52:43 +0000 UTC" firstStartedPulling="2026-06-02 18:52:44.090721601 +0000 UTC m=+778.903184390" lastFinishedPulling="2026-06-02 18:52:50.485775195 +0000 UTC m=+785.298237999" observedRunningTime="2026-06-02 18:52:51.412974419 +0000 UTC m=+786.225437230" watchObservedRunningTime="2026-06-02 18:52:51.416621281 +0000 UTC m=+786.229084141" Jun 02 18:52:53.957620 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:53.957589 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:53.957983 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:53.957636 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:53.970281 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:53.970258 2567 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:52:54.412439 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:52:54.412413 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2" Jun 02 18:54:45.673769 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:54:45.673738 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:54:45.675619 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:54:45.675591 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:59:20.849602 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:20.849515 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7855c9d57f-wf7vf_1640c4e2-f590-4f75-bd0d-abbcdf4f3553/maas-api/0.log" Jun 02 18:59:20.964127 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:20.964094 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686679c54-vjhhv_8cc671c1-888e-463f-9721-98189ee7183c/manager/0.log" Jun 02 18:59:21.285409 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:21.285337 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-mgdmv_9ae0ec40-cd62-405d-be63-83b6ebd38ead/copy-manifests/0.log" Jun 02 18:59:21.303523 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:21.303491 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-mgdmv_9ae0ec40-cd62-405d-be63-83b6ebd38ead/manager/0.log" Jun 02 18:59:23.434629 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:23.434602 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-kkl4m_352d895d-d05d-40fc-aa7f-4d7dee012672/manager/0.log" Jun 02 18:59:23.651229 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:23.651197 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xr6pw_55536d5e-aebf-46f7-a3a7-61cb45192a3d/manager/0.log" Jun 02 18:59:24.330495 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:24.330466 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6c8b7568-v2cgp_01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b/kube-auth-proxy/0.log" Jun 02 18:59:24.655542 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:24.655512 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-87c65c465-xbm49_4346b2eb-596b-4b3f-a08a-dd6833c46230/router/0.log" Jun 02 18:59:25.211419 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:25.211389 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2_427134cf-ee96-4e88-8190-2b0d115bfbcb/storage-initializer/0.log" Jun 02 18:59:25.218874 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:25.218850 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-225k2_427134cf-ee96-4e88-8190-2b0d115bfbcb/main/0.log" Jun 02 18:59:29.615707 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.615672 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w4k8q/must-gather-c2smw"] Jun 02 18:59:29.619565 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.619548 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:29.624549 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.624528 2567 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w4k8q\"/\"default-dockercfg-tfwvc\"" Jun 02 18:59:29.625715 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.625695 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4k8q\"/\"kube-root-ca.crt\"" Jun 02 18:59:29.628719 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.628703 2567 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w4k8q\"/\"openshift-service-ca.crt\"" Jun 02 18:59:29.648409 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.648385 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/must-gather-c2smw"] Jun 02 18:59:29.718443 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.718418 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7984r\" (UniqueName: \"kubernetes.io/projected/03bfc1d8-ace4-4c40-be77-1f723ca4b51c-kube-api-access-7984r\") pod \"must-gather-c2smw\" (UID: \"03bfc1d8-ace4-4c40-be77-1f723ca4b51c\") " pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:29.718571 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.718449 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/03bfc1d8-ace4-4c40-be77-1f723ca4b51c-must-gather-output\") pod \"must-gather-c2smw\" (UID: \"03bfc1d8-ace4-4c40-be77-1f723ca4b51c\") " pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:29.819817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.819789 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7984r\" (UniqueName: \"kubernetes.io/projected/03bfc1d8-ace4-4c40-be77-1f723ca4b51c-kube-api-access-7984r\") pod \"must-gather-c2smw\" (UID: \"03bfc1d8-ace4-4c40-be77-1f723ca4b51c\") " pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:29.819817 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.819820 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/03bfc1d8-ace4-4c40-be77-1f723ca4b51c-must-gather-output\") pod \"must-gather-c2smw\" (UID: \"03bfc1d8-ace4-4c40-be77-1f723ca4b51c\") " pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:29.820142 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.820127 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/03bfc1d8-ace4-4c40-be77-1f723ca4b51c-must-gather-output\") pod \"must-gather-c2smw\" (UID: \"03bfc1d8-ace4-4c40-be77-1f723ca4b51c\") " pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:29.829008 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.828978 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7984r\" (UniqueName: \"kubernetes.io/projected/03bfc1d8-ace4-4c40-be77-1f723ca4b51c-kube-api-access-7984r\") pod \"must-gather-c2smw\" (UID: \"03bfc1d8-ace4-4c40-be77-1f723ca4b51c\") " pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:29.939558 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:29.939479 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/must-gather-c2smw" Jun 02 18:59:30.067852 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:30.067828 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/must-gather-c2smw"] Jun 02 18:59:30.070292 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:59:30.070254 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03bfc1d8_ace4_4c40_be77_1f723ca4b51c.slice/crio-228d87b46e079786078e2986ab1055174c31e1c8a18a4eb300dbf7f9a05098d8 WatchSource:0}: Error finding container 228d87b46e079786078e2986ab1055174c31e1c8a18a4eb300dbf7f9a05098d8: Status 404 returned error can't find the container with id 228d87b46e079786078e2986ab1055174c31e1c8a18a4eb300dbf7f9a05098d8 Jun 02 18:59:30.071905 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:30.071885 2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 18:59:30.731999 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:30.731961 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/must-gather-c2smw" event={"ID":"03bfc1d8-ace4-4c40-be77-1f723ca4b51c","Type":"ContainerStarted","Data":"228d87b46e079786078e2986ab1055174c31e1c8a18a4eb300dbf7f9a05098d8"} Jun 02 18:59:31.739544 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:31.739504 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/must-gather-c2smw" event={"ID":"03bfc1d8-ace4-4c40-be77-1f723ca4b51c","Type":"ContainerStarted","Data":"0940f8027cea0d6b74d3eb2ce4bff8678707b72e3e24bb8fbf38f6fba01b1a5f"} Jun 02 18:59:31.739544 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:31.739548 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/must-gather-c2smw" event={"ID":"03bfc1d8-ace4-4c40-be77-1f723ca4b51c","Type":"ContainerStarted","Data":"ee4adc0ef66a486b186b8e153744c141f0ae4ef6c8b827b21d883af7e211debb"} Jun 02 18:59:31.759334 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:31.759269 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-w4k8q/must-gather-c2smw" podStartSLOduration=1.869136564 podStartE2EDuration="2.759250131s" podCreationTimestamp="2026-06-02 18:59:29 +0000 UTC" firstStartedPulling="2026-06-02 18:59:30.072028344 +0000 UTC m=+1184.884491133" lastFinishedPulling="2026-06-02 18:59:30.962141901 +0000 UTC m=+1185.774604700" observedRunningTime="2026-06-02 18:59:31.757294291 +0000 UTC m=+1186.569757102" watchObservedRunningTime="2026-06-02 18:59:31.759250131 +0000 UTC m=+1186.571712943" Jun 02 18:59:32.708949 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:32.708907 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2ltqf_f7a3402c-71c0-4f56-9136-99d51e043c53/global-pull-secret-syncer/0.log" Jun 02 18:59:32.840445 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:32.840392 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hbpbt_27555d26-14a0-4551-b300-38ab47ce8ebc/konnectivity-agent/0.log" Jun 02 18:59:32.966464 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:32.966375 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-185.ec2.internal_5aeaf278a0e5b76b237c975d46dc71d9/haproxy/0.log" Jun 02 18:59:37.249610 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:37.249528 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-kkl4m_352d895d-d05d-40fc-aa7f-4d7dee012672/manager/0.log" Jun 02 18:59:37.309406 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:37.309371 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xr6pw_55536d5e-aebf-46f7-a3a7-61cb45192a3d/manager/0.log" Jun 02 18:59:38.913761 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:38.913724 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-mcjsq_f9ef6220-80c6-4230-9e2c-66b89b8eed9f/cluster-monitoring-operator/0.log" Jun 02 18:59:39.119989 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.119961 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86cfd_a1aac776-6b64-4a37-95ae-b226aa08c352/node-exporter/0.log" Jun 02 18:59:39.159948 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.159908 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86cfd_a1aac776-6b64-4a37-95ae-b226aa08c352/kube-rbac-proxy/0.log" Jun 02 18:59:39.186284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.186250 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86cfd_a1aac776-6b64-4a37-95ae-b226aa08c352/init-textfile/0.log" Jun 02 18:59:39.411450 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.411414 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-sxzhx_0469ee3a-543f-4a5f-b52f-c85f1a42579d/kube-rbac-proxy-main/0.log" Jun 02 18:59:39.444118 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.444078 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-sxzhx_0469ee3a-543f-4a5f-b52f-c85f1a42579d/kube-rbac-proxy-self/0.log" Jun 02 18:59:39.473586 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.473557 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-sxzhx_0469ee3a-543f-4a5f-b52f-c85f1a42579d/openshift-state-metrics/0.log" Jun 02 18:59:39.522386 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.522359 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f8661c33-5647-4ca6-982a-4a9456178f19/prometheus/0.log" Jun 02 18:59:39.545422 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.545389 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f8661c33-5647-4ca6-982a-4a9456178f19/config-reloader/0.log" Jun 02 18:59:39.568687 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.568657 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f8661c33-5647-4ca6-982a-4a9456178f19/thanos-sidecar/0.log" Jun 02 18:59:39.593131 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.593103 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f8661c33-5647-4ca6-982a-4a9456178f19/kube-rbac-proxy-web/0.log" Jun 02 18:59:39.621175 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.621143 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f8661c33-5647-4ca6-982a-4a9456178f19/kube-rbac-proxy/0.log" Jun 02 18:59:39.648472 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.648430 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f8661c33-5647-4ca6-982a-4a9456178f19/kube-rbac-proxy-thanos/0.log" Jun 02 18:59:39.671431 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.671354 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f8661c33-5647-4ca6-982a-4a9456178f19/init-config-reloader/0.log" Jun 02 18:59:39.698721 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.698692 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qswwm_b967646b-646e-40b0-99e9-9d7c42487661/prometheus-operator/0.log" Jun 02 18:59:39.718645 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.718619 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-658bcd8bdf-qswwm_b967646b-646e-40b0-99e9-9d7c42487661/kube-rbac-proxy/0.log" Jun 02 18:59:39.743866 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:39.743823 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-fl4nh_c68aff05-0ad8-48a7-b2b3-1a3376078586/prometheus-operator-admission-webhook/0.log" Jun 02 18:59:41.068230 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:41.068197 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-76c9bb5fdf-mj6cz_e7bbe34e-7452-40fb-aca6-5303f3cdfeb5/networking-console-plugin/0.log" Jun 02 18:59:41.643963 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:41.643917 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:59:41.653818 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:41.653782 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/2.log" Jun 02 18:59:42.154431 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.154399 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-c65b8dc4b-tg654_df900abc-1db7-48a6-9c1a-db4c247f6158/download-server/0.log" Jun 02 18:59:42.561970 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.561881 2567 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp"] Jun 02 18:59:42.568109 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.568088 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.577934 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.577903 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp"] Jun 02 18:59:42.745838 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.745798 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-podres\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.746027 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.745873 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-lib-modules\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.746027 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.745944 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrjgv\" (UniqueName: \"kubernetes.io/projected/fcc5a800-0056-40b9-a790-c582a04c830c-kube-api-access-wrjgv\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.746027 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.746015 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-sys\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.746276 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.746055 2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-proc\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.847230 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.847195 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-podres\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.847512 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.847491 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-lib-modules\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.847820 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.847798 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wrjgv\" (UniqueName: \"kubernetes.io/projected/fcc5a800-0056-40b9-a790-c582a04c830c-kube-api-access-wrjgv\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.848352 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.848325 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-sys\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.848458 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.848367 2567 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-proc\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.848458 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.848398 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-sys\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.848458 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.847394 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-podres\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.848458 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.847734 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-lib-modules\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.848624 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.848498 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcc5a800-0056-40b9-a790-c582a04c830c-proc\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.856962 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.856941 2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrjgv\" (UniqueName: \"kubernetes.io/projected/fcc5a800-0056-40b9-a790-c582a04c830c-kube-api-access-wrjgv\") pod \"perf-node-gather-daemonset-bphxp\" (UID: \"fcc5a800-0056-40b9-a790-c582a04c830c\") " pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:42.883984 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:42.883956 2567 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:43.041242 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.041204 2567 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp"] Jun 02 18:59:43.044680 ip-10-0-140-185 kubenswrapper[2567]: W0602 18:59:43.044648 2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfcc5a800_0056_40b9_a790_c582a04c830c.slice/crio-20c07b0392da8a2b2646964997545a54ab544a3c21052bafdc13e52bbf1a07ce WatchSource:0}: Error finding container 20c07b0392da8a2b2646964997545a54ab544a3c21052bafdc13e52bbf1a07ce: Status 404 returned error can't find the container with id 20c07b0392da8a2b2646964997545a54ab544a3c21052bafdc13e52bbf1a07ce Jun 02 18:59:43.651527 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.651486 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj5lg_b3284f7e-a49f-4653-9f96-c06804b34f09/dns/0.log" Jun 02 18:59:43.670780 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.670755 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vj5lg_b3284f7e-a49f-4653-9f96-c06804b34f09/kube-rbac-proxy/0.log" Jun 02 18:59:43.744157 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.744128 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wpp2r_154022e6-248f-4861-b053-a9994a9e9a30/dns-node-resolver/0.log" Jun 02 18:59:43.795471 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.795420 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" event={"ID":"fcc5a800-0056-40b9-a790-c582a04c830c","Type":"ContainerStarted","Data":"964fa87d3e09cd79507c3a798f2a7d4cfc403516351949df8ef94d95a286b65a"} Jun 02 18:59:43.795650 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.795479 2567 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" event={"ID":"fcc5a800-0056-40b9-a790-c582a04c830c","Type":"ContainerStarted","Data":"20c07b0392da8a2b2646964997545a54ab544a3c21052bafdc13e52bbf1a07ce"} Jun 02 18:59:43.795735 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.795708 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:43.817848 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:43.817791 2567 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" podStartSLOduration=1.817775531 podStartE2EDuration="1.817775531s" podCreationTimestamp="2026-06-02 18:59:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 18:59:43.816628136 +0000 UTC m=+1198.629090945" watchObservedRunningTime="2026-06-02 18:59:43.817775531 +0000 UTC m=+1198.630238342" Jun 02 18:59:44.287371 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:44.287341 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hqr7x_a5892822-06c6-452e-ad71-7aba446f1618/node-ca/0.log" Jun 02 18:59:45.248988 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:45.248958 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6c8b7568-v2cgp_01b31ef0-9d06-46e3-a14c-ff6fa2a07f5b/kube-auth-proxy/0.log" Jun 02 18:59:45.319847 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:45.319809 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-87c65c465-xbm49_4346b2eb-596b-4b3f-a08a-dd6833c46230/router/0.log" Jun 02 18:59:45.712246 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:45.712212 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:59:45.713936 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:45.713906 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-46f7w_f7ac207f-754d-48e3-bebb-b16f0c4f16e3/console-operator/1.log" Jun 02 18:59:45.861322 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:45.861288 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bjgwr_7019a38a-dfac-4478-8411-b7bca7218343/serve-healthcheck-canary/0.log" Jun 02 18:59:46.402855 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:46.402830 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqz9r_f128bee5-a1e3-4d8d-a833-a713d0dca597/kube-rbac-proxy/0.log" Jun 02 18:59:46.424429 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:46.424398 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqz9r_f128bee5-a1e3-4d8d-a833-a713d0dca597/exporter/0.log" Jun 02 18:59:46.447813 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:46.447786 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bqz9r_f128bee5-a1e3-4d8d-a833-a713d0dca597/extractor/0.log" Jun 02 18:59:48.630592 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:48.630552 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7855c9d57f-wf7vf_1640c4e2-f590-4f75-bd0d-abbcdf4f3553/maas-api/0.log" Jun 02 18:59:48.658653 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:48.658620 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6686679c54-vjhhv_8cc671c1-888e-463f-9721-98189ee7183c/manager/0.log" Jun 02 18:59:48.844077 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:48.844045 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-mgdmv_9ae0ec40-cd62-405d-be63-83b6ebd38ead/manager/0.log" Jun 02 18:59:48.859735 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:48.859712 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dddc7c6cc-mgdmv_9ae0ec40-cd62-405d-be63-83b6ebd38ead/copy-manifests/0.log" Jun 02 18:59:49.809901 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:49.809859 2567 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w4k8q/perf-node-gather-daemonset-bphxp" Jun 02 18:59:50.299614 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:50.299584 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-655df48c9-s2tdj_5d44e37d-8d58-4e6b-adb6-fa45fb209474/manager/0.log" Jun 02 18:59:55.136284 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:55.136248 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-g4wxs_262fca87-d441-4d5a-abe0-dc91d3ad252d/migrator/0.log" Jun 02 18:59:55.157952 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:55.157931 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-g4wxs_262fca87-d441-4d5a-abe0-dc91d3ad252d/graceful-termination/0.log" Jun 02 18:59:56.870064 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:56.870033 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkqnl_52f2e98a-b555-4a0b-af02-01d34a9b0d23/kube-multus-additional-cni-plugins/0.log" Jun 02 18:59:56.889521 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:56.889494 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkqnl_52f2e98a-b555-4a0b-af02-01d34a9b0d23/egress-router-binary-copy/0.log" Jun 02 18:59:56.908276 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:56.908254 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkqnl_52f2e98a-b555-4a0b-af02-01d34a9b0d23/cni-plugins/0.log" Jun 02 18:59:56.929311 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:56.929286 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkqnl_52f2e98a-b555-4a0b-af02-01d34a9b0d23/bond-cni-plugin/0.log" Jun 02 18:59:56.954029 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:56.954009 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkqnl_52f2e98a-b555-4a0b-af02-01d34a9b0d23/routeoverride-cni/0.log" Jun 02 18:59:56.975680 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:56.975659 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkqnl_52f2e98a-b555-4a0b-af02-01d34a9b0d23/whereabouts-cni-bincopy/0.log" Jun 02 18:59:56.993929 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:56.993906 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jkqnl_52f2e98a-b555-4a0b-af02-01d34a9b0d23/whereabouts-cni/0.log" Jun 02 18:59:57.078705 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:57.078677 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vnnpk_5e04a94e-1507-48de-be8a-939b4a8d0ce7/kube-multus/0.log" Jun 02 18:59:57.188145 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:57.188066 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tbm7r_a8ce9161-c49b-4a7c-af89-1294da53da1d/network-metrics-daemon/0.log" Jun 02 18:59:57.208156 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:57.208130 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tbm7r_a8ce9161-c49b-4a7c-af89-1294da53da1d/kube-rbac-proxy/0.log" Jun 02 18:59:58.047274 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.047246 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/ovn-controller/0.log" Jun 02 18:59:58.082553 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.082524 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/ovn-acl-logging/0.log" Jun 02 18:59:58.104471 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.104440 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/kube-rbac-proxy-node/0.log" Jun 02 18:59:58.132558 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.132526 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/kube-rbac-proxy-ovn-metrics/0.log" Jun 02 18:59:58.156992 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.156970 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/northd/0.log" Jun 02 18:59:58.178571 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.178548 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/nbdb/0.log" Jun 02 18:59:58.203526 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.203505 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/sbdb/0.log" Jun 02 18:59:58.398255 ip-10-0-140-185 kubenswrapper[2567]: I0602 18:59:58.398223 2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-86wdb_e9286a64-8422-458b-9bcb-95aa44f00567/ovnkube-controller/0.log"